What's the best way to getting started with making a game?

I've always been curious about game design, even when I was a little kid. I've had plenty of ideas for games here and there, but never really knew how to make them actual things.

I'm terrible at math and programming languages have always looked really daunting to me, so I guess that's been my deterrent.

I figure maybe making a game could be a fun hobby or something to do on the weekends.