New to the idea of PC gaming, would like some advice/information purchasing my first gaming PC.

So like the title says, the idea of getting a gaming PC is something relatively new to me. I've stuck with consoles mainly for the nostalgia (I've had every console generation since the Super Nintendo), and because all my friends have a console so it's easy to play together. As of now, I have a PS4. I know that gaming on a PC would be much more fun, but I've been put off with the idea since I mainly game with just friends (something simple like Super Smash Bros and FIFA). I have a Mac (I know), and I bought a very nice gaming monitor. I played a few games using my mac, and I've enjoyed it tremendously, which made me consider buying a PC so that I can play much more without any restrictions. I've been looking at the Syber Vapor (http://www.bestbuy.com/site/syber-vapor-e-desktop-amd-athlon-x4-4gb-memory-500gb-hard-drive-black/4676301.p?id=1219795214133&skuId=4676301) since it's relatively cheap and the hardware seems to be fairly good for starting out. I'm not trying to break the bank since I'm a broke college kid, and I feel building a PC would be the proper next step after I try it out first. I think the feel of the Syber would be a very nice transition from console to PC. Are there any recommendations that would be fairly similar to the Syber in price range and hardware? Any and all suggestions would be appreciated.

(PS: based on what I've seen, a tremendous amount of Steam Machines are ridiculously overpriced for what they present.)

EDIT: You guys have been more than helpful with my question. Thank you for all the support! It seems like building is the way I'm going! Is there a case that anyone could suggest that looks fairly similar? I like the idea of it kind of looking like a console. The way my room is set up, it'd look a lot better than having a tower.