What's the best way to back up all my data to my computer?

I have to exchange my defective phone for a new one and want to download all my data (contacts, pictures, apps, app data) to my computer before I do so I can load it all on my new phone. What's the best way to do this?