How can immigration be a bad thing?

What is the problem with people immigrating to one's country? Is it hurting someone? Why do countries put up obstacles to make immigration difficult? Isn't more people generally better for GDP?