What criteria would you say an activity has to have before its considered a sport?

I got into an argument with a friend last night over what constitutes a sport. I argued that it had to include hand-eye coordination, the ability to play defense, and cardiovascular endurance. Now this would leave off activities like swimming and golf. What do you guys think?