Do I really need to do my taxes?

I'm an undergraduate college student in the US and it seems like nobody else does their taxes. Because I'm on a full ride scholarship any extra scholarships I get counted as income. I don't have an official job, but I got non employee compensation from an internship. Every year I end up paying $3,000 in taxes!! People in my same situation just aren't filing and nothing has happened to them. What are the odds that I'll get into trouble if I just don't do my taxes next year?