Are all VOCs "bad"?

The first couple of times I heard about VOCs it was in a negative light and I had no idea what that even meant.

My current understanding of the word volatile in this context is a chemical that is a gas at the current temperature and pressure it is in. Correct me if I'm wrong.

Aren't VOCs also the fragrance from cooking food or that plants give off?

I haven't heard much fuss about those, so are all VOCs dangerous? If so, why?