Have any of you quit caffeine? Was it worth it?

I'm not a big caffeine drinker at all, I have probably the equivalent of a cup and a half of coffee a day. But it's starting to annoy me that I feel like crap until I've had my first one, and so I'm wondering if it's worth quitting.