Caught between awful depression and anxiety

So When I don't drink caffeine (or tapering down) I get horribly depressed and fatigued. When I do drink it though, sometimes I feel great but often I get jittery and anxious.

Has anybody had depression and it got better after quitting caffeine for a while (>2-3 weeks)?