Caffeine and Physiological Stress

I know most people post about how they cut caffeine and everything improved. I try not to drink coffee daily to not be dependent on it. What I have noticed however is that when I drink coffee before work my stress levels stay low, but when I don't have coffee I stay close or in the stress range all day. I do the same work with the same activity level each day.

Any thoughts on this paradox?