Exercise leading to Caffeine sensitivity and sexual dysfunction

Anyone else having issues like this? I've been drinking pulled espresso shots (only once per morning) with steamed milk every day for several years with no issues.

I just now hit a stride where I'm going to the gym almost every day. I've been exercising with a calorie deficit for about one month. The pounds are finally beginning to fall off, and I have a lot of energy during the day...and at night...and at 2am when I wake up after only five hours of sleep. my fight or flight takes off during sexual activity and I lose all ability to perform if you know what I mean. When this happens, my heart starts racing and I get all jittery and spazzy feeling. I hate it. This only happened a few years ago when I started exercising, and it's happening again. I'd say I have a normal to above average sex drive

I love my morning espresso, but it's made me wonder if I might be addicted to caffeine. I've never gone without it, but I've become so sensitive to it that I might actually consider quitting caffeine cold turkey. Has anyone else ever experienced this?