Psychiatrist says that my fatigue is not at all linked to ADHD

Hi! I’ve just been diagnosed with combined ADHD a few months ago and started on medication. I’ve always been a super tired girl in general, my whole life since childhood. I’m the person who can literally take a 3 hour nap, wake up for a few hours, and then go back to sleep for the whole night with no problems whatsoever. It’s not like I’m narcoleptic or anything, but other than the first few hours of the morning, I pretty much feel like if I allowed myself to lay down, I could fall right asleep at any time of day. This has always been my baseline, but my ADHD comes with a lot of anxiety & I’ve noticed that I’m definitely much more sleepy during the day if anxious or stressed. I’ve also set unrealistically high expectations for myself my whole life and typically take on too much work/school/responsibilites. I’ve read similar experiences online from ADHD women.

Since being medicated, my anxiety is so much better and I do have more energy, although my job is pretty stressful and most days, a 5pm nap or going to bed for the night at 6-7pm still just sounds amazing. I’ve shared this info with my psychiatrist from the very first appt. Low energy levels in general but crazy chaos in my head. I do have PCOS, have had my thyroid checked several times, etc. but labs have been fine - always chalked it up to just being a naturally tired girl. My dad also had a very sleepy nature.

When my psychiatrist mentioned my sleepiness again in my most recent appt, I shared that I am still feeling fatigued by about 3-4pm, but not nearly as bad. They are insistent that this has nothing to do with racing thoughts or ADHD, but that I need to get sleep tests, rheumatology labs, etc. done before my next appt. I do agree that it would be good to have these things ruled out, but was kind of surprised with their opinion of it being very abnormal for ADHD women. What are your thoughts? Does anyone else experience this or am I going crazy??