[Non-TRT user] Anyone already experiencing symptoms of high E2 with just a slightly elevated E2 level (48 pg/mL)?

Asking here since I suppose that people here will be more knowledgeable.

I'm 5'9 and 170 lbs. My test level is 865 ng/dl, so an E2 level of 48 pg/mL is to be expected. However I've been experiencing various physical and mental symptoms for years which I can only attribute to hormones:

Physical: enlarged nipple and breast tissue, fat deposits at the waist (I have the so called "skinny fat" body type), muscle weakness and flabbiness, poor cardio exercise performance

Mental: feeling weepy and emotional, generalized anxiety and racing thoughts, low mood, social anxiety and timidness, insomnia, lazy and unmotivated, sugar cravings

Those symptoms were diagnosed as depression, anxiety and ADHD. However various psychiatric medicine did not help at all.

After I self-medicated with my first dose of anastrozole (0.5mg) 4 days ago, these symptoms mostly disappeared within a few hours. I understand the pain of low E2, so I will refrain from re-dosing until I feel these symptoms coming back. I know it's unscientific and maybe foolish, but no doctors are willing to treat a non-medical issue, and I'm getting quite desperate as it's affecting my career and livelihood.

Would there be any issues I need to note as someone taking anastrozole without being on TRT? Are there anyone else facing the same issues?