Is taking an aromatase inhibitor really okay?

I had my estrogen levels tested and they came out at 64pg/mL. I already know it's a little high, but my testosterone is over 1300, so I thought maybe there was no problem with the balance.

However, I thought it was still too high, so I insisted to my doctor that I should be prescribed an aromatase inhibitor, and was told "Your body processes hormones differently from cis men, so your estrogen levels are fine since women typically have levels of around 100〜200 or higher." Apparently, a level of around 64pg/mL is normal for men too... I really don't believe it. I was also told an aromatase inhibitor would be bad for my heart and bones…

Really, I don't feel unwell or have any symptoms that could mean my estrogen levels are too high, and I haven't menstruated since I tried reducing my dose…So is it really that dangerous? If it's possible to be prescribed an aromatase inhibitor, should I worry about my heart failing? Please tell me.