hormone guilt

i (ftm) have ovarian dysfunction in a family that i have yet to come out to. i have been perscribed estrogen in order to keep my levels stable. i do not take it, because it makes me incredibly dysphoric. i know this is likely bad for me, could someone who knows more about hormones tell me how to navigate this? thanks in advance.