After a doctor visit, my loved ones are stopping me from using hearing aids, saying it will ruin my hearing

I was told by someone that my hearing will be ruined if I keep using hearing aids. (I was diagnosed via audiometry for fitting the aids). Because of this, my parents stopped me from using all forms of hearing assistance, including my hearing aids. I am hard of hearing, and I can hear a little bit, but I cannot hear everything. They believed everything I have is conversion disorder, which I understand where they are coming from but I do not understand why they would think that wearing hearing aids would ruin my hearing.