Toxic work environment

I've been in this company for 9 years now but recently (7 months ago) transfered to another department working with women (I have nothing against women just no experience working with them). The first 3 months were ok but then they completely flipped on me and now they don't even look at me anymore and started making rumors about me, the amount of gossip is insane. They completely destroyed my reputation not just the women but also the men keep talking shit behind my back and coming up with lies. I don't know what to do I cant trust anyone anymore in this department and have a ton of debt so I cant just leave. My anxiety has skyrocketed triggering me to fight or flight. Is gossip everywhere? I know I'm weird but not to the extreme where everyone basically hates my guts.