Latin Americans often make toxic work environments

I’ve worked for multiple jobs and every single time there’s was a toxic work environment was because of Latin Americans. I’m not even trying to be racist, I’m a extremely friendly person and every other race of people return the kindness but not Latin Americans, they often take my kindness for weakness and spread rumors, gossip and mock me when I’m not around. I thought I was just me but Ive also seen them do the same to other non Spanish speakers. Am I alone in noticing this or just seeing patterns that aren’t there?