Is it racist if I’m scared of them.?

I don’t know if this was ever asked before but it didn’t show up when I googled this so I’m just putting it out here in hopes of a social answer

I’m not scared of black people due to their color, but i think I am due to practically every black person I’ve seen is either loud, mean, or intensely both. I think it’s more of a skill issue on my part than them, as I get overstimulated easily, put I’m not sure if it would be considered racist or not, and if it is… how to stop.? I don’t wanna be racist :(