Why should i not care about what others think of my favorite thing, if they constantly give it shade to the point where it is unbearable?

"Just enjoy the things that you like." "No need to hear what others think about it." "Who cares what people think?" Sure, these are all words and motos that we can live by. But, say that you are a fan of a football team for whatever reason and yet that football team sucks and people will always mock them around you. Surely, there has to be a breaking point where you just want to defend the team that you like. If football fans, sports fans, heck, if any fans can get mad at slander and hate, legit or not, why should i not care about what they say anyways? Why shouldn't i clap back for once and sling back the same shit that they threw? At what point are slander and hatred can be considered legit that you cannot do that?