Am I wrong for still loving my brother even though he is objectively an asshole.

For reference me and my brother are both white he is M(17) and I am M(18). My brother even though he is younger than me has always been the bully brother type push you around and beat you up kind. Its something I've grown accustomed to over the years its been less physically and more jokes things he says that are trying to be funny just arnt and are rude. But lately over the last year or so it has gotten more intense I dont know if its some kind of alpha male culture or what but he user the N word constantly not necessarily for racist remarks but it inherently is a racist word. I am an openly gay male and whenever we talk he finds a way to call me the f slur and makes fun of me if we're talking about relationships or potential ones he will act grossed out if I say anything about guys but I just try to not take it personally. But as I get ready to go to college the thought that I want to cut him off keeps crossing my mind we dont really talk much anyway but I dont want to create unnecessary drama in my family and Its not like I hate him I still love him but sometimes its hard. And yes I've tried talking to him but I just get called a f slur and then the n word.