Question & typical love the actor, hate the character!

Question before the hate/love sesh: Was there ever a moment in the show where D'Onofrio absolutely hated or really disliked the actor that was playing the episode's antagonist?

So I would 100% consider myself a Bobby Goren hater. Cannot even be in the same room as someone watching CI because I will be mad for absolutely no reason because I cannot *stand* Bobby Goren. In fact, I will even go as far to say that I am glad he was never able to charge Nicole Wallace with anything (because of her not guilty verdict in "Pas de Deux") thus never being able to fully arrest her on anything. I hope it will always eat at him that his mentor was the one to get her, not him. With that all being said and off my chest, Vincent D'Onofrio is an awesome actor!! I love his Kingpin and love his Edgar as well!! I'll even grudgingly say I love his Goren too (jokes there, that's what makes him so good imo)