Ashamed that I sometimes I feel joy in people’s heartbreaks

More towards the non ugly people. Coworker of mine was mad that her man cheated on her and had a conversation with almost everyone about it. I did not want to partake in this conversation at all, but honestly all I wanted to say was “yea, he’s good looking, chances are girls are throwing themselves at him” but of course I just said stuff to calm her down and some empathy. I’ve met this guy cause he stops by every now and then, I actually liked him, really nice dude. She herself is attractive as well but this dude looks like Benicio del toro young, plays baseball. I’m honestly trying not to feel this way, anyone else find themselves doing this?