Can anyone help me figure out why I feel this way

Hey everyone, for the past year I have been out as Grey-Asexual, I'm pretty happy with this term as obviously I can be sexually attracted to people but its its incredibly rare, and for the most part is something that almost never happens with me in a relationship.

I've slept with partners who I hadn't been sexually attracted to before and it always made me feel kinda uneasy but not too icky or uncomfortable. I've usually described myself as sex neutral because as much as I'm probably not attracted to them, the idea of sex isnt necessarily repulsive.

I've gone just over a year without sex and have been much happier this way, and when I look back on when I was sexually active, as soon as I started regularly sleeping with someone its like I would become addicted? And then when I wouldn't have sex it would make me angry and upset.

I'm not sure if the reason I would react so negatively while sexually active is my body telling me that having sex isnt what it wants. Or if maybe I actually got addicted to it and faced incredibly strong withdrawal symptoms.

I just wanna know if any other ace or ace spectrum folks have felt similar to this before? I kinda still wanna have sex with those very rare people I can be sexually attracted to, but it's like my body is telling me that sex isnt right for me?

If anyone knows how this feels please let me know your experience with it