New Relationship

So just for context I'm 27 years old. I met a woman a little older than me while I was out at a bar in her early thirties and we clicked instantly. As in any new relationship the sex is virtually constant which of course I love. It can never be enough. We've also gotten very into each other. We've been away for a romantic weekend and I stay over at her place three or four times a week and when I do we do it three or four times a night. She let me know early on that she's married and while I thought it would bother me it didn't. Apparently her husband is asexual for a variety of reasons which I won't bore the subreddit with as I'm sure you've read them a hundred times. He was fine with this at the beginning but now she's telling me it bothers him because of how constant it is. She's not interested in reducing our time together and of course I'm not either but am I in the wrong here?

Please advise and if I need to be roasted that's okay too. I have a thick skin haha