Less than a year married but 5 years together..

I love my husband. He’s my best friend and I would do anything for him and appreciate everything he does for me… but there’s one thing missing and that’s intimacy. We have never been very sexual with each other. From the beginning I have never really had urges to have sex with him and although used to practically beg for us to be intimate he has come around to the understanding that I am just not as sexual as I used to be. Prior to being monogamous with him, I used to sleep around a lot and drink and hop into bed with everyone and he is aware of that. Before marrying him I made extra sure over the course of years that he was okay with me just not wanting to be that physical all the time or hardly ever and I myself made peace with that as well.

Fast forward to today and now I’m realizing that we are both sexually restricted. Yesterday he made a comment to me and said something along the lines of “…you just don’t want to be sexual with me” and I haven’t been able to stop thinking about it since. I

tried to determine the root of the situation and thought back to our sexual encounters… I occasionally give in and give it my all and most times I tire him out to the point of exhaustion and he will not finish. This in turn makes me frustrated and I will not finish and that makes me not want to have sex with him and then he becomes frustrated and the cycle continues. Additionally, he is no longer physically the same as when I met him and although I’m not repulsed by him, I’m not as sexually attracted enough to initiate anything.

tl;dr: I really want to have a conversation with him about maybe swinging or bringing in people JUST for the sex. I have no desire to start a life with anyone else and I know he doesn’t either…. Has anyone had this experience before? How to initiate? How did it go?