Confused

(Both of us 44) My husband has mentioned that he wants an open relationship now because I can't so-call attend to his needs. He says he have a high sex drive but what man would reject a woman when she is attempting to have and he pushes her away. To me that's not having a high sex drive seems like he wants it only on his time. Mind you he always seems to say his needs aren't met when he's horny and I'm at work. Now he is also saying he wants to sew his royal oats, he wants to go to a swingers club all things that I've told him should have been done when he was single. I asked why he didn't think about this before we got married. FYI we have only been married for a year. They say a drunk mouth speaks the truth needless to say he was and now he wants to come out with all his deep feelings/wants. I told him if that's how he's feeling then draw up the papers and we can go our separate ways that way he can do everything his heart desires. I cried myself to sleep. Am I wrong for feeling this way?