My Past bothers him 23F

23F I just quit stripping last month, been dating him for 5. he knew me when I danced and never was against it and always found it hot. now that I’ve quit and do something else he keeps saying it bothers him my past abour how many guys I’ve danced for and etc. I was a dancer for 2 years is this just how it goes when you had. A past like this? Would it bother most guys? Or is this just a one off situation