Unmatched or ghost when I am asked what I do for a living.

I am noticing that I will have great conversations going (M45) Most women will eventually ask what I do for work. On multiple occasions I will tell them what I do, which is a food service director for a state penitentiary, I think everyone that asks me either un matches, or goes ghost. Is working in a penitentiary a turn off? I have a ton of vacation a year, and make a decent living of my job. Any insight would be appreciated.