Negged in informal chat

Had an informal chat about potential future opportunities at a company a few days ago. Mentioned in passing as we were talking about academia, that I had been offered a PhD, but didn't take it, as I wanted to be able to save up some money and buy a house at some point. Got asked by the interviewer, "And how's that going for you?" and then laughed. Maybe I don't have a sense of humour, but I haven't had full-time work since graduating, and I already feel shit about myself 24/7. I don't need it to be rubbed in even more. 1-0 to them. Top corner.