OA lang ba ako? O sadyang medyo off na

My boyfriend and I are both adults. We’ve been together for years, and on weekends, we usually spend time at each other’s houses. It’s not even every weekend sometimes I go to their house, sometimes he comes to ours. Whenever I’m at their place, I don’t just sit around. I help cook, wash the dishes, and even clean because that’s how I was raised to help out when I’m a guest. Recently, my boyfriend told me that his dad talked to him and said I shouldn’t come over “too often” because apparently some neighbors have been saying things like, “Bakit laging nandito ’yan? Hindi pa naman sila kasal.”

What hurt me is that this only became an issue now. His family never gave me the impression that there was a problem before. They were always welcoming, so hearing this through my boyfriend caught me off guard.
I understand that his parents may just be old-school and concerned about what other people think. But at the same time, I can’t help but feel a little hurt that the opinions of neighbors suddenly matter when we’re both adults and we’re not doing anything inappropriate.
Am I overreacting for feeling this way? Or is this just one of those situations where I have to accept that different families have different boundaries and values?