Does anyone else deal with non-residents always in their building?

I live in a “luxury” apartment that was built a couple of years ago. We live near a big city and everything is key-fob access, gated garage parking, etc. even the elevators need a keyfob to use them.

Since I’ve moved in, there have been countless homeless people find a way in and sleep in common areas, etc. even non residents that come in just to use our workspaces (we have a wework type space on the 3rd floor).

We don’t even live in a part of the city where there are homeless people, but somehow they always gravitate to our place.

Anyways, does anyone else have this happen that lives in a similar place?