Home: Landing in someone else's house

I've noticed that sometimes when I go the the AH or Cash Shop from my own Home and leave after having been in there for a long time, I land in some random person's house.

But recently, for some reason, when I log out from my own Home and then log back in later, I land in a random person's house, but it's always a specific random person's house. I don't even know this person but I end up intruding very often, and they always seem to be in their house when I land there.

Has this happened to anyone else or is it just me?