Help me play with this story idea?

The protagonist has seen the same stranger, on random occasions, throughout his life, beginning in early childhood. He sees him in different cities, even countries. The circumstances that bring them together keep them physically apart, making eye contact across a crowded room or some other barrier. When his life turns sour in his thirties, he begins obsessing about the stranger, and what it all might mean.