[the prestige] how does no one know the borden are twins ?

There gotta be someone from their childhood , their parents , neighbor , friends who know who they are before they start becoming magician

If the answer is “they perform faraway” then they don’t even have to swap lives with other , just have one brother live far away from the other and only meet up when performance is near so I don’t think that is the answer