Do people who know sign language get distracted by someone using sign language within eyeshot the same way hearing people get distracted by people talking around them?

Hearing people get annoyed by people talking when they shouldn't be (in class, at the movies, at church, etc) or might have a harder time focusing on what their doing if there's a conversation going on within earshot. Does the same thing happen to deaf people - or anyone who speaks a sign language fluently for that matter - when someone's using sign language within eyeshot ?