Anyone strongly against the audience helping to call in/out?

Usually when I play rec games and nobody is sure if it's in or out, I'll holler at the people watching "did you guys see if it was in or out" and I'll go by that answer. If they shout in / out on my side or the opponent's I'll go with that too.

However recently I was playing and one guy was riled when he hit a shot and the audience called it out; he said it's only for the receiving team to call, and insisted on replaying the point. This is the first time I've seen this and is it common?