Why does my guy friend keep bringing up other men who are interested in me?

Why does he worry about running into the men that are interested in me and then jokes about it other times? I am into my guy friend, but I am confused about him bringing up men who are interested in me into our conversations. It seems that he is teasing. Occasionally, he actually seems annoyed. Rather than putting them down, he usually "pairs" me and those guys in a joking manner. I always say no and how it is gross. At other times, he becomes anxious and annoyed when talking about them or tries to avoid them. He says "I hope they're not here/I hope we don't run into them." I did ask him if he wanted me to be with them and he went quiet. Sometimes I worry if he wants me to be with them. Why would he do this?