What do I do in this case?Will he thinks it's too much

I’ve been dating my boyfriend for around two months now, but we were very close friends for about a year before that, and I genuinely love him and see a future with him.I have a childhood male friend that my boyfriend knows about and I understand why it sometimes makes him feel jealous. Recently, my friend has said a few things that made me uncomfortable and made me question whether he might have feelings for me. For example, he pointed out that he doesn’t talk to any girls except me and even showed me a proof which is very unnecessary

Because my boyfriend and I are long-distance, there are times when I tell him I’m doing certain activities with this friend, and I can feel the tension it creates between us. When I thought about it from the opposite perspective, I realized I wouldn’t feel comfortable if my boyfriend had a female friend in a similar situation.

For that reason, I’m considering setting stronger boundaries and distancing myself from this friend on my own, without my boyfriend asking me to so i am thinkingto tell my bf that i am gonna distance myself from my friend. My priority is my relationship, and I don’t want to be in a situation that creates guilt, tension, or misunderstanding but what to tell my bf and am I being so dramatic?