Xbox One Bedrock

My Friends Non Realm won't let anybody but me and him to join (World is on Multiplayer not Local and Friends of Friends can join) any help on what to do with be appreciated