No friends lost showing when trying to share world

Hey so me and my friend are both playing on Xbox and have been trying to share a world with each other so we can play when there’s only one of us on, however when we press invite friends to shared world it’s shows to friends in our friends list so we are unable to invite each other I’ve made sure I have crossplay turned on on my Xbox and have tried most solutions other than deleting and redownloading the game. Is this a problem others are having aswell or is the a way around this/to fix it thanks