Can't invite my friend even though we are on the same internet right next to each other?

This has been happening ever since we bought the game. We want to play teams, but the invite button won't work. We have to restart the game 3+ times before we get a invite to actually go through.

Any simple fix?

Are we doing something wrong?

Thanks for your help!!