How can I host a contact mission? PS4

Me and a friend want to play contact missions together but keep joining full lobbies and cannot invite each other. Is there a way I can go into an invite only lobby and invite my friend then still be able to find 2 other random players by turning on matchmaking ?