Is there any reason I can't switch from a Lone Wolf party in act 1 to a 4 man party in act 2?

I'm having trouble getting my party rolling so I'm going to use Lone Wolf to brute force my way through act 1. Will I still have all my companions available even if I don't do their personal quests on the Island ? Is there a point of no return as far as recruiting companions?