Stuck at level 3 in fort joy... what did I do wrong?

I've done everything I'm supposed to do, I even looked up walkthroughs to see everything I can do to get xp, and I'm still just 75% of the way to level 4 with literally nothing left that I can do. The only "level 3" fights are the arena of the one and the houndmaster, both of which I've tried but are not possible for me. I think I softlocked myself by choosing the wrong classes. I have a two handed knight, a ranger, a rogue, and an enchanter. The enchanter is useless because nobody else deals magic damage. The rogue and knight suck because melee sucks, although the rogue atleast has a short ranged teleport while the knight spends more time walking and dying to ranged enemies and fire surfaces then he does attacking. The archer is the only useful character. Which classes are good early game? Do I need to restart and have 4 summoners or 4 archers instead of different classes?