I don't think HM is for me...

Made it to the grove without any issues really but then I decided to reorganize my spells and such. As I'm clicking through the radial menu swapping skills around, I accidentally clicked on one of the attack skills so my character took out his sword. Zevlor immediately rolls initiative against my party, no warning. Insta killed Gale with a searing smite and then trapped the rest of the party against the gate and I couldn't escape. Welp.