Can I please have a conversation???

There's GOT to be a way to stop wild pals from locking onto me in the middle of dialogue. I just had to skip nearly the entirety of the conversation with the questgiver in the world tree because Rayhounds and Grizzbolts spawn too close to him and kept blitzing me while I couldn't back out. Is there an item that makes wild pals never aggro onto you, or even a mod that makes it so pals de-aggro during dialogue only?? It's happened like three times across my playthrough and I'm pretty sick of it..