Dynamically switch local models during the summarizing process
Hey, I'm still kinda new to the whole local LLM thing but I've started using hermes recently and I was amazed with how well it runs with my workflow.
I use Qwen 3.6 27b on my 4090 and have 140k context tokens which is working great for me, but on long conversations the summarizing thing is taking way too long, I was wondering if there could be any way to swap to another lighter model like gemma for this task, and like dynamically load/unload the models?
Thanks!
Posted Aug 13, 2026, 5:00 PM UTC
27