Local AI running Skyrimnet (AI brains for everyone) with fast response times

https://www.youtube.com/watch?v=fU0PW4GPM6U

Took about a week of slowly removing info from the prompts and trying different models but I now have a fairly coherent "world simulation" going on in my Skyrim where people can talk to each other, I can talk to anybody with my voice with pretty much instant responses and the people can perform a variety of actions like attacking me/others, arresting me/others, giving/taking gold, leading the way traveling to locations, etc and it's really fun to mess around with. I tried to remove the default dialogue from the game and rely almost exclusively on realtime generated dialogue, but I also added speaking out loud to choose vanilla style dialogue options with Dragonborn Speaks Naturally.

It's honestly not too hard to set this up. I cared a lot about response times so I stripped a ton of info that the AI normally sees and strictly kept what is necessary for coherent roleplay and awareness. Just shortening the prompts myself or running certain ones through ChatGPT was enough to lower the info down enough to get ~1 second response times most of the time. Also using a really small model, either Qwen 3 4B 2507 Instruct or Llama 3.2 3B Instruct. Models in this range seem to be good enough at everything while being fast enough.