Tired of LLM amnesia in RP? I built a local AI roleplay client where messages have in-game timestamps so the AI never mixes up the days.

I've been into AI roleplaying for about 3 years now. At first, things seem really cool and the replies are great, but the more you do it, the more flaws you notice. Memory gets lost and leaks out heavily. Summarizations exist, but from what I've seen, they don't really save the situation. You'd think that simply increasing the context window would make things better (even if it costs more), but that's not true. Actually, the larger the context, the worse it often gets.

Nowadays, many API providers support prefix auto-caching, which can save a lot of money, but the sliding history window must also be updated accordingly if you want a stable effect. Honestly, everything currently on the market isn't executed very efficiently. It can always be better. Quality in roleplay is practically limitless; you just need the vision.

And so, since AI corporations are generously subsidizing vibecoding today, I decided it's my time to develop the most efficient, freely customizable memory system that combines maximum quality and efficiency. I integrated RAG, ensuring the most relevant chunks fly into the context along with the lorebooks. I created several levels of summarization and memory, and even added dynamic lorebooks—meaning lorebooks are written right during the story. Each chat has its own lorebook that records entries on the fly. I also planned the architecture to combine all of this so that context enters the cache as efficiently as possible without losing quality.

Furthermore, I added some gamification elements, like taking quests or an inventory that the AI model can update on every turn. I also designed everything around a time system—every message and every summary has an IN-GAME timestamp. So, a summary doesn't just exist; it provides information about the entire journey and *when* it happened. It knows what happened yesterday or a week ago and won't mix up the timeline. This is something that really annoys me in SillyTavern; when I see such inaccuracies, honestly, I used to just exit the chat and couldn't continue.

Here, however, I'm running a single chat that already has 400 assistant messages (about 500k context). I love when responses are long and the chat reads like a book, and to be honest, the app is designed heavily around this type of experience. The result is impressive: the system really remembers everything thanks to this setup. It knows literally almost everything. Of course, I didn't limit the customization options, so anyone can tweak it to make the experience even better. I built everything that I believe makes for the ideal roleplay app:

1. **Fully local desktop app:** No cloud, everything runs on your machine.

2. **Complete freedom and free of charge:** You can connect whatever you want. I even implemented custom embeddings fine-tuned for the ultimate roleplaying experience.

3. **Mobile support via server:** You just enable the server in the settings and play straight from your phone. Right now, this is my primary way to play.

4. **SPEAKER SYSTEM:** I get lost in chats where multiple different characters are talking, so I designed everything so that multi-character dialogue isn't torture, but a true immersion into the story. Each character has their own specific color.

What do you guys think about this? Are you satisfied with what you have today?