AI agent and tool developers, we want to talk to you...!

I have been building AI agents and tools for a while, the most challenging pain points was I always kept running into memory management problem.

The current approach was to dump everything into a huge bucket and all it was doing a retrieval. This created a problem again with:

1. Noise starts accumulate over time

2. Latency issue

3. Agents hallucinate or lose track of important earlier decisions

To solve this, I have been experimenting with a strict four layer memory system, that tries to different types of information, so instead of treating everything as one big retrieval bucket. The goal was simple, low latency, less noise, and memory that should actually improve rather than degrade as the agent runs longer.

I want to see how other people are handling this:

1. Still using a pure RAG/Vector?

2. Graph, structured state or something more custom?

3. What was the biggest source of hallucinations or forgetting in your agents?

If anyone is currently building agents or tools ( happy to share more thoughts and technical details on the approach), feel free to drop a comment or a DM. Always interested in talking to people in this space.