RedThread, keeping LLM-agent security regressions replayable

I build RedThread, an open-source CLI for a narrow LLM-agent security test.

A retrieved document or tool result can change a later tool call without ever being granted authority to change the job. The run may end with a refusal or a denied action, but I still want the record of what context reached the proposed call.

RedThread stores the context, tool schema, proposed call, result, and score in a replayable case. I use it to compare prompt, model, and adapter changes without treating a green result as proof of impact or production safety.

Source and code: https://github.com/matheusht/redthread

Posted Sep 11, 2026, 3:23 PM UTC

10
Loading comments…