Separate_Sand8265
u/Separate_Sand8265
Last month I was losing my mind.
I had a solid refund agent. One tiny prompt tweak in a PR. Tests green. Code review passed. I shipped it.
Next day in prod? It stopped asking for confirmation and started auto-refunding random stuff. Customers furious. I spent days tracing logs trying to figure out what broke.
Turns out the behavior changed. Not the code. Just how the agent actually acted.
That silent killer is why I'm open sourcing Shadow.
Shadow gives you behavior regression testing + causal root-cause analysis for AI agents. Dead simple:
You keep real production-like traces on your laptop (your data never leaves your machine).
You write one YAML behavior contract that
Last month I was losing my mind.
I had a solid refund agent. One tiny prompt tweak in a PR. Tests green. Code review passed. I shipped it.
Next day in prod? It stopped asking for confirmation and started auto-refunding random stuff. Customers furious. I spent days tracing logs trying to figure out what broke.
Turns out the behavior changed. Not the code. Just how the agent actually acted.
That silent killer is why I'm open sourcing Shadow.
Shadow gives you behavior regression testing + causal root-cause analysis for LangGraph (and other agent frameworks). Dead simple:
You keep real production-like traces on your laptop (your data never leaves your machine).
You write one
You've reached the end of this feed.