What Research Says About Structuring LLM Agent Harnesses
- Deterministic guardrails beat smarter models
- Majority vote beats debate
- Hierarchies work at scale; multi-agent orgs fail in human ways
- Memory needs an architecture, not a bigger context window
- Sandboxed execution AND verified outcomes
- Harnesses are finally measurable — and they matter more than the model
- Cost routing
- Autonomy is earned: trust calibration and supervised practice
- Open problems
No standardized, repeatable A/B comparisons of full harness architectures yet — Harness-Bench (§6) is the first step, but diagnostic rather than leaderboard-grade.
Injection defenses saturate current public benchmarks (firewalls paper, §1) while failing on dynamic ones (AgentDyn) — evaluation lags deployment.
Single-agent safety certification does not transfer to multi-agent deployments (Anthropic, §3).
Trust calibration research (§8) studies human perceptions of agents; equivalent measured results for system-side earned-autonomy policies (e.g., statistically tuned promotion gates) are still emerging.
Posted Aug 27, 2026, 1:09 PM UTC
510