The world is not built for AI agents (yet) — what we learned the hard way

We're building managed AI agents for non-technical users. Here's what nobody tells you about giving AI agents access to real-world tools.

APIs assume a human is in control.

Take Twilio. We give each agent its own phone number for SMS and WhatsApp. Sounds simple. Except Twilio's permission model assumes one account = one operator. There's no concept of "this API key can only access this number." So we had to build an entire authorization layer on top to prevent Agent A from accidentally texting Agent B's contacts.

This pattern repeats everywhere. Most APIs were designed for humans clicking buttons in a dashboard, not for autonomous software that needs scoped, minimal permissions. The agent security model basically doesn't exist yet — you're bolting it on yourself every time.

The PLG death spiral with AI products.

Building a product-led growth AI product is a special kind of pain. People sign up, try it once, hit one tiny friction point, leave, and never tell you why. With traditional SaaS you can look at where users drop off in a funnel. With agents, the failure mode is "the AI did something slightly wrong and the user just… closed the tab."

You're iterating on silence. No error reports. No angry emails. Just a quiet churn chart going the wrong direction.

What's real after the hype.

The underlying idea is sound — people genuinely want autonomous agents handling entire functions (marketing, sales, support) so they can stop carrying the mental load. But the gap between "cool demo" and "I trust this to run my business" is enormous. Security is a nightmare. Reliability expectations are sky-high because you're promising automation, not a tool.

The speed is real though.

3 developers. 4 weeks. We built what would've been a 4-quarter product roadmap 2 years ago. Claude Code for backend, Lovable so our less-technical team could contribute to frontend, full TDD, strict type checking. The AI-assisted development loop is genuinely a step change — not hype, just faster iteration.

Curious if others building in the agent space are hitting similar walls with API permissions and PLG feedback loops. What's working for you?