The production AI engineering work that nobody budgets for, the integration layer problem

Something I see consistently underscoped in AI feature development: the integration layer, the engineering that connects the AI component to the rest of the production system.

It doesn't show up in demos. It's not the interesting AI model work. And it typically ends up being 40–60% of the total production engineering effort.

What the integration layer actually includes:

Auth and permission scoping — Does the AI have access to the right data for the right user, correctly scoped? In multi-tenant SaaS, this is non-trivial. "Technically accessible" and "correctly permissioned" are different conditions.

Async handling — AI calls are slow: 800ms–4 seconds is typical. What does the UX do while waiting? What happens on timeout (and what's the timeout threshold)? What does the user see when the AI call returns garbage? Retry logic and circuit breakers for rate limiting?

Output rendering — AI responses rarely map cleanly to UI components. Text that needs formatting. Citations that need links. Structured data that needs to render as tables. This is underestimated almost universally.

Output validation — Automated checks before anything reaches the user: format compliance, confidence scoring, basic factual grounding checks. These sit between the AI call and the user-facing response.

Feedback collection — If users can rate, correct, or flag AI outputs, that signal needs a capture system, storage, and routing to quality improvement. Usually an afterthought that should be a day-1 requirement.

Audit logging — Especially in regulated industries: what the AI returned, to whom, in what context, when. Compliance requirement. Also essential for debugging when things go wrong.

The scoping problem:

The integration layer tends to get scoped as part of "frontend and backend work" in project plans rather than as its own category. Which means it gets underestimated by the engineers who've built the AI component (because it doesn't feel like their work) and underestimated by the frontend/backend engineers (because AI integration isn't standard web dev work).

Each item above is realistically 1–3 weeks of engineering. Together: significant. The projects that account for this in week 1 are delivered on time. The projects that discover it in week 7 don't.

Has anyone found good frameworks or checklists for scoping the integration layer on AI projects? Or is this just something that experienced teams have learned through painful iteration?