What are you actually using AI for in your test pipeline right now?

I've been using Copilot for unit test scaffolding for a few months now and it saves me maybe 20 minutes a day on the boilerplate stuff, assert blocks, mocking setup, etc... Nothing that makes me rethink how I work.

What I keep hearing about though is teams going way further with it. Full e2e test generation through agents, exploratory testing where an LLM is basically crawling your app looking for edge cases, even AI doing test impact analysis on PRs so you only run what actually matters. Someone showed me a demo last week of an agent writing Playwright tests straight from Figma specs and I couldn't tell if it was cherry picked or if that's where things are now.

The difference between what I'm getting out of it and what people claim online feels huge and most LinkedIn posts I see about this read like vendor demos repackaged as personal experience so it's hard to know who's running this stuff in production.

Is anyone here shipping AI generated tests into CI without having to hand hold every single one?

Posted Mar 6, 2026, 3:55 PM UTC

11
Loading comments…