I got tired of flaky Playwright visual tests in CI, so I built an AI evaluator that doesn't need a cloud.

Hey everyone,

I’ve been struggling with visual regressions in Playwright. Every time a cookie banner or a maintenance notification popped up, the CI went red. Since we work in a regulated industry, I couldn't use most cloud providers because they store screenshots on their servers.

So I built BugHunters Vision. It works locally:

  1. It runs a fast pixel match first (zero cost).
  2. If pixels differ, it uses a system-prompted AI to decide if it's a "real" bug (broken layout) or just dynamic noise (GDPR banner, changing dates).
  3. Images are processed in memory and never stored.

Just released v1.2.0 with a standalone reporter. Would love to hear your thoughts on the "Zero-Cloud" approach or a harsh code roast of the architecture!

GitHub (Open Source parts): https://github.com/bughunters-dev

Posted Mar 8, 2026, 8:06 PM UTC

00
Loading comments…