I got tired of flaky Playwright visual tests in CI, so I built an AI evaluator that doesn't need a cloud.
Hey everyone,
I’ve been struggling with visual regressions in Playwright. Every time a cookie banner or a maintenance notification popped up, the CI went red. Since we work in a regulated industry, I couldn't use most cloud providers because they store screenshots on their servers.
So I built BugHunters Vision. It works locally:
- It runs a fast pixel match first (zero cost).
- If pixels differ, it uses a system-prompted AI to decide if it's a "real" bug (broken layout) or just dynamic noise (GDPR banner, changing dates).
- Images are processed in memory and never stored.
Just released v1.2.0 with a standalone reporter. Would love to hear your thoughts on the "Zero-Cloud" approach or a harsh code roast of the architecture!
GitHub (Open Source parts): https://github.com/bughunters-dev
Posted Mar 8, 2026, 8:06 PM UTC
00