Google’s AI Overviews, powered by Gemini, are correct about 90% of the time—but that still means hundreds of thousands of false answers are delivered every minute, translating to tens of millions per day.

**Key Details:**

* A New York Times analysis, aided by startup Oumi, used the SimpleQA benchmark (4,000+ verifiable questions) to test AI Overviews, finding 91% accuracy after the Gemini 3 update—up from 85% with Gemini 2.5.
* Examples include confidently citing incorrect dates for Bob Marley’s museum and falsely claiming Yo-Yo Ma’s hall of fame doesn’t exist, despite citing the correct source.
* Google disputes the test, calling SimpleQA flawed and preferring its own “SimpleQA Verified” with vetted questions, while noting AI Overviews uses multiple models (often faster, less accurate Gemini Flash) depending on query needs.
* AI Overviews’ non-deterministic nature means answers can vary on repeated queries, and even the evaluation tools used can hallucinate.

**Why It Matters:** While Google claims the results don’t reflect real-world usage, the scale of errors—and the system’s encouragement to accept summaries over verifying sources—raises serious concerns about trust in AI-generated search results.

Google’s AI Overviews Generate Millions of Inaccurate Answers Daily Despite 90% Accuracy Rate