How Many Companies Are Invisible to AI Without Knowing It?

When we reviewed about 3,000 websites across the United States and United Kingdom, we found that 27% were blocking at least one major LLM crawler. But if most of these companies never intended to block AI, where is the problem really happening? If robots txt and CMS settings look fine, could the issue be hiding at the CDN or hosting layer inside bot protection, firewall rules, or edge security settings? And if that’s the case, how many marketing teams are publishing content every week without realizing that some AI systems can’t consistently access their site? When we compare segments and see that eCommerce stores on Shopify are usually easier for AI crawlers to access, does that mean platform defaults are quietly shaping which companies show up more in AI answers?

If over a quarter of websites are blocking AI crawlers today, how many businesses are becoming invisible in the AI ecosystem without even realizing it, and what will that mean for content strategy in the next few years?