AI can barely read most WordPress sites. Here's why and what you can do about it

AI bots choke on WordPress HTML. All the div soup, shortcodes, page builder markup — they either skip it or waste a ton of tokens trying to parse it. What they actually want is clean Markdown with some metadata on top.

Cloudflare actually past week launched a feature "Markdown for Agent" thing on the Pro plan. Which is cool except it's $20/month and tied to their ecosystem. And the MD generation is automatic and if you want to edit it, you have no control.

That annoyed me enough to build a free plugin that does this natively in WordPress. It auto-generates a Markdown version of every post/page and even Custom Post Type, adds YAML frontmatter, creates llms.txt files (thats becoming the standard for AI discovery), and handles content negotiation so bots get Markdown while humans see your normal site. The MD file is referenced on the <head> section and the AI Crawler will follow the MD file from here

Not trying to sell anything , the plugin (AgentPress MD) is free for small sites with up to 50 posts/pages, which is more than enough for small sites. Just wanted to share because this stuff genuinely matters now and most people don't even know their sites are invisible to AI.

I've submitted the plugin within the WordPress Repository and currently waiting for its approval (have to wait at least up to 16 days blaaahhh). I don't mind sharing the link with anyone if it's interested on installing this on own website.

 Happy to answer questions about how plugin works.