Has anyone had any success providing Markdown?
I already cache my html web pages so its not a huge amount of work converting them to markdown and caching them again, and then checking the headers to see if a bot asks for markdown. I've read all the stuff I can find online and the consensus seems to be that it's not going to help with getting more AI citations, but it won't do any harm either.
I'm wondering if it's still worth doing anyway, purely to stop AI bots hammering my site. I had to block a few in Cloudflare because they were going nuts, but if they're requesting smaller markdown files then maybe it will be worth allowing them back in again (I can cut the files down to about a third of the size).
I suppose my question is, has anyone actually seen one of the major AI bots request markdown?
Posted Aug 29, 2026, 1:26 PM UTC