Cloudflare Will Write Your Robots.txt, And It Has A Point

Cloudflare's Bot Preference Sync will auto-generate robots.txt from three dashboard settings and block AI crawlers failing its four disclosure conditions. Defaults change for new domains on September 15.