Robots
questions tagged ‘Robots’
Blocking AI bots?
Is there a best practice for blocking AI bots on a Blot site? I can include a robots.txt sourced from here: https://github.com/ai-robots-txt/ai.robots.txt But that's very soft step. What else might I do? I saw that Cloudflare has an AI blocking feature, but I'm not sure if I can use Cloudflare with Blot: https://blog.cloudflare.com/declaring-your-aindependence-block-ai-bots-scrapers-and-crawlers-with-a-single-click/ Any other ideas? Alex
Newsletter
Get updates on Blot’s latest features and changes. Delivered every three months.