Blocking bots – Manu
Blocking the bots is step one.
AI Agents robots.txt Builder | Dark Visitors
A handy resource for keeping your blocklist up to date in your robots.txt file.
Though the name of the website is unfortunate with its racism-via-laziness nomenclature.
Responses
Related links
Perplexity AI Is Lying about Their User Agent • Robb Knight
See, this is exactly why we need to poison these bots.
Declare your AIndependence: block AI bots, scrapers and crawlers with a single click
This is a great move from Cloudflare. I may start using their service.
AI Pollution – David Bushell – Freelance Web Design (UK)
AI is steeped in marketing drivel, built upon theft, and intent on replacing our creative output with a depressingly shallow imitation.
Robots.txt - Jim Nielsen’s Blog
I realized why I hadn’t yet added any rules to my
robots.txt: I have zero faith in it.
1 Bookmark
# Bookmarked by Zachary Dunn on Saturday, December 30th, 2023 at 3:56pm