Neatnik Notes · Gotta block ’em all
While we’re playing whack-a-mole, let’s poison these rodents.
Link tags: disallow
4
Blocking bots – Manu
Blocking the bots is step one.
Perplexity AI Is Lying about Their User Agent • Robb Knight
See, this is exactly why we need to poison these bots.
Documentation for GPTBot - OpenAI API
Now that the horse has bolted—and ransacked the web—you can shut the barn door:
To disallow GPTBot to access your site you can add the GPTBot to your site’s robots.txt:
User-agent: GPTBot Disallow: /