GPTBot is OpenAI's AI crawler. CipherCue reads the public robots.txt of tracked organisations and records, per named AI crawler, whether the site declares a rule disallowing it. These are the organisations observed blocking GPTBot. Sign up free, no credit card, to see the full list.
21,345organisations observed disallowing GPTBot in their robots.txt
Refine
A sample of the organisations observed
A few of the organisations whose robots.txt disallows GPTBot. Sign up free to filter and view the full list.
Free, no credit card. Filter and view every organisation observed disallowing GPTBot in robots.txt, alongside which other AI crawlers they block and their full observed infrastructure.
How this is observed:
CipherCue reads the public robots.txt each organisation publishes and records the disallow rules it declares per named user-agent. A site is recorded as blocking GPTBot when its robots.txt disallows the site root for that agent (or the * catch-all). robots.txt is a stated preference the crawler chooses whether to honour; this records what the site declares, not crawler behaviour. See the AI-crawler methodology.
We use privacy-friendly analytics (Matomo, self-hosted in the EU) to understand
how visitors use the site. Nothing is tracked unless you agree.
Privacy policy.