CIPHERCUE

← All companies blocking OAI-SearchBot

Which companies in United Kingdom block OAI-SearchBot in robots.txt?

OAI-SearchBot is OpenAI's AI crawler. CipherCue reads the public robots.txt of tracked organisations and records, per named AI crawler, whether the site declares a rule disallowing it. These are the United Kingdom organisations observed blocking OAI-SearchBot. Sign up free, no credit card, to see the full list.

6,764 United Kingdom organisations observed disallowing OAI-SearchBot in their robots.txt
Refine

See all 6,764 United Kingdom organisations blocking OAI-SearchBot

Free, no credit card. Filter and view every United Kingdom organisation observed disallowing OAI-SearchBot in robots.txt, alongside which other AI crawlers they block and their full observed infrastructure.

Show me the full list See pricing

Companies blocking OAI-SearchBot in other markets

France Germany Ireland Italy Netherlands Poland Spain United States

Other AI crawlers blocked in United Kingdom

GPTBot Amazonbot ClaudeBot Meta-ExternalAgent Google-Extended anthropic-ai Applebot-Extended ChatGPT-User cohere-ai FacebookBot Claude-Web PerplexityBot DuckAssistBot Perplexity-User MistralAI-User Claude-SearchBot CCBot Bytespider
How this is observed: CipherCue reads the public robots.txt each organisation publishes and records the disallow rules it declares per named user-agent. A site is recorded as blocking OAI-SearchBot when its robots.txt disallows the site root for that agent (or the * catch-all). robots.txt is a stated preference the crawler chooses whether to honour; this records what the site declares, not crawler behaviour. See the AI-crawler methodology.