CIPHERCUE

← All companies blocking Bytespider

Which companies in Germany block Bytespider in robots.txt?

Bytespider is ByteDance's AI crawler. CipherCue reads the public robots.txt of tracked organisations and records, per named AI crawler, whether the site declares a rule disallowing it. These are the Germany organisations observed blocking Bytespider. Sign up free, no credit card, to see the full list.

1,526 Germany organisations observed disallowing Bytespider in their robots.txt
Refine

A sample of the organisations observed

A few of the Germany organisations whose robots.txt disallows Bytespider. Sign up free to filter and view the full list.

SoundCloud
DE
Technology
soundcloud.com
t-online.de
DE
Telecommunication
t-online.de
 Show me Locked Locked Locked Locked Locked

See all 1,526 Germany organisations blocking Bytespider

Free, no credit card. Filter and view every Germany organisation observed disallowing Bytespider in robots.txt, alongside which other AI crawlers they block and their full observed infrastructure.

Show me the full list See pricing

Companies blocking Bytespider in other markets

Canada France Ireland Italy Netherlands Poland Spain United Kingdom United States

Other AI crawlers blocked in Germany

GPTBot Amazonbot ClaudeBot Meta-ExternalAgent Google-Extended anthropic-ai Applebot-Extended ChatGPT-User cohere-ai FacebookBot Claude-Web PerplexityBot OAI-SearchBot DuckAssistBot Perplexity-User MistralAI-User Claude-SearchBot CCBot
How this is observed: CipherCue reads the public robots.txt each organisation publishes and records the disallow rules it declares per named user-agent. A site is recorded as blocking Bytespider when its robots.txt disallows the site root for that agent (or the * catch-all). robots.txt is a stated preference the crawler chooses whether to honour; this records what the site declares, not crawler behaviour. See the AI-crawler methodology.