Which companies block Perplexity-User in robots.txt?
Perplexity-User is Perplexity's AI crawler. CipherCue reads the public robots.txt of tracked organisations and records, per named AI crawler, whether the site declares a rule disallowing it. These are the organisations observed blocking Perplexity-User. Sign up free, no credit card, to see the full list.
17,637organisations observed disallowing Perplexity-User in their robots.txt
Refine
A sample of the organisations observed
A few of the organisations whose robots.txt disallows Perplexity-User. Sign up free to filter and view the full list.
See all 17,637 organisations blocking Perplexity-User
Free, no credit card. Filter and view every organisation observed disallowing Perplexity-User in robots.txt, alongside which other AI crawlers they block and their full observed infrastructure.
How this is observed:
CipherCue reads the public robots.txt each organisation publishes and records the disallow rules it declares per named user-agent. A site is recorded as blocking Perplexity-User when its robots.txt disallows the site root for that agent (or the * catch-all). robots.txt is a stated preference the crawler chooses whether to honour; this records what the site declares, not crawler behaviour. See the AI-crawler methodology.
We use privacy-friendly analytics (Matomo, self-hosted in the EU) to understand
how visitors use the site. Nothing is tracked unless you agree.
Privacy policy.