What makes Perplexity different
Its docs are specific about crawler access, and WAF rules are where sites usually fail.
- PerplexityBot surfaces and links sites. It is not used for foundation-model training
- Perplexity-User fetches on a user's request and generally ignores robots.txt
- Robots.txt changes can take up to 24 hours to take effect
- A WAF can block both bots, so allow by user agent and published IP list
- Sources appear as numbered cards beside the answer