Crawler type: html_page docs.perplexity.ai↗

Perplexity

stable for 36 days · 1 material event tracked · 9 snapshots in history

Documented user-agents (2)

Each distinct UA this vendor publishes on its docs page, extracted by Haiku from the latest snapshot. New UAs appearing or scope changes here are the high-signal events to watch.

User-agent Purpose Scope / when it fires Opt-out
PerplexityBot Surface and link websites in search results on Perplexity Search result indexing, not used for AI model training Disallow PerplexityBot in robots.txt file
Perplexity-User Support user actions and fetch pages to provide accurate answers User-triggered fetches when users ask questions, generally ignores robots.txt Configure WAF rules or site-level access controls to block Perplexity-User requests
Change timeline — diffs over time with insights

Each block is a detected change: the new-vs-prior snapshot diff and the LLM-written insight. Newest first.

2026-07-02 2026-07-16 14 days apart
+0 −23
View diff
Index: perplexitybot
===================================================================
--- perplexitybot	2026-07-02
+++ perplexitybot	2026-07-16
@@ -1,27 +1,4 @@
 We strive to improve our service every day by delivering the best search experience possible. To achieve this, we collect data using web crawlers (“robots”) and user agents that gather and index information from the internet, operating either automatically or in response to user requests. Webmasters can use the following robots.txt tags to manage how their sites and content interact with Perplexity. Each setting works independently, and it may take up to 24 hours for our systems to reflect changes.
-User Agent
-Description
-PerplexityBot
-PerplexityBot
-is designed to surface and link websites in search results on Perplexity. It is not used to crawl content for AI foundation models. To ensure your site appears in search results, we recommend allowing
-PerplexityBot
-in your site’s
-robots.txt
-file and permitting requests from our published IP ranges listed below.
-Full user-agent string:
-Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
-Published IP addresses:
-https://www.perplexity.com/perplexitybot.json
-Perplexity‑User
-Perplexity-User
-supports user actions within Perplexity. When users ask Perplexity a question, it might visit a web page to help provide an accurate answer and include a link to the page in its response.
-Perplexity-User
-controls which sites these user requests can access. It is not used for web crawling or to collect content for training AI foundation models.
-Full user-agent string:
-Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
-Published IP addresses:
-https://www.perplexity.com/perplexity-user.json
-Since a user requested the fetch, this fetcher generally ignores robots.txt rules.
 WAF Configuration
 If you’re using a Web Application Firewall (WAF) to protect your site, you may need to explicitly whitelist Perplexity’s bots to ensure they can access your content. Below are configuration guidelines for popular WAF providers.
 Cloudflare WAF
2026-06-05 2026-07-01 26 days apart
+1 −0
View diff
Index: perplexitybot
===================================================================
--- perplexitybot	2026-06-05
+++ perplexitybot	2026-07-01
@@ -1,3 +1,4 @@
+We strive to improve our service every day by delivering the best search experience possible. To achieve this, we collect data using web crawlers (“robots”) and user agents that gather and index information from the internet, operating either automatically or in response to user requests. Webmasters can use the following robots.txt tags to manage how their sites and content interact with Perplexity. Each setting works independently, and it may take up to 24 hours for our systems to reflect changes.
 User Agent
 Description
 PerplexityBot
2026-04-29 2026-06-04 36 days apart
+0 −4
View diff
Index: perplexitybot
===================================================================
--- perplexitybot	2026-04-29
+++ perplexitybot	2026-06-04
@@ -1,7 +1,3 @@
-Documentation Index
-Fetch the complete documentation index at:
-https://docs.perplexity.ai/llms.txt
-Use this file to discover all available pages before exploring further.
 User Agent
 Description
 PerplexityBot
2026-04-19 2026-04-29 10 days apart
+4 −0
View diff
Index: perplexitybot
===================================================================
--- perplexitybot	2026-04-19
+++ perplexitybot	2026-04-29
@@ -1,3 +1,7 @@
+Documentation Index
+Fetch the complete documentation index at:
+https://docs.perplexity.ai/llms.txt
+Use this file to discover all available pages before exploring further.
 User Agent
 Description
 PerplexityBot
Events