Meta
stable for 1 days · 0 material events tracked · 1 snapshot in history
Documented user-agents (5)
Each distinct UA this vendor publishes on its docs page, extracted by Haiku from the latest snapshot. New UAs appearing or scope changes here are the high-signal events to watch.
| User-agent | Purpose | Scope / when it fires | Opt-out |
|---|---|---|---|
FacebookExternalHit | Crawl content shared on Meta apps; display title, description, thumbnail image | Content from websites or apps shared on Facebook, Instagram, or Messenger | User-agent: facebookexternalhit / Disallow: / in robots.txt (may bypass for security checks) |
Meta-WebIndexer | Improve Meta AI search result quality and relevance for users | General web crawl to enhance Meta AI search accuracy and help cite content | User-agent: meta-webindexer / Disallow: / in robots.txt |
Meta-ExternalAds | Crawl web for improving advertising and business-related products and services | General web crawl for advertising and business product improvement | User-agent: meta-externalads / Disallow: / in robots.txt |
Meta-ExternalAgent | Train foundation AI models and improve products by indexing content | General web crawl for AI model training and product development | User-agent: meta-externalagent / Disallow: / in robots.txt |
Meta-ExternalFetcher | Fetch links at user request; support agentic AI capabilities and task completion | User-triggered individual link fetches for AI navigation and task assistance | User-agent: meta-externalfetcher / Disallow: / in robots.txt (may bypass for user-requested fetches) |
Events
No material changes detected yet.