Cloudflare Launches Web Search API Beta for AI Agents with Verified Bot Standards
Development
Cloudflare has introduced a beta release of its Web Search API to allow AI agents and applications to ground model responses in live web data through AI Gateway. At launch, developers can query third-party search providers Ceramic.ai, Exa, and Linkup via REST or Cloudflare Worker bindings. All participating search providers support Zero Data Retention for requests routed through Cloudflare and have committed to Cloudflare’s verified bot crawling standards.
Why it matters
As AI models transition from static training knowledge to real-time agentic web discovery, the infrastructure mediating web queries will determine how crawling traffic is identified, governed, and billed across the ecosystem.
Trend impact
- agentic-search-apis
- crawler-verification-mandates
- zero-data-retention-proxies
Evidence
- Primary source
- Evidence ID:
cf-changelog-ai-gateway--65cd43d47a98d8e1