Cloudflare Unveils Monetization Gateway, Pay Per Use, and Cryptographic Bot Controls for Agentic Web
Summary
Cloudflare reported that non-human traffic now accounts for over half of all web requests on its network, driven by a 1,700% annual increase in AI agent requests. To address the breakdown of traditional ad-supported search referrals, the company launched Pay Per Use and a Monetization Gateway beta using the open x402 protocol and HTTP 402 responses. These mechanisms sit alongside granular Search, Agent, and Training toggles, Disallow AI Training directives supported by Apple, Google, and Microsoft, and cryptographic verification via Web Bot Auth.
Insight
Edge networks are transitioning from binary access control (block vs. allow) into programmatic settlement platforms where automated traffic can be identified via cryptographic signatures (Web Bot Auth) and monetized dynamically per request or token (x402 protocol), decoupling crawl authorization from training permissions.
Implication
Publishers without large-scale direct AI licensing deals gain a mechanized framework to bill AI agents and answer engines on a per-use basis, while AI developers face growing friction if their user-facing bots cannot parse structured formats or settle micro-transactions.
Why it matters
As answer engines siphon human referrals away from ad-supported sites, programmatic micropayments and crawler verification at the CDN level represent the most concrete infrastructure attempt yet to fund the open web through machine traffic.
Evidence
- Primary source
- Evidence ID:
cloudflare-blog--ed593ebfcb36b680