Weekly Dispatch · archived
Weekly Dispatch · Week 26 of 2026
Crawling & Publisher Controls
A quiet week for substantive reporting, analysis, or perspective on AI crawlers and publisher controls; most activity flowed through product updates or older content, with no qualifying pieces published in the last 14 days.
No items qualified this week.
Agents
This week's discourse on AI agents heavily features the Model Context Protocol (MCP) and Agent-to-Agent (A2A) protocols, with significant focus on their enterprise deployment, governance, and security implications. Reports detail frameworks for managing AI assets at scale and pentesting agentic systems for vulnerabilities.
- Governing AI Assets at Scale with MCP Gateway and Registry
Details AWS's open-source MCP Gateway and Registry for managing AI agents, tools, and skills in enterprise environments, emphasizing security and discoverability.
"Enterprises that onboard AI assets (MCP servers, agents, skills, and multi-step workflows) need to govern these assets and make them discoverable without blocking innovation."
- AI Infrastructure Security: Pentesting MCP & Agentic Systems
Discusses the new attack surface introduced by MCP servers and agentic AI systems, detailing autonomous pentesting methods to identify infrastructure risks.
"MCP servers are a new and largely untested attack surface in most enterprise environments."
- A2UI + MCP Apps: Combining the best of declarative and custom agentic UIs
Explores combining A2UI and MCP Apps to create dynamic, generative user interfaces for AI agents, addressing architectural advantages and security.
"It provides the benefits of dynamic UI without the overhead of building a full Agent-to-Agent (A2A) architecture or dealing with complex discovery mechanisms."
Copyright & Legal
A quiet week; no qualifying reporting, analysis, or perspective on AI training-data copyright lawsuits, regulatory action, licensing disputes, or government policy changes on AI + copyright was published in the last 14 days from the specified reputable sources.
No items qualified this week.
Web Ecosystem & AI Impact
This week's reporting highlights a significant shift in the web ecosystem due to AI, with publishers facing declining search traffic from AI Overviews and exploring new monetization strategies like content licensing and pay-per-crawl systems. There's a growing focus on first-party data, protecting indigenous and minority language content, and the challenges AI poses for small and niche publishers.
- OpenAI Publisher Deals: The Complete Map of Every Media Partnership (2023-2026)
Maps OpenAI's extensive content licensing deals with publishers, detailing who signed, when, what's covered, and reported payments.
"OpenAI has signed content partnerships with more than 20 news publishers covering 160+ outlets in over 20 languages, from the Associated Press in July 2023 to Brazil's Folha and UOL in May 2026."
- Publishers Are Losing More Than Traffic: The New Value Challenge of the AI Era
Argues publishers face a new challenge in monetizing content value as AI shifts how content is used, referenced, and incorporated.
"What once depended exclusively on audience reach, the value of content is now tied to how that content is used, referenced and incorporated into AI-powered experiences."
- The great traffic reckoning: how publishers can grow despite the AI search drop
Reports on significant drops in search traffic and revenue for publishers due to AI Overviews, advocating direct reader relationships.
"According to Piano's benchmark data across hundreds of publisher sites, search traffic dropped by 36%. Revenue fell just 16%, and overall audience was down 9%."
- How is AI Impacting Affiliate Publishers?
Reports on a new survey by APMA to understand AI search's impact on affiliate publishers' traffic, visibility, and earnings.
"While news websites have reported significant drop-offs in click-through rates, reducing traffic and revenue, when it comes to the affiliate industry, comprehensive data on the impact of AI search has not yet been gathered."
- Same gatekeepers, new tollbooths in the AI content licensing market
Argues AI content licensing replicates past platform monopolies, with bilateral deals failing to protect most publishers from traffic erosion.
"Publishers with direct AI licensing agreements initially enjoyed a substantial click-through advantage from AI interfaces. By the fourth quarter of 2025, that 'deal premium' had essentially evaporated."
- Media Companies Are Billing AI Firms and Betting on Microdramas
Publishers are embedding billing clauses in terms of service to charge AI companies for scraping, creating a new legal and revenue strategy.
"Publishers are embedding billing clauses in their websites' terms of service and threatening to sue if AI companies scrape content without payment."
- Mapping publisher value in the AI marketplace
Examines the evolving AI licensing market, arguing publishers need to define value across AI systems, not just focus on individual deals.
"AI licensing is quickly evolving from a series of one-off negotiations into a new marketplace for content."
- What Publishers Must Do in 2026 to Prepare for the AI Era
Argues publishers must build strong first-party data and identity infrastructure for sustainable monetization in a privacy-constrained, AI-driven landscape.
"In a privacy-constrained, fragmented landscape, first-party data is the foundation of sustainable monetization."
- Cloudflare's Pay-Per-Crawl Turns Website Content Into a Priced Commodity
Cloudflare introduced a pay-per-crawl system, making AI companies pay for website access, shifting from free access to a priced marketplace.
"In 2026, Cloudflare has introduced a pricing layer between AI crawlers and website content. AI companies must pay website operators for crawl access."
- Amazon Content Partners: A new program for independent content creators in the AI age
Amazon launched a program for independent content creators, offering AI traffic management, increased affiliate commissions, and premium advertising access.
"Amazon Content Partners brings together AI traffic management and monetization, increased revenue, and hosting credits in one program for independent content creators."
- Emerging uses of AI chatbots for news and what it means for journalism
Research shows low click-through rates from AI chatbots to news sources, raising concerns about referral traffic for publishers.
"just 4% of respondents overall say they always or often click through to underlying news sources from AI, compared with 19% from search, and 17% from social media."
- Canada's National Artificial Intelligence Strategy: AI for All
Canada's AI strategy aims to protect Indigenous cultural and linguistic expression and support self-determination in AI development.
"Canada will work with Indigenous communities to ensure AI tools designed and built here protect Indigenous cultural and linguistic expression, support Indigenous self-determination over how AI is built and used in Indigenous contexts."
- AI Search Engines Reduce Publisher Traffic by Up to 15%, New Research Finds
Academic study finds AI-generated search summaries reduce website traffic by approximately 15%, impacting online publishing economics.
"Researchers estimated that exposure to AI-generated search summaries reduced traffic to affected pages by approximately 15%, raising new questions about the future economics of online publishing."
- First-Party Data for Agencies: Build It for Clients
Argues agencies should build first-party data monetization as a service for clients, enabling better targeting and premium pricing.
"First-party data monetization creates a service line that many agencies have not yet built but that forward-thinking agencies are beginning to offer explicitly."
- Full-Text Access: The Main Barrier for AI Research Tools
Argues content rights negotiation is a major hurdle for AI research tools, leading to exploration of pay-per-crawl and micropayment models.
"In the short run, they may seek middle-ground: tiered APIs, micropayments for AI usage, or pay-per-crawl schemas."
- Bots Now Outnumber Humans Online. Here's What It Actually Means for Your Content Strategy
Discusses how AI Overviews and bot traffic distort analytics, leading to declining click-through rates and revenue for publishers.
"AI Overviews now appear on 48% of all Google searches as of March 2026, up from 6 to 7% in early 2025."
- Dutch Publishers Launch Opt-In AI Licensing Platform
Dutch publishers launched Bookpact.ai, an opt-in platform giving rightsholders control over licensing their books to AI companies.
"Publishers VBK, WPG, Lannoo, and Maven and distributor CB have launched Bookpact.ai in an effort to keep rightsholders in control of how their books are used by tech companies."
- Google's AI opt-out leaves publishers with a choice they can't safely use
Argues Google's AI opt-out for publishers is practically unusable due to its default opt-in nature and lack of specific AI click data.
"That delay, combined with the fact it's an opt-out rather than an opt-in system – and that Google is drip-feeding the data they'd need to assess the impact – leaves publishers with a theoretical right to say no to AI in search that is, in practice, almost unusable."
- AWS turns its web firewall into a toll booth for AI crawlers
AWS introduced a pay-per-crawl pricing layer in its WAF, enabling publishers to charge AI bots for content access.
"AWS has added a pay-per-crawl pricing layer directly inside its Web Application Firewall, giving content publishers the ability to charge AI bots for each page they consume."
- Three perspectives on 'zero-click' search
Explores publisher, user, and Google perspectives on zero-click search, noting declining traffic but potential for engaged clicks from AI Overviews.
"Publishers heavily dependent on referral traffic and associated programmatic revenues have already seen the sky fall in."
- AI Niche Sites: Real Numbers Behind the Passive Income Pitch
Examines the harsh reality of AI's impact on niche content sites, with significant traffic drops and a need for diversified strategies.
"Google AI Overviews reduce clicks to top-ranking content by 34.5% to 58%, depending on query type."
- Why Your Website Traffic Is Dropping in 2026: Google AI Overviews
Explains that Google AI Overviews directly answering queries cause significant traffic drops, necessitating new monetization and diversification strategies.
"Your website traffic is dropping primarily because Google AI Overviews now answer a large share of queries directly on the results page, removing the need to click."
- The Rise of AI in Publishing: Should Authors Be Worried?
Discusses AI's impact on creative writing, highlighting concerns about fraudulent AI-generated content and the need for author protections.
"Friedman's experience is a disturbing one, showing how vulnerable authors are to AI-generated fraud. Without stricter protections, these issues will continue to grow, damaging reputations and misleading readers."
- Newstex Blog | Content Licensing & Syndication Insights
Discusses the shift towards licensed, high-quality datasets for AI, positioning niche publishers to monetize specialized expertise.
"As AI companies shift toward licensed, high-quality datasets, niche publishers may be uniquely positioned to turn specialized expertise into a valuable new revenue opportunity."
- AI-Generated Traffic: Can Publishers Actually Make Money on It?
Argues publishers can monetize AI traffic by becoming authoritative sources that AI systems trust and cite, leading to high-intent users.
"Successful AI traffic monetization depends on trust, so your website must become an authoritative LLM traffic website that AI systems trust and cite."
- Forecasting the future: how can publishers thrive in the AI search era?
Argues publishers must shift from traffic acquisition to maximizing value from owned audiences through direct engagement and first-party data.
"The competitive advantage will come from publishers' ability to maximise the value of the audiences they already own, not the ones they are still trying to acquire."
- USA Today vs. Google AI Overviews: A World Cup battle for breaking news traffic
Reports how USA Today is adapting workflows, including pre-writing stories, to compete for breaking news traffic against Google AI Overviews.
"As Google's AI Overviews arrive more quickly for developing stories, publishers are adjusting workflows to capture search interest early."
- The Corner Newsletter: Our Next Revolution Conference on Capitol Hill & Europe's New Rules to Support Publishers in AI Era (June 16, 2026)
Discusses new rules in Italy and the UK to help publishers negotiate fair compensation with AI corporations, and Cloudflare's pay-per-crawl system.
"Cloudflare, whose networking tools are used by about 20% of websites globally, allows site owners to manage AI bot access and is now experimenting with a pay-per-crawl system."
- A New Framework for AI Permissions in Entertainment: RSL Media's Human Consent Standard
Proposes a 'Human Consent Standard' to give creators control over digital replicas and ensure compensation in the AI economy.
"For performers and entertainers, the standard could provide a scalable mechanism to assert control over digital replicas without individual negotiation with each AI developer."
- Should You Even Try to Optimize for AI Overviews? [Study]
Study questions the reliability of optimizing for AI Overviews due to inconsistent citations and minimal traffic impact, suggesting other strategies.
"most marketers have capitulated to a world where AI tools scrape content from sites that have built up authority and expertise for years–and then don't send traffic back to those sites where it came from."
- For Advertisers, Google's Sweeping AI Push Creates Both Challenges and Opportunities
Discusses how Google's AI push redefines search, creating challenges for traditional traffic models but opportunities for Generative Engine Optimization.
"As search becomes more conversational and AI depresses site traffic, AI Max can restore some of that by casting a wider, smarter net."
- Major Publishers Deploy Gist AI to Capture Q&A Search Traffic
Reports that major publishers are using Gist AI to capture Q&A search traffic, as consumers increasingly start searches with AI engines.
"Recent research from Eight Oh Two Marketing indicates that 37% of consumers now begin their search with an AI engine, and nearly half say AI influences which brands they trust first."
- Taboola expands DeeperDive into an ad network for AI apps and agents
Taboola launched an ad network for LLMs, chatbots, and virtual assistants, leveraging first-party data to monetize AI-driven conversations.
"Taboola is opening up the monetization engine behind its DeeperDive generative AI product, launching an ad network designed specifically for LLMs, chatbots, and virtual assistants."
- This Concordia professor is leading a global initiative to bring Indigenous knowledge to AI
Reports on an initiative to teach AI to recognize and protect Indigenous languages and cultural patterns, addressing AI's English bias.
"Little Bear tells me one of the Niitsitapi pod's primary focuses is working through the complexities of teaching AI to recognize Blackfoot language patterns."
- AI, Indigenous Communities, and the Question: What Does the Future Hold for Humans?
Explores the need for Indigenous communities to participate in shaping AI to protect cultural integrity and prevent historical inaccuracies.
"If biased or incomplete information goes in, inaccurate answers can come out with confidence."
- Opinion: Africa lacks AI laws to protect culture and intellectual property
Argues Africa needs AI-specific legal frameworks, like geographical indications, to protect its cultural and linguistic intellectual property from AI extraction.
"At a minimum, Africa needs the AI equivalent of GI legal frameworks that protect cultural provenance before it is absorbed, rendered generic and monetised elsewhere."
- Has AI Already Killed How-To Nonfiction? Sales Trends, My Personal Data, and What It Might Mean for the Future
Examines how AI might be impacting how-to nonfiction sales, citing industry data and personal observations on content consumption shifts.
"For the first three months of 2026, Publishers Weekly reported that 'adult nonfiction' was down 9% from Q1 2025."