Weekly Dispatch · archived
Weekly Dispatch · Week 30 of 2026
Crawling & Publisher Controls
This week's analysis on crawling and publisher controls highlights the importance for marketers to optimize robots.txt configurations for AI crawlers and to track AI referral traffic for improved ROI, while also noting the continued use of web scraping for competitive intelligence.
- The Ultimate Performance Marketing Guide to Maximizing ROI
Marketers are advised to optimize robots.txt for AI crawlers and track AI referral traffic to enhance ROI, alongside leveraging web scraping for competitive insights.
"Fix any AI crawler blocks in robots.txt or WAF settings immediately – this is the fastest, highest-impact fix available."
Agents
This week's reporting highlights significant advancements and challenges in AI agent ecosystems, focusing on emerging protocols like MCP and A2A, the evolving landscape of agent identity and security, and the critical need for robust governance and accountability frameworks, particularly in agentic commerce and enterprise deployments. Regulatory efforts, such as the proposed AI AGENT Act, are also shaping the future of consumer AI agent interactions.
- The Federal AI AGENT Act: Consumer Protection in AI Clothing? | Davis Wright Tremaine
Critiques the proposed AI AGENT Act, examining its framework for consumer AI agents, platform interoperability, and unresolved liability issues.
"Even in its current form, however, it provides an important indication of how policymakers may begin approaching the regulation of consumer AI agents and platform interoperability."
- AI Agent Protocols in 2026: MCP, A2A, A2UI, AG-UI, and UCP | Aasher Kamal
Provides a practical guide to the 2026 AI agent protocol stack, differentiating between MCP, A2A, and other standards for tool and agent collaboration.
"Google's March 2026 guide to AI agent protocols describes MCP as the data/tool layer and A2A as the collaboration layer. That is the most useful mental model."
- AI Agents Don't Break IAM, They Break Its Assumptions | RSAC Conference
Argues that AI agents fundamentally challenge traditional Identity and Access Management (IAM) by introducing non-human identities and complex delegation chains.
"The real question is no longer who is this, but whose authority is being exercised, under what constraints, and for how long."
- State of Agentic Commerce | Protocol Tracker | agenticplug.ai
Reports on key developments in agentic commerce, including AWS Bedrock AgentCore Payments, Visa's collaboration with OpenAI, and Adyen's new APIs.
"AWS announced Amazon Bedrock AgentCore Payments (preview), a managed service that lets AI agents autonomously pay for APIs, web content, MCP servers, and other agents."
- Agent Gateway: Control layer for agentic AI - Affinidi
Describes an 'Agent Gateway' as a control layer for agentic AI, providing a single enforcement point for compliance, security, and operational policies.
"Agent Gateway is deployed between your applications and agents and the AI backend services they rely on (MCP servers, databases, external actors and beyond), routing all AI traffic through a single point."
- Who is accountable when AI breaks the law? - Foster Moore
Discusses the critical question of accountability when AI agents act on behalf of businesses, highlighting the need for infrastructure to establish identity and authority.
"Ultimately, AI may change how work is performed, but it does not change where accountability rests."
Copyright & Legal
This week saw a significant development in the ongoing AI copyright litigation, with news outlets seeking sanctions against OpenAI in their lawsuit. Additionally, the European Union implemented new regulations requiring Google to share search data and open its Android platform to rival AI companies.
- News outlets urge a judge to sanction OpenAI in a high-stakes AI copyright fight
News organizations are seeking attorney fees and sanctions against OpenAI in their copyright infringement lawsuit, alleging improper withholding of evidence.
"Among the sanctions sought by the newspapers Thursday are attorney fees that would pay for the efforts to secure “improperly withheld” evidence."
- EU forces Google to share search data and open Android to rival AI companies
The European Union has issued new rules compelling Google to share search data and allow rival AI companies access to its Android operating system.
"The European Union issued two new rules for Google on Thursday to force it to share search data and open up its Android operating system to rival AI companies."
Web Ecosystem & AI Impact
This week's analysis and reporting reveal a significant decline in publisher traffic due to AI Overviews, severely impacting small and medium-sized outlets. While content licensing deals with AI platforms are becoming more common, a critical issue is that publishers are not receiving a share of AI-generated ad revenue, raising concerns about fair compensation and negotiation power.
- AI licensing is changing which affiliate publishers matter most to your program
AI content licensing deals are creating a new dynamic where publishers supplying content to AI platforms gain upstream influence, impacting affiliate programs.
"Publishers supply licensed content into structured pipelines and receive payment each time their content grounds an AI answer, shifting from open-web scraping to permissioned, metered access."
- Why Writers Are Quitting Has Three Specific Causes. The Personal Essays Name Only One. | by Noor Mohammad - Medium
Google AI Overviews have severely reduced publisher traffic, leading to significant income loss for writers and a broken pre-AI revenue model.
"Ahrefs' February 2026 analysis found that AI Overviews correlate with a 58% reduction in click-through rates for top-ranking pages."