Weekly Dispatch · Week 19 of 2026

Crawler policy is now a board-level issue, affecting AI search visibility, training, and monetization, with Cloudflare offering pay-per-crawl options.

"The executive lesson is direct. Crawler policy is now a distribution decision. It belongs in legal, marketing, engineering, and leadership conversations."

A personal site audit reveals AI crawlers have full access, with Perplexity already citing content, suggesting blocking might be strategic self-harm for solo publishers.

"If you are a solo publisher, blocking is strategic self-harm."

Robots.txt is insufficient for AI scraping control; new standards like `ai.txt` and `llms.txt` are proposed for purpose-based content use and legal enforceability under the EU AI Act.

"Robots.txt falls short for AI crawlers because it is a voluntary, non-enforceable guideline in an increasingly hostile data environment where many AI agents simply ignore it."

Examines the fundamental shift in security for multi-agent AI systems, detailing new risks and the need for runtime defense and continuous visibility.

"Multi-agent security is not an extension of single-model security—it is a fundamentally different problem driven by autonomous systems that plan, delegate, and act across environments."

Outlines the biggest AI agent security risks, including prompt injection and excessive permissions, and proposes controls for safe enterprise deployment.

"The moment an agent can read data, make decisions, and take action inside your business systems, your risk profile changes."

Explores hidden threats and failures in agentic AI systems, arguing that traditional RBAC is insufficient and a data control layer is essential.

"Autonomous AI agents pull data from systems you secured, pass it between pipelines, write to memory, and act on instructions without a human reviewing each step."

Discusses new security challenges introduced by AI agents at scale, such as agent sprawl and tool misuse, and how a distributed security model can address them.

"AI agents introduce new security challenges, including: Agent sprawl from user-created and SaaS agents that expands the attack surface."

This commentary argues artists are uniquely positioned to address AI's copyright theft and calls for regulation of AI training and updated copyright laws.

"Artists are disproportionately impacted by AI's tendency to steal work from creatives and deprive them of paid work – but artists are also uniquely qualified to explore the complex issues we now face."

A UK Parliament report details a government working group exploring support for independent and smaller creative organizations in licensing their content for AI.

"In particular, the 18th March 2026 Statement on Copyright and AI Progress announced a working group on independent and smaller creative organisations to explore whether there is a role for government to support their ability to license their content."

Google's Q1 2026 earnings show 19% Search revenue growth with AI Overviews, challenging predictions of revenue collapse despite potential publisher traffic shifts.

"Apparently, the user behavior changes that AI Overviews introduced did not produce the revenue collapse that critics predicted."

Google's Liz Reid defends AI Overviews by claiming they reduce 'bounce clicks,' but a field experiment shows a 38% drop in organic clicks.

"When AI Overviews appeared, organic clicks dropped 38%, and zero-clicks rose 33%."

Liz Reid reiterates that AI Overviews reduce 'bounce clicks,' but third-party data from Chartbeat and Pew Research indicates significant publisher traffic declines.

"global publisher traffic from Google Search declined by roughly one-third."

AI platforms are consuming publisher content, leading to a one-third collapse in search traffic and an estimated $2 billion annual ad revenue loss, especially for smaller publishers.

"AI platforms are consuming publisher content, stripping away the brand, and returning almost nothing."

Google's Search revenue is growing, but this doesn't clarify outbound clicks to publishers, as third-party data shows significant CTR drops and traffic loss for publishers.

"Google's revenue can rise even as publisher traffic declines."