Completed window
2026-09-21
→ 2026-09-27
Weekly intelligence · 2026-W39
Web ecosystem governance is progressing across both technical standards bodies refining bot data collection practices and antitrust regulators structuring user choice in search discovery.
Standardization and regulatory initiatives are targeting critical structural layers of the web. Within the IETF Web Bot Auth Working Group, an updated Internet-Draft renews operational standards for responsible data collectors. Concurrently, the UK Competition and Markets Authority is consulting on a user choice conduct requirement for Google's general search services under the DMCC Act 2024 framework.
- Pipeline
- degraded
- Coverage
- 34/39
- Generated
- 2026-09-28 19:59 UTC
Executive shifts
What changed the read
IETF Web Bot Auth WG Updates Draft on Responsible Crawling Standards
The IETF Web Bot Auth Working Group received an updated revision of the Internet-Draft 'Best Practices for Responsible Web Data Collection' (draft-farzdusa-webbot-datacollection-01), preventing expiration and continuing discussions on operational standards for automated web data collectors.
UK CMA Launches Consultation on Google Search User Choice Conduct Requirement
The UK Competition and Markets Authority initiated a consultation on 23 September 2026 regarding a proposed user choice conduct requirement for Google Search under the Digital Markets, Competition and Consumers Act 2024, building on earlier conduct requirements tied to Google's Strategic Market Status designation.
Track ledger
Material developments
1 verified material development.
UK CMA Opens Further Consultation on User Choice Conduct Requirement for Google Search →1 verified material development.
UK CMA Opens Further Consultation on User Choice Conduct Requirement for Google Search →1 verified material development.
UK CMA Opens Further Consultation on User Choice Conduct Requirement for Google Search →1 verified material development.
IETF Web Bot Auth WG Sees Updated Draft on Responsible Web Data Collection →No verified material change in this track.
No verified material change in this track.
1 verified material development.
IETF Web Bot Auth WG Sees Updated Draft on Responsible Web Data Collection →No verified material change in this track.
No verified material change in this track.
Actors
Moves
UK CMA
Search defaults and choice architecture dictate default web entry points and upstream traffic distribution; a formalized user choice requirement could alter how millions of UK consumers select search and discovery engines.
Search defaults and choice architecture dictate default web entry points and upstream traffic distribution; a formalized user choice requirement could alter how millions of UK consumers select search and discovery engines.
IETF
Cryptographic authentication verifies who a bot is, but standardizing data collection best practices establishes what behaviors constitute responsible crawling across the web.
IETF Web Bot Auth Working Group
Cryptographic authentication verifies who a bot is, but standardizing data collection best practices establishes what behaviors constitute responsible crawling across the web.
Next evidence
Watchlist
- What primary evidence would make agentic-web materially change?
- What primary evidence would make licensing-monetization materially change?
- What primary evidence would make asset-rights materially change?
- What primary evidence would make measurement-economics materially change?