Sagoh
In the rapidly evolving landscape of digital media, the traditional playbook for audience reach and monetization is undergoing a seismic shift. As generative AI reshapes how information is discovered and consumed, media executives are grappling with a dual-pronged crisis: how to extract fair value from their content in an era of automated scraping, and how to define "engagement" in a world where human traffic is increasingly obscured by a flood of non-human entities.
These themes took center stage during the recent Digiday Media Strategies Town Hall in London, where industry leaders met under the Chatham House Rule to candidly discuss the survival strategies required for an AI-first future. From the technical challenges of blocking rogue crawlers to the experimental promise of "agentic" media trading, the conversation highlighted a sector in the midst of a profound identity crisis.
The Search for Meaning: Beyond the Page View
For decades, the page view served as the industry’s North Star—a simple, quantifiable metric that signaled success. However, as the digital ecosystem becomes populated by Large Language Models (LLMs), bots, and automated agents, that metric has lost its utility.
"If you think about it from first principles, you have human visitors and non-human visitors," one executive noted during the London session. "We have struggled as an industry for a long time to define what the unifying metrics should be."
Redefining Engagement
The consensus among leadership is shifting away from volume-based metrics toward a more nuanced "engagement stack." This includes unique user identification, subscriber-to-visitor ratios, dwell time, and conversion depth. Yet, this evolution presents a communication hurdle: how do you explain a complex, weighted index to editorial teams accustomed to the binary simplicity of "high traffic versus low traffic"?
One proposed solution is the adoption of "page hours"—a metric that tracks the cumulative time spent by humans on a site. By measuring depth of interaction rather than frequency of clicks, publishers hope to provide editorial teams with actionable data that correlates better with actual business value. However, the lack of a standardized industry definition remains a bottleneck. Without a universal language for "attention," agencies and advertisers remain skeptical, making it difficult for publishers to prove the superiority of their specific audience models against competitors.
The Bot War: Balancing Control and Discoverability
The rise of LLMs has forced publishers into a precarious tactical position: to block or not to block? While preventing unauthorized AI scraping protects intellectual property, it risks severing the link to the very platforms where future audiences reside.
"We’re concerned about discoverability and what blocking might mean in the short term, but also the long-term implications for brand awareness," an executive remarked. The industry is currently experimenting with a strategy of "controlled scarcity." By restricting access, some publishers hope to create a premium market for their content, though the viability of that market remains unproven.
The Problem of Identification
A major technical challenge is the "bad actor" problem. While legitimate tech giants often follow established robots.txt protocols, a growing number of entities scrape content under a shifting array of aliases. Even well-intentioned bots often lack the transparency required for publishers to distinguish them from malicious scrapers.
Fiona Spooner, managing director of consumer revenue at the Financial Times, underscored the scale of the threat, noting that a single trialist account recently attempted to access one million articles across 700,000 different IP addresses in just eight hours. This constant barrage of scraping has moved the issue from a technical annoyance to a top-level financial priority.
Agentic Media Trading: The Next Frontier
While much of the conversation around AI focuses on the defensive, some publishers are looking toward the offensive potential of "agentic" media trading. This involves deploying AI agents to buy and sell ad inventory autonomously, potentially bypassing the current bloated ecosystem of Demand-Side Platforms (DSPs) and Supply-Side Platforms (SSPs).
The goal is to reclaim the value lost to middlemen. By building proprietary selling agents, publishers hope to create a more direct, efficient path to advertisers. The challenge, however, is adoption. "The market is approaching one of those moments when things could change significantly," one participant observed. If publishers can successfully build these systems, they stand to gain an early-mover advantage, potentially attracting ad spend that currently languishes in the inefficient gaps of the traditional programmatic stack.
The skepticism, however, lies in the agency landscape. If automated buying becomes the norm, will agencies allow themselves to be disintermediated, or will they build their own proprietary agents that keep the power structure in their favor?
Official Perspectives: The Rise of SPUR
Amidst this chaos, the Standards for Publisher Usage Rights (SPUR) initiative has emerged as a crucial organizing body. With heavyweights like The New York Times, The Atlantic, and The Economist recently joining its ranks, SPUR is attempting to formalize how AI companies interact with publisher content.
In an interview with Digiday, SPUR co-founder David Buttle addressed the momentum behind the coalition: "The market—a sort of fair, liquid, vibrant market for content to fuel AI systems—doesn’t exist. But it urgently needs to exist."
The Roadmap Ahead
SPUR’s strategy is three-fold:
- Telemetry Standards: Implementing a universal standard to track when and how AI models use publisher data.
- Machine Use Definitions: Establishing a clearer legal and technical framework to separate authorized, beneficial AI usage from illicit scraping.
- Advisory Engagement: Engaging with the "demand side"—the tech giants—to ensure that the development of AI does not come at the expense of the journalism it consumes.
Buttle remains optimistic, noting that conversations with major platforms are "moving in the right direction," though he acknowledges that a finalized, industry-wide agreement is still a work in progress.
Implications: The Year of Structural Re-alignment
The overarching sentiment from the London Town Hall is that the industry is in a "wait and see" period, albeit one where inaction is its own form of risk. Whether it is CNN expanding its "All Access" model internationally or USA Today integrating Palantir’s AI to consolidate reader data, the theme is the same: the consolidation of power through data and the diversification of revenue streams.
Key Takeaways for the Future
- Data Consolidation: Publishers are finally moving toward "single system" architectures. By merging fragmented reader data, companies like USA Today hope to turn anonymous visitors into registered, known users—a necessity in a post-cookie world.
- The Profitability Mandate: With the appointment of figures like Alex Wallace as COO at The Washington Post, the industry is signaling a return to fiscal discipline. Profitability, not just growth, is the new benchmark for leadership.
- The Legal Precedent: The industry is holding its collective breath for the outcome of the New York Times vs. OpenAI lawsuit. This ruling is expected to be the catalyst that finally forces tech platforms to the table, potentially establishing the economic floor for content licensing.
A Sector in Transition
The coming year will likely be defined by the success or failure of these AI experiments. As Fiona Spooner’s account of aggressive scraping shows, the threat is immediate and massive. However, the proactive steps being taken—the formation of SPUR, the development of internal AI agents, and the move toward engagement-based metrics—suggest that publishers are not merely reacting to the AI wave, but attempting to steer it.
The transition from a "traffic-first" model to an "engagement and rights-first" model is fraught with technical and cultural challenges. Yet, as traditional revenue streams continue to face pressure from Apple’s tracking blocks and the shift in consumer habits toward LLM-based search, this transition is no longer an option—it is an existential imperative. The media industry is currently building the plane while it is flying, but for the first time in years, the flight path is beginning to come into focus.
Neng Nana
Siti Muinah
Suro Senen
Azzam Bilal Chamdy
Asep Darmawan
Nana Wu
Nana
Muslim