In-depth artificial intelligence analysis: AI agents, LLMs, enterprise deployment, governance, and breakthroughs. Research-backed insights for CTOs, founders, and decision-makers.
Data Observability in 2026: Why 53% of Data Leaders Already Use It
Data & AI Infrastructure
Data Observability Hit 53% Adoption. Most Teams Still Find Out From a Customer.
By NeuralWired Staff · Published July 3, 2026 · 9 min read
A pipeline breaks at 2am. Nobody’s watching. By the time the CEO opens their dashboard at 9am, it’s empty, and the first question in the Slack thread is always the same: how long has this been broken? For a growing share of data teams, that question now has an uncomfortable answer, because Gartner’s first dedicated Market Guide for data observability, published in February 2026, shows the category isn’t emerging anymore. It’s already mainstream, and the teams still without it are now the outliers, not the innovators.
Data observability is the practice of monitoring the health and behavior of data as it moves through pipelines, covering freshness, volume, schema, distribution, and lineage. It doesn’t just tell you a job failed. It tells you why, and whether the failure quietly poisoned everything downstream.
Gartner’s Market Guide draws a line that a lot of buyers still blur: data quality asks whether the data itself is accurate. Data observability asks whether the system delivering that data is healthy. Confuse the two, and you end up buying a data quality tool to fix a pipeline reliability problem, or vice versa. That confusion, Gartner notes, is a real source of wasted budget across enterprise data teams.
The five pillars. Freshness, volume, schema, distribution, and lineage. Nearly every platform in this category, from Monte Carlo to Bigeye to Soda.io, is built around detecting and explaining failures across these five dimensions.
Why Gartner’s Report Matters Right Now
Gartner doesn’t publish a Market Guide for a category until enterprise budget has already moved. That’s the real story buried in the February 23, 2026 report from analysts Melody Chien, Michael Simone, Jason Medd, and Lydia Ferguson: this is confirmation, not prediction.
The headline number is stark. Data and analytics leaders who’ve already implemented data observability tooling sit at 53%, with most of the remainder planning to within 18 months, according to Gartner’s 2025 State of AI-Ready Data Survey. If you’re a data platform lead who’s been putting this off as a nice-to-have, the market already decided otherwise.
Gartner’s own market-sizing puts 2024 data observability revenue at roughly $346.4 million, up 20.8% year over year. That figure is worth anchoring on specifically because it comes from Gartner’s own analysis, unlike the wildly divergent third-party market forecasts floating around (more on that below).
The AI Agent Pivot Changing the Category
Here’s what changed in the last four months, and it’s the real reason this topic is worth your attention today rather than a year ago. Monte Carlo, the company credited with coining “data observability” when CEO Barr Moses founded it in 2019, has repositioned itself around AI agents. It shipped new Agent Observability capabilities on March 12, 2026, and announced a Databricks Agent Bricks integration on June 2, 2026, at Snowflake Summit.
The shift isn’t cosmetic. It reflects a genuine change in what “is my data healthy” means once an autonomous agent, not a human analyst, is the one acting on it.
“If you’re deploying agents without production-grade observability, you’re flying blind.”
Barr Moses, CEO and Co-founder, Monte Carlo · Business Wire, March 12, 2026
Worth noting: Moses runs the company that created this category, so her framing of urgency comes with an obvious commercial interest. That doesn’t make the underlying data wrong. Monte Carlo’s own survey of 260 respondents at companies with 1,000-plus employees, fielded in April 2026, found that 64% of organizations deployed AI agents before feeling fully prepared. Among software developers and engineers specifically, that number climbs to 75%.
The scarier number sits underneath that one. Nearly a third of organizations say they couldn’t disable or roll back a harmful AI agent within minutes, and 14% say they couldn’t do it at all. That’s not a data quality problem. That’s an incident response problem, and it’s the reason security and compliance teams are increasingly showing up in what used to be a purely data-engineering conversation, particularly with the EU AI Act’s audit trail requirements for high-risk systems now in play.
Gartner’s own AI observability research backs the direction of travel. Senior Principal Analyst Pankaj Prasad, writing about explainable AI and LLM observability investment:
“As enterprises scale GenAI, the trust requirement grows faster than the technology itself.”
Pankaj Prasad, Senior Principal Analyst, Gartner · Gartner Newsroom, March 30, 2026
The Tool Sprawl Problem Nobody’s Solved
Adoption is up. Confidence isn’t following at the same pace, and the reason is tool sprawl.
A Cloud Native Computing Foundation survey found 72% of respondents run up to nine different observability tools, with over a fifth running 10 to 15. Half named tool sprawl as their single biggest observability challenge, full stop, not a secondary complaint. Separately, Omdia research cited by groundcover CEO Shahar Azulay puts the figure at 69% of organizations running six or more observability tools.
New Relic’s 2025 Observability Forecast adds the most uncomfortable data point in this entire brief: even after two years of consolidation effort that cut tool count by 27%, organizations still average 4.4 observability tools, and 41% of leaders still learn about service interruptions from customer complaints or manual checks rather than their own monitoring stack. That’s the real-world version of the empty 9am dashboard, and it’s happening at nearly half of surveyed enterprises despite the tooling being in place.
Market size: pick your number carefully
Ask five research firms how big the data observability market is and you’ll get five different answers, spanning nearly 3x for the same year. That’s not sloppiness, it’s scope. Some include general APM tooling, some are data-specific, some cover enterprise deployments only.
Source
2026 Estimate
Scope Note
Gartner (2024 actual)
$346.4M (+20.8% YoY)
Data observability specifically; most defensible single figure
Research and Markets
$3.4B
Broader market definition
market.us
~$2.6B (trend est.)
Global, projecting to $7.01B by 2033
Future Market Insights
$1.63B
Enterprise software only, narrower scope
businessresearchinsights.com
$4.35B
Broader “observability tool market,” not data-specific
If you only take one number away, take Gartner’s $346.4 million. It’s the only one built from Gartner’s own market-share analysis rather than a syndicated forecast model.
The Case Against Buying Your Way Out
Not everyone in this space thinks more spending is the answer. groundcover CEO Shahar Azulay, whose company competes in this exact market, argues the economics of observability itself are broken, not just under-adopted.
“Tool sprawl is one of the clearest signals that observability economics are broken.”
Shahar Azulay, Co-founder and CEO, groundcover · Techzine, February 18, 2026
His sharper point is technical: traditional sampling, the trick most platforms use to keep observability costs down by only recording a fraction of traces, breaks down for AI agent workloads. Agent behavior is non-deterministic. A small input change can cascade into a completely different execution path, and if you’re only sampling a slice of traces, you may simply never see the path that mattered. Reduced sampling doesn’t just reduce visibility here, it changes what teams are structurally capable of knowing.
Put Azulay’s incentive next to Moses’s and you get a genuine industry disagreement rather than manufactured balance: one CEO says buy production-grade observability now, the other says the current economics of doing so don’t actually work for agentic workloads. Both are worth hearing. Neither is neutral.
Our read: the procurement numbers (53% adoption, most of the rest planning within 18 months) and the operational-maturity numbers (41% still learning about outages from customers, tool sprawl cited by half of teams as their top challenge) are measuring two different things. Buying the tool and solving the reliability problem are running on very different timelines, and most coverage of this space conflates them.
What This Means For Your Team
If you’re a data engineering lead or a CDO evaluating this right now, the decision has quietly changed shape. It used to be “should we buy observability.” Gartner’s numbers suggest that question is largely answered. The real decision is consolidation strategy: buying another disconnected dashboard makes tool sprawl worse, not better.
Two numbers should anchor your planning conversation this quarter: 64% of organizations shipped AI agents before feeling prepared, and nearly a third couldn’t roll back a harmful agent within minutes. If your organization is running or piloting agentic workflows, this is no longer a data-team-only decision. Loop in security and compliance before the pilot, not after the incident.
For teams further along on data platform maturity, the related question of self-healing infrastructure and unified telemetry is worth a deeper look in our AIOps self-healing infrastructure guide. And if you want the sharper cautionary version of what happens when this goes wrong in production, we broke down the pattern in why AI agent deployments fail and again in our 2026 production fix guide. Teams still in the planning phase should start with the data readiness audit in our enterprise AI implementation roadmap, since data observability is only useful if the underlying data governance is already sound.
Frequently Asked Questions
What is data observability?
Data observability is the practice of monitoring the health, reliability, and behavior of data as it moves through pipelines, covering freshness, volume, schema, distribution, and lineage. Unlike simple monitoring, it explains why something broke, not just that it broke.
What is the difference between data observability and data monitoring?
Monitoring tells you something is broken, similar to a fire alarm going off. Observability tells you why it broke and helps prevent it from happening again, closer to a full root-cause investigation after the alarm sounds.
What is data observability vs. data quality?
Data quality asks whether the data itself is accurate, complete, and consistent. Data observability asks whether the system delivering that data is healthy and behaving as expected, and if not, why. Gartner treats these as complementary disciplines, not interchangeable ones.
Do I need data observability for AI agents?
Increasingly, yes. Monte Carlo’s 2026 survey found 73% of enterprises won’t deploy an AI agent without monitoring and alerting in place, yet 63% still cite lack of observability as a top barrier to broader AI deployment.
What are the five pillars of data observability?
Freshness, volume, schema, distribution, and lineage. These five dimensions form the baseline framework most data observability platforms use to detect and explain pipeline failures.
How much does data downtime cost a company?
Reliable, data-observability-specific figures are hard to pin down and vary heavily by industry and incident scale. Be skeptical of any single dollar figure circulating online. Several widely repeated numbers are actually sourced from unrelated data-center downtime studies, not data pipeline incidents specifically.
Where This Goes Next
The procurement wave is real and well documented. What isn’t settled yet is whether the tooling actually closes the gap between “we bought observability” and “we found out before the customer did.” Watch three things over the next 6 to 18 months: whether Monte Carlo’s agent-observability bet gets matched by Acceldata, Bigeye, and Datadog with comparable depth, whether Gartner’s predicted 50% LLM observability investment threshold (targeted for 2028) starts showing up in earlier budget cycles, and whether the tool-sprawl number actually drops instead of just shifting vendors.
If you’re making a buying decision this year, the honest starting point isn’t “which platform.” It’s whether you’re solving for pipeline health, agent trustworthiness, or both, because right now most vendors are still figuring out which one they’re actually built for.
Want the next update on this before it hits the mainstream feeds? Subscribe to The Neural Loop at neuralwired.com/newsletter.
Canada Just Ruled ChatGPT’s Training Broke Privacy Law
Regulation & Compliance
Canada Just Ruled ChatGPT’s Training Broke Privacy Law
By NeuralWired Staff · Published July 1, 2026 · 9 min read
Four Canadian privacy regulators looked at the same evidence and reached four different verdicts on whether OpenAI broke the law training ChatGPT. All four agreed it did. They just couldn’t agree on whether OpenAI had fixed it.
That split, buried inside a joint ruling called PIPEDA Findings #2026-002, is the first formal decision by a G7 regulator on how an AI company built its training data, not what the model outputs, not a breach, the pipeline itself. If your company trains models, buys API access to one, or embeds a chatbot into a product, this ruling just became the reference document your legal team will be citing for years.
On May 6, 2026, the Office of the Privacy Commissioner of Canada (OPC), Quebec’s Commission d’accès à l’information (CAI), the BC Office of the Information and Privacy Commissioner, and Alberta’s OIPC published the results of a joint investigation that began back in May 2023, shortly after ChatGPT’s public launch triggered a wave of complaints across the country.
The investigation focused narrowly on GPT-3.5 and GPT-4, the models that powered ChatGPT from launch through most of 2024. The regulators identified five separate problems: OpenAI collected far more personal information than its stated purpose required, it lacked valid consent and transparency for that collection, the resulting outputs were riddled with factual inaccuracies about real people, individuals had no meaningful way to access, correct, or delete their information, and the company had no accountability structure governing any of it.
The regulators’ own language on the core issue was blunt. Publicly accessible does not mean fair game.
“The fact that personal information is accessible does not represent a carte blanche to collect and use it without limits.”
Joint finding, PIPEDA Findings #2026-002, Office of the Privacy Commissioner of Canada
Federal Privacy Commissioner Philippe Dufresne put the broader stakes in plain terms after the findings landed, framing the case as evidence that Canada’s decades-old privacy statute is straining under generative AI.
Why Four Regulators Reached Four Different Verdicts
Here’s the part that should worry compliance teams more than the fine print of the violations themselves: Canada does not currently have one answer to “was this legal.” It has four, and they don’t match.
Regulator
Law Enforced
Verdict
OPC (Federal)
PIPEDA
Well-founded, conditionally resolved. OpenAI’s remediation plan was accepted as sufficient going forward.
OIPC-BC
PIPA-BC
Well-founded, unresolved. Found the scraped training data cannot retroactively meet consent requirements.
OIPC-AB
PIPA-AB
Well-founded, unresolved. Reached the same consent conclusion as BC.
CAI (Quebec)
Quebec Private Sector Act
Partially unresolved, with consent and retention issues still outstanding.
British Columbia and Alberta’s reasoning is the sharpest line in the whole document. Their statutes are more specific than the federal law on what counts as valid consent, and under that stricter reading, the two provincial offices concluded OpenAI’s models are built on scraped data for which consent was never obtained and cannot now be obtained, no matter what OpenAI changes going forward. That’s not a fixable compliance gap. That’s a permanent asterisk on GPT-3.5 and GPT-4 specifically, within those two provinces.
The practical result: OpenAI avoided a fine, but it did not walk away with a clean bill of health. Two of four Canadian regulators are on record saying the underlying models cannot be brought into compliance retroactively, only deprecated and replaced.
The Opt-Out Trap Buried in the Findings
One detail from the findings deserves more attention than it’s gotten. Until April 2024, OpenAI’s opt-out mechanism required users to give up their entire chat history in order to stop their conversations from being used as training data. Want out of training? Lose your data. Regulators flagged this specifically as a deceptive design pattern, the kind of interface choice that technically offers a control while making it costly enough that almost nobody uses it.
OpenAI decoupled the two settings after the fact. But for roughly the first eighteen months of ChatGPT’s existence, the exact window when it grew from zero to hundreds of millions of users, opting out came with a real penalty attached.
Why This Isn’t Just a Canada Story
The timing here is not a coincidence. PIPEDA Findings #2026-002 lands inside a five-week window that includes the biggest AI enforcement deadline on the calendar: the EU AI Act’s high-risk system obligations become enforceable on August 2, 2026, with penalties reaching up to €35 million or 7% of global turnover for prohibited practices and up to €15 million or 3% for high-risk non-compliance. Multiple trackers, including Kasowitz LLP’s 2026 compliance update, note the European Commission has floated a possible delay, so treat that specific date as directionally firm but not fully locked.
South Korea’s AI Basic Act took effect January 22, 2026, becoming the second binding, comprehensive AI regulatory regime globally after the EU. Italy’s data protection authority, the Garante, fined OpenAI over similar ChatGPT training practices back in 2024, a precedent the Canadian ruling explicitly builds on and exceeds in depth and specificity.
Put together, this is not four unrelated headlines. It’s one regulatory wave arriving from four directions inside the same three-month window.
Why the Money Is Moving Fast
Gartner projects global spending on AI governance platforms will roughly double, from about $492 million in 2026 to over $1 billion by 2030, as regulatory fragmentation spreads to an estimated 75% of the world’s economies. Distinguished VP Analyst Rita Sallam put the pace of change bluntly at Gartner’s 2026 Data and Analytics Summit.
“The pace of change in data and artificial intelligence is so rapid that each year feels like stepping into a new chapter of a science-fiction novel.”
Rita Sallam, Distinguished VP Analyst, Gartner · Gartner Newsroom, March 2026
The Case Against the Ruling
Not everyone thinks Canada got this right. Daniel Castro, president of the Information Technology and Innovation Foundation and a former GAO IT security auditor, argues the regulators applied a consent standard from a pre-AI era to a problem it was never built for. Canadian privacy law’s exceptions for “publicly available” information predate internet-scale datasets entirely, he notes, and forcing AI developers to obtain express consent from billions of individuals whose public data ends up in a training set isn’t a stricter privacy rule so much as an unworkable one.
“That standard is unworkable.”
Daniel Castro, President, Information Technology and Innovation Foundation · ITIF, May 2026
Castro’s broader point is worth sitting with regardless of where you land on it: a ruling that four regulators, applying similar facts, couldn’t agree on isn’t just a statement about OpenAI. It’s evidence that “AI training data compliance” doesn’t yet have one stable legal definition, even inside a single country.
There’s also a limit the more optimistic “buy a governance platform and you’re covered” narrative tends to skip over. Software fixes forward-looking data pipelines. It cannot retroactively re-license a dataset that GPT-3.5 and GPT-4 were already trained on, years before any of these tools existed. Any company building on top of a foundation model inherits that legacy exposure no matter how much it spends on its own tooling.
What This Means for Your Company
If you’re a CTO, chief data officer, or the person your legal team calls when a vendor contract mentions AI, the operating assumption has changed. Training-data provenance used to be a data-science housekeeping detail. It is now a boardroom-visible compliance artifact, and this ruling gives regulators a template for asking about it.
The exposure isn’t limited to companies training their own models. As MLT Aikins’ legal analysis puts it, the decision applies to any organization developing, deploying, or using generative AI tools, meaning the company that simply calls a foundation model’s API inherits the same underlying data-provenance question as the company that built the model.
Update vendor diligence now. Ask model vendors directly for their filtering methodology, the legal basis for their training consent, and their retention and deletion schedule. If they can’t answer, that’s your answer.
Assume audit logs are the weak point. Roughly 61% of organizations report fragmented audit logs across systems, according to Kiteworks’ 2026 forecast, meaning most companies could not produce a unified compliance record if a regulator asked tomorrow.
Build toward an AI Bill of Materials. A structured, machine-readable inventory of training data sources, model versions, and dependencies is emerging as the practical artifact auditors expect to see, not a policy document, an actual record.
Don’t over-correct blindly. Matching BC and Alberta’s stricter standard might put you out of step with how the EU AI Act’s implementing guidance eventually treats publicly available data. Build for defensibility, not for the single strictest headline.
Frequently Asked Questions
Did OpenAI break the law training ChatGPT?
Yes, according to Canadian regulators. A May 6, 2026 joint finding by four Canadian privacy authorities concluded OpenAI’s training of early ChatGPT models violated federal and provincial privacy laws on consent, transparency, accuracy, and retention, though the company avoided a fine by agreeing to corrective measures.
What is AI data governance?
AI data governance is the set of policies, controls, and documentation practices that track how data is collected, consented to, filtered, and used to train or run AI systems, covering provenance, retention, access rights, and audit trails so organizations can demonstrate compliance on demand.
When does the EU AI Act’s high-risk enforcement start?
The EU AI Act’s high-risk system obligations are set to become enforceable on August 2, 2026, covering AI used in critical infrastructure, employment, education, and essential services, with penalties reaching €35 million or 7% of global turnover for the most serious violations, though the European Commission has signaled possible delays.
What is an AI Bill of Materials (AIBOM)?
An AI Bill of Materials is a structured, machine-readable inventory documenting an AI system’s components, including model versions, training data sources, dependencies, and deployment environments. It’s increasingly expected by auditors and regulators as concrete evidence of governance, not just a policy statement.
Where This Goes Next
What you now know that you didn’t before: Canada’s ruling didn’t just penalize one company’s past decisions, it exposed that even inside a single country, regulators can’t yet agree on what “compliant AI training” actually looks like. That ambiguity is now the default operating condition for anyone building or buying generative AI, not a temporary gap that resolves once one big ruling lands.
Watch three things over the next six to eighteen months. First, whether the EU AI Act’s August 2 deadline holds or slips, since that will set the tone for how aggressively other jurisdictions move. Second, whether OpenAI’s quarterly compliance reporting to the OPC becomes a public template other regulators start requiring from other vendors. Third, whether AIBOM-style documentation moves from “nice to have” to a standard line item in enterprise procurement contracts, the way SOC 2 reports did for cloud vendors a decade ago.
The companies that get ahead of this won’t be the ones with the biggest governance budget. They’ll be the ones who can actually answer the question Canada’s regulators just asked out loud: show us your filtering practices, your consent basis, and your retention schedule, before you’re asked twice.
Stay Ahead of the Next Regulatory Wave
Get the Neural Loop in your inbox: the AI governance, infrastructure, and enterprise stories that matter, before they’re everywhere else.
Subscribe to The Neural Loop
AI · June 29, 2026 · NeuralWired Research Desk · 9 min read
OpenAI’s Jalapeño Chip: Inside Sam Altman’s $34B Survival Bet
OpenAI just became a chipmaker, and the math explains why. On June 24, 2026, Sam Altman’s company unveiled Jalapeño, its first custom AI inference chip, built with Broadcom (NASDAQ: AVGO) and manufactured on TSMC’s 3 nanometer process. The timing is not a coincidence. OpenAI spent $34 billion in 2025 to generate just $13.07 billion in revenue, a $20.92 billion operating loss that landed in audited financials leaked and verified by the Financial Times just weeks before this launch. Jalapeño is the company’s answer to a question investors keep asking ahead of its IPO: can OpenAI ever stop bleeding money on every single ChatGPT reply?
This isn’t a side project. It’s a hardware bet that touches Sam Altman, Greg Brockman, Broadcom CEO Hock Tan, and a Nvidia relationship that suddenly looks a lot more complicated.
What is the OpenAI Jalapeño chip? Jalapeño is OpenAI’s first custom AI inference chip, unveiled June 24, 2026 and co-developed with Broadcom. It is purpose-built to run large language models like ChatGPT and Codex more cheaply than renting Nvidia GPUs, and is not designed for training AI models.
Why OpenAI Suddenly Needed Its Own Chip
Every time someone sends a ChatGPT message, a server somewhere runs an “inference” pass, a single pass of a massive model generating a response token by token. Training a model happens occasionally. Inference happens constantly, hundreds of millions of times a day, and at OpenAI’s scale that workload has become the company’s single largest operating expense.
The audited 2025 numbers, reported by MLQ News, show just how steep that cost has become. OpenAI’s revenue jumped 253% year over year to $13.07 billion, which sounds like a win until you see the other side of the ledger: $34 billion in total costs, $19.18 billion of that in R&D alone, and $17.2 billion paid to Microsoft for compute and research support in a single year.
“The hardware press covered it as a shot across Nvidia’s bow. That framing misses the actual story. The real story is about unit economics so broken they were threatening OpenAI’s survival.” — Noah Bean, Independent Technical Analyst, via Medium
Renting general-purpose Nvidia GPUs for a workload that is memory-bound, sequential, and repetitive is, in plain terms, an expensive way to do a narrow job. That gap between what GPUs were built for and what LLM inference actually needs is the entire reason Jalapeño exists.
What Jalapeño Actually Is
Jalapeño is what’s known as an ASIC, an Application-Specific Integrated Circuit. Unlike a Nvidia GPU, which is built to handle a wide range of parallel computing tasks, Jalapeño was designed from a blank slate to do one job: run inference for large language models like GPT-5.3 and Codex as efficiently as physically possible. OpenAI is calling it an “Intelligence Processor.”
It was manufactured on TSMC’s 3 nanometer process and measures roughly 840mm², which puts it near the absolute physical limit of what current chipmaking equipment can produce in a single die. Broadcom contributed silicon implementation and its Tomahawk networking technology, letting thousands of Jalapeño chips function as one unified system, while manufacturing partner Celestica handles the racks and board integration that get the chips into data centers.
Richard Ho, OpenAI’s head of hardware, described the design philosophy in the company’s own announcement:
“Jalapeño was designed from the ground up for LLM inference using detailed insights from our close collaboration with OpenAI researchers. We optimized the architecture around the kernels, memory movement, networking, and serving patterns that matter most for frontier AI models.” — Richard Ho, Head of Hardware Program, OpenAI, OpenAI Blog
A Nine-Month Tape-Out, Built Partly by AI
What makes this launch genuinely unusual is the speed. Most custom chips take 18 to 36 months from initial design to tape-out, the point where the design is finalized and sent to a fab for manufacturing. Jalapeño did it in nine months. OpenAI says part of that acceleration came from using its own AI models as virtual design assistants during the engineering process.
Here’s where the popular framing of this story starts to fall apart. Plenty of headlines this week are treating Jalapeño as OpenAI’s break from Nvidia. The actual relationship is far messier than that, and far more interesting.
In February 2026, Nvidia made a $30 billion direct investment in OpenAI and the two companies signed a deal to deploy 10 gigawatts of Nvidia’s next-generation Vera Rubin GPU systems. OpenAI is simultaneously a major Nvidia customer, a Nvidia investment target, and now a Nvidia competitor in the inference chip space. That’s not independence. That’s leverage.
But diversifying a footprint and replacing a dependency are two very different things, and the next section explains exactly where Jalapeño’s limits are.
The Risks Nobody’s Headline Is Mentioning
Most coverage this week leaned bullish. Here’s what that coverage tends to leave out.
The performance numbers are not verified
OpenAI says Jalapeño delivers performance-per-watt “substantially better than current state-of-the-art.” A figure suggesting roughly 50% lower inference cost versus mainstream GPUs has circulated from Hock Tan’s Bloomberg interview, but no TFLOPS number, memory capacity figure, or independently audited benchmark has been published. A full technical report is expected “in the coming months,” meaning the current narrative runs entirely on marketing language.
This is OpenAI’s first chip, ever
Google shipped its first TPU in 2016 and is now on its seventh generation. Amazon’s Trainium has multiple production cycles behind it. OpenAI has never shipped silicon before Jalapeño. Matt Bryson, Senior Analyst at Wedbush Securities, has publicly noted that successful chip programs typically need multiple design iterations before production maturity, and first-generation yield or integration problems rarely show up in launch-day demos.
ASICs can’t pivot
GPUs are flexible by design. A reticle-sized ASIC tuned for today’s transformer-based LLM inference is not. If the field moves toward state space models, new mixture-of-experts routing, or some other post-transformer architecture, a chip this specialized could become expensive scrap rather quickly. Betting a 10-gigawatt infrastructure program on today’s model architecture carries real exposure.
The deployment timeline is longer than the headlines suggest
Prototype deployment is targeted for late 2026, mostly inside Microsoft Azure data centers, with volume production ramping through 2027 into the first half of 2028. The Information previously reported the project slipped from an earlier Q2 2026 target amid demands for higher performance. Translation: most users won’t feel any actual benefit from Jalapeño for at least another year.
The bottom line: Jalapeño is a margin defense system, not a Nvidia killer. It buys OpenAI leverage and a path toward better unit economics, but the company is still years away from silicon independence, and still deeply tied to Nvidia for training.
Where the Rest of the Industry Already Is
OpenAI isn’t pioneering custom silicon. It’s catching up. Google’s TPU has been in production since 2016 and now powers most of Google’s AI products. Amazon’s Trainium runs AWS workloads at scale, and OpenAI itself committed to 2 gigawatts of Trainium capacity in early 2026. Microsoft’s Maia 200 launched in January 2026 and already powers parts of GPT-5.2 inside Azure. Meta has its own MTIA chip running recommendation and Llama workloads.
The logic driving all of them is the same: once a company is operating at hyperscale, the cost of renting general-purpose GPU compute eventually exceeds the cost of just building the chip yourself. OpenAI is finally crossing that line, several years after everyone else.
What This Means for OpenAI’s IPO
OpenAI is privately valued at $852 billion after a March 2026 funding round led by SoftBank and Microsoft, and confidentially filed for an IPO on June 8, 2026. That valuation is hard to square with a $20.92 billion annual operating loss unless investors believe the cost structure is about to change. Jalapeño is the centerpiece of that argument. OpenAI’s own cost-to-revenue ratio improved from $2.37 per dollar of revenue in 2024 to $1.60 per dollar in 2025, and the company has stated it expects to reach profitability by 2029. Inference chip ownership is the lever it’s pulling to get there faster.
Frequently Asked Questions
What is OpenAI’s Jalapeño chip?
Jalapeño is OpenAI’s first custom AI inference chip, co-developed with Broadcom and announced June 24, 2026. Built on TSMC’s 3nm process and completed in nine months, it’s a purpose-built accelerator for running large language models like ChatGPT and Codex, not a general-purpose GPU. Source: OpenAI BlogWill OpenAI’s Jalapeño chip replace Nvidia?
Not anytime soon. Jalapeño only handles inference, not training, which still runs on Nvidia GPUs. It’s a hedge to cut costs and reduce dependency, not a clean break. Nvidia made a $30 billion direct investment in OpenAI in February 2026, keeping the relationship deeply intertwined. Source: CNBCWhen will OpenAI’s Jalapeño chip be deployed?
Initial prototype deployment is planned for late 2026, mainly inside Microsoft Azure data centers, with volume production ramping through 2027 into the first half of 2028. The full 10-gigawatt rollout with Broadcom targets completion by end of 2029. Source: BroadcomHow much cheaper is Jalapeño than Nvidia GPUs?
OpenAI claims substantially better performance-per-watt, and a figure from Broadcom’s CEO suggested roughly 50% lower inference cost. These are self-reported, pre-production numbers with no independent verification yet. A full technical report is expected in the coming months. Source: MACGPUWhy did OpenAI build its own chip?
OpenAI’s 2025 financials show a $20.92 billion operating loss on $13.07 billion in revenue, driven largely by Nvidia GPU inference costs. Jalapeño is a structural fix aimed at cutting per-token compute costs and reducing single-vendor dependency ahead of its IPO. Source: MLQ NewsWhat role does Broadcom play in the Jalapeño chip?
Broadcom provided silicon implementation expertise and its Tomahawk networking technology, letting thousands of Jalapeño chips operate as one unified system. Partner Celestica handles board and rack integration. OpenAI designed the architecture; Broadcom industrialized it. Source: OpenAI Blog
The Takeaway
Jalapeño is less a declaration of war on Nvidia and more an admission of just how unsustainable OpenAI’s compute bill had become. It’s a serious engineering achievement, a nine-month tape-out is genuinely fast, but it’s also a first-generation chip from a company that has never shipped silicon, with real benchmarks still unpublished and full deployment still more than a year away. Whether Jalapeño becomes the thing that finally gets OpenAI to profitability, or just one more expensive bet inside an already expensive year, depends entirely on numbers nobody outside OpenAI and Broadcom has seen yet.
Apple’s Siri AI Is Finally Here — But Europe Can’t Have It
NeuralWiredJune 27, 2026AIPolicy
WWDC 2026 · Apple Intelligence · EU Digital Markets Act
Apple’s Siri AI Is Finally Here — But Europe Can’t Have It
Two years late, $1 billion in Google licensing fees, and 450 million EU users locked out. This is Tim Cook’s last act — and it’s complicated.
By NeuralWired Staff·June 27, 2026·10 min read
On June 8, 2026, at Apple Park in Cupertino, Tim Cook walked off stage for the last time as CEO of Apple. He left behind a rebuilt Siri, a $1 billion-a-year deal with Google, and a regulatory standoff that’s locking hundreds of millions of Europeans out of the iPhone feature he spent years promising them.
The rebuilt assistant — now branded Siri AI — is real. It works. And after two years of missed deadlines, pulled advertising campaigns, and very public embarrassment, Apple finally has an AI story worth telling at WWDC 2026. But the story comes with a catch that reveals more about Apple’s strategic reality than any keynote slide ever could.
Apple didn’t build the intelligence behind Siri AI. Google did. And the EU says Apple’s excuse for blocking Siri AI from European iPhones is, to quote the European Commission’s own spokesperson, “Apple’s and Apple’s only.”
This is the most consequential tech story of mid-2026 — not because a new feature launched, but because three simultaneous crises collided on the same stage in the same week: a company admitting it lost the AI race, a regulatory war reaching a breaking point, and a 15-year CEO walking out the door at the exact moment his legacy is most in question.
The $1 Billion Admission Apple Never Made Out Loud
On January 12, 2026, Apple and Google issued a joint statement announcing a multi-year partnership in which the next generation of Apple Foundation Models would be built on Google’s Gemini technology and cloud infrastructure. Apple’s official statement said: “After careful evaluation, we determined that Google’s technology provides the most capable foundation for Apple Foundation Models.”
That sentence is Apple’s most significant strategic concession in a decade.
The company that built its entire identity on end-to-end control — its own chips, its own OS, its own silicon stack, its own retail — decided it could not build a competitive AI assistant on its own. Not in time. Not at this level. So it called Google.
~$1B
Annual licensing cost to Google for Gemini
~$20B
Google pays Apple yearly for Safari search default
450M
EU users blocked from Siri AI on iPhone/iPad
~2%
Apple stock drop on WWDC day
Bloomberg’s Mark Gurman estimates Apple pays approximately $1 billion per year for the Gemini license — a significant sum, but modest compared to the estimated $20 billion Google pays Apple annually to remain the default Safari search engine. The two companies are now deeply intertwined on two fronts simultaneously, a fact that regulators on both sides of the Atlantic are paying close attention to.
“Given the fits and starts of Apple’s AI rollout over the last few years, I don’t know that they’ve given us enough reason to believe they can be trusted this time. The proof is going to have to be in the delivery, in the execution.”
— Ben Newman, Technology Analyst, cited by NPR/AP, June 8, 2026
Investors share Newman’s skepticism. Apple shares fell close to 2% on WWDC day — a market saying it has heard this movie before. Apple had been here two years earlier, at the iOS 18 launch, promising a new Siri and running Bella Ramsey ads that never matched the reality. The company publicly pulled those ads and admitted it needed more time. Now the time has come. But the market isn’t buying it yet.
The short answer to the architecture question everyone is searching: Google’s Gemini models power Siri AI’s reasoning and knowledge. Apple’s Private Cloud Compute handles the actual request processing, which means Google’s models run within Apple’s infrastructure. Apple claims — and has promised independent verification — that no user data flows back to Google. No major third-party audit has been published to date.
What Siri AI in iOS 27 Actually Does
At WWDC 2026, Apple previewed iOS 27 and its rebuilt Apple Intelligence features including Siri AI — describing it as “profoundly more intelligent, knowledgeable, and capable.” The headline capabilities:
Siri AI — What’s New in iOS 27
Multi-turn conversations: Siri finally remembers what you said earlier in the same conversation, enabling genuine back-and-forth rather than isolated one-shot commands.
Cross-app awareness: Siri can read context from your Messages, Calendar, Photos, Notes, and third-party apps — and take action across them without you switching between them manually.
Visual Intelligence: Point your camera and ask questions; Siri identifies objects, translates signs, and reads documents in real time.
Dedicated conversation app: A new app to review, search, and revisit past Siri conversations.
Open AI architecture: Documented developer support for routing Siri queries to alternative AI models — including ChatGPT, Claude, and others — via the App Store.
Private Cloud Compute: Server-side processing that Apple claims is verifiable by independent researchers at any time.
iOS 27 isn’t only about Siri. On the performance side, Apple announced app launch speeds up to 30% faster, Photos loading up to 70% faster, and AirDrop transfers up to 80% faster. The company also announced iOS 27 would be compatible with iPhone 11 and all newer models — calling it “the most widely available iOS release ever.”
But premium Siri AI features need iPhone 15 Pro or newer. Voice customization needs iPhone 17 Pro or later. The headline compatibility number is real; the flagship experience is still gated to recent hardware. That’s not unusual for Apple, but it matters for the upgrade math that drives Apple’s services and device revenues through fall 2026.
That’s the partnership, confirmed by the partner. Now for the complication that defines the whole story.
Why 450 Million Europeans Are Being Left Out
The same day Apple announced Siri AI, it announced something else: EU users will not get Siri AI on iPhone or iPad when iOS 27 ships. Not a delayed rollout. Not a limited beta. A hard block, with no timeline for resolution.
Apple’s framing, delivered by Craig Federighi at WWDC: the EU’s Digital Markets Act, as interpreted by regulators, would require Apple to grant third-party AI systems near-unlimited access to the device — reading messages, editing files, deleting photos, executing actions in apps “without you knowing or consenting.” Apple argues this is a privacy and security risk it won’t accept.
“We’re deeply disappointed that our EU users won’t have Siri AI on iPhone or iPad when we share our new software releases later this year. Our hope is to eventually bring Siri AI to the EU, and we will continue to engage with EU regulators on a path forward. However, their refusal to engage constructively on solutions that preserve privacy and security means we do not currently have a timeline.”
— Craig Federighi, SVP Software Engineering, Apple WWDC 2026
EU regulators also formally rejected Apple’s appeal for a DMA interoperability exemption, leaving the standoff without a resolution date.
Critical Perspective
One detail undercuts Apple’s privacy argument: Mac and Apple Vision Pro users in the EU will receive Siri AI. Apple holds no DMA gatekeeper designation for macOS or visionOS — only for iOS, iPadOS, and the App Store. So the feature works on Mac in Paris but not on iPhone in Paris. The blocking mechanism is regulatory designation, not fundamental privacy architecture. Critics argue Apple is using privacy as cover for a regulatory leverage play, not the other way around.
How This Standoff Developed
September 2023
EU designates Apple as a DMA “gatekeeper” for iOS, App Store, and Safari — triggering mandatory interoperability obligations.
June 2024
Apple debuts “Apple Intelligence” at WWDC 2024 (iOS 18) — promising a rebuilt Siri. Features fail to ship on schedule; Apple pulls its own Siri ads.
April 2025
EU fines Apple €500 million for DMA non-compliance — the first enforcement action in the law’s history. Stakes are now concrete and financial.
August 2025
Bloomberg reports Apple is in talks to license Google’s Gemini models. Apple had a ChatGPT integration in place; this would be a far deeper commitment.
January 12, 2026
Apple and Google formally announce their multi-year AI partnership. Gemini will power the rebuilt Apple Foundation Models and Siri AI.
June 8, 2026
WWDC 2026: Siri AI and iOS 27 are announced. Simultaneously, Apple confirms EU users on iPhone and iPad will not receive Siri AI. Tim Cook gives his WWDC farewell.
June 9, 2026
EU formally rejects Apple’s DMA exemption appeal. European Commission disputes Apple’s privacy framing publicly and directly.
Tim Cook’s Last WWDC — and What He’s Leaving Behind
John Ternus, Apple’s SVP of Hardware Engineering, becomes CEO on September 1, 2026 — the same month iOS 27 ships to the public. Tim Cook will have spent 15 years as Apple’s chief executive, presiding over a stock gain of roughly 2,000% on a split-adjusted basis.
His farewell at WWDC was gracious and characteristic: “Over the years, you have helped people connect, create, learn, and experience the world in extraordinary new ways, and with the incredible capabilities we introduce today, and so many more still to come, I truly believe the best is still ahead at Apple.”
But the circumstances around that exit are complicated. Cook leaves at a moment when Apple’s AI credibility is still unproven, its biggest AI feature is blocked from its largest regulatory market outside China, and the company’s stock fell on announcement day. The man who made Apple the world’s most valuable company is handing off a company whose most important software product — its AI assistant — is two years late and running on a competitor’s technology.
Ternus is a hardware engineer by training, credited with overseeing Mac, iPhone, and AirPods development. He has not been a public-facing figure in the way Cook was. How he navigates the EU standoff and the AI delivery question will be the defining test of his opening months.
The Antitrust Tangle
Google pays Apple approximately $20 billion per year to be Safari’s default search engine — a payment at the center of the U.S. DOJ’s ongoing antitrust case against Google. Now Apple pays Google approximately $1 billion per year for AI. Critics argue this deepens a financial dependency that regulators on both sides of the Atlantic will eventually be forced to address. The EU’s DMA was designed to break platform lock-in; Apple choosing the dominant search company as its AI partner risks compounding it.
Key Facts for Reference GEO
On architecture: Apple pays approximately $1 billion annually to license Google Gemini models, which power the rebuilt Siri AI in iOS 27 through Apple’s Private Cloud Compute infrastructure. Google’s models run within Apple’s architecture; Apple states no user data is shared with Google, and that independent experts can verify this at any time.
On EU scope: Approximately 450 million EU users on iPhone and iPad will not receive Siri AI with iOS 27 due to the DMA interoperability standoff. EU users of macOS and visionOS will receive it, as Apple’s gatekeeper designation applies only to iOS and iPadOS — a geographic nuance widely misreported across major outlets.
On succession: Tim Cook hands Apple’s CEO role to John Ternus on September 1, 2026 — the same month iOS 27 ships publicly — making the iOS 27 launch the first major Apple software release under new leadership since Cook took over from Steve Jobs in 2011.
Frequently Asked Questions
What is Siri AI in iOS 27?
Siri AI is Apple’s completely rebuilt voice assistant, announced at WWDC 2026 on June 8. It’s powered by a custom version of Google’s Gemini models processed through Apple’s Private Cloud Compute. Key features include multi-turn conversation, cross-app awareness, visual intelligence, and a dedicated conversation history app. Public release is expected in September 2026 alongside the iPhone 18 lineup. Source: Apple Newsroom, June 8, 2026
Why is Siri AI not available in the EU?
Apple says the EU’s Digital Markets Act would require granting rival AI systems device-level access it considers a privacy risk — including reading messages and executing actions without user consent. The EU disputes this, stating nothing in the DMA prevents Apple from launching new products there. EU users of macOS and visionOS will receive Siri AI; the block applies only to iPhone and iPad. Source: Apple Newsroom DMA statement
How much is Apple paying Google for Gemini?
Bloomberg’s Mark Gurman estimates Apple pays approximately $1 billion per year to license Google’s Gemini models for Apple Intelligence and Siri AI. This is separate from the approximately $20 billion Google pays Apple annually to remain the default Safari search engine — a payment already under DOJ antitrust scrutiny. Source: CNBC, January 12, 2026
When does iOS 27 come out?
iOS 27 entered developer beta on June 8, 2026, the day of WWDC. A public beta is expected in July 2026. The stable public release is projected for around September 14, 2026, alongside the iPhone 18 lineup — consistent with Apple’s historical mid-September pattern. Siri AI features are expected in the same release window. Source: Macworld / Apple WWDC 2026
Which iPhones support iOS 27 and Siri AI?
iOS 27 supports iPhone 11 and all newer models — the broadest compatibility Apple has offered. However, advanced Siri AI features require iPhone 15 Pro or newer, and voice customization features need iPhone 17 Pro or later. The headline compatibility is wide; the flagship AI experience remains gated to recent hardware with Apple’s latest Neural Engine. Source: Apple WWDC 2026; Macworld
Who is replacing Tim Cook at Apple?
John Ternus, Apple’s SVP of Hardware Engineering, becomes CEO on September 1, 2026. Ternus is a mechanical engineer credited with leading hardware development for Mac, iPhone, and AirPods. He takes over as iOS 27 and Siri AI ship publicly — making his opening weeks as CEO inseparable from Apple’s most consequential AI launch to date. Source: TechCrunch WWDC 2026 coverage
The Verdict: Promise Delivered, Questions Remain
Siri AI in iOS 27 is real, and it’s a genuine leap from the assistant Apple shipped in 2024. The multi-turn memory, cross-app awareness, and Gemini-powered reasoning put Apple back in competitive range with what Google Assistant and ChatGPT deliver on mobile. That matters.
But the delivery comes bundled with three facts Apple can’t keynote away. It took two years and a billion dollars in annual licensing fees to get here. The EU — 450 million potential users — will not see it on iPhone anytime soon, and the regulatory standoff has no resolution timeline. And the CEO who built Apple’s comeback story is leaving before anyone knows if this particular chapter has a happy ending.
Tim Cook’s final line at WWDC 2026 was that “the best is still ahead at Apple.” That may well be true. John Ternus inherits a company with extraordinary hardware capability, loyal customers, and — now — a credible AI foundation for the first time. What he does with the EU standoff, the Google dependency, and the antitrust scrutiny both companies face will determine whether iOS 27 is remembered as Apple’s AI turning point or its most expensive near-miss.
The developer beta is live. The public will be able to judge for themselves in September. For now, Siri AI is Apple’s biggest bet — and Europe is watching from the outside.
Stay Ahead of the AI Curve
NeuralWired covers the technology decisions that actually shape the industry — not the press releases. Subscribe for analysis, not noise.
Get the Weekly Brief
AI Product Liability 2026: Who Pays When AI Kills or Harms?AI Law & Liability
Who Pays When AI Kills? Four Countries, Zero Answers
NeuralWired.comJune 24, 2026Deep Analysis14 min read
On February 28, 2024, a 14-year-old boy in Florida named Sewell Setzer III died by suicide. In the months before his death, he had spent thousands of hours talking to AI chatbots on Character.AI, including a role-playing character inspired by the Game of Thrones series. His mother, Megan Garcia, sued. In May 2025, a federal judge ruled the case could proceed, treating the AI chatbot as a product under strict liability law and rejecting the company’s First Amendment defense. Character.AI and Google settled in January 2026.
That single case broke open a legal question that four of the world’s largest economies are now scrambling to answer: when an AI system causes serious harm, who is responsible? The developer who built the model? The company that deployed it? The platform that distributed it? The investor who funded it?
Right now, the answer depends entirely on which country the harm happened in. And the answers are incompatible.
The Case That Changed Everything
Garcia v. Character Technologies, Inc. (Case No. 6:2024-cv-01903, M.D. Florida) is the first wrongful death lawsuit ever filed against an AI chatbot company in the United States. The claims included strict product liability for design defect, failure to warn, negligence, and wrongful death. Defendants included not just Character Technologies but also co-founders Noam Shazeer and Daniel De Freitas Adiwarsana, plus Google and Alphabet.
Judge Anne Conway’s ruling on May 21, 2025 mattered far beyond this single case. She was “not prepared to hold that Character AI’s output is speech”, which neutralized the most powerful defense available to AI companies: the argument that their outputs are constitutionally protected expression under the First Amendment. She treated the AI app as a product at the pleading stage. That framing, product not speech, is now rippling through every AI harm case filed since.
The settlement came January 7, 2026, with undisclosed terms and a commitment to new safety features for users under 18. It resolved the immediate litigation. It also prevented the appellate ruling that would have given every court in America binding guidance on the First Amendment question. That question remains open. And every plaintiff’s attorney in the country noticed.
The cases that followed came fast. In August 2025, the parents of 16-year-old Adam Raine sued OpenAI in California Superior Court, alleging ChatGPT fostered emotional dependency and provided self-harm instructions. Later that year, the estate of an elderly Connecticut woman filed a wrongful death action alleging that an AI chatbot’s interactions with her son materially contributed to a homicide-suicide. In March 2026, insurer Nippon Life sued OpenAI in federal court in Illinois to recover costs from AI-assisted legal filings that cited nonexistent cases.
The number of generative AI-related lawsuits in the US grew 978% between 2021 and 2025, passing 700 cumulative cases, according to a March 2026 report by Gallagher Re in conjunction with MIT and Testudo Global Inc. The year-over-year filing rate accelerated from 59% growth in 2023-2024 to 137% growth in 2024-2025. AI product liability litigation is no longer a hypothetical risk. It is a present operational one.
Four Jurisdictions, One Question
This is not a story about a single court case crossing borders. It is a story about four major legal systems each building their own answer to the same question, and those answers pointing in entirely different directions.
Jurisdiction
Current Status
Key Mechanism
Timeline
United States
Case law developing; no federal AI liability statute
Product liability via tort; First Amendment question unresolved
AI LEAD Act and CHATBOT Act proposed; 1,000+ state bills filed in 2025
European Union
EU Product Liability Directive in force Dec 2024
Strict liability; AI = product; manufacturer presumption
Member state transposition deadline: December 9, 2026
United Kingdom
Consultation closed Feb 2026; Law Commission review announced
Existing tort law; no AI-specific statute yet
Public consultation on “pure software” planned for H2 2026
Canada
Landmark ruling Feb 2024 (Air Canada)
Negligent misrepresentation; corporate liability for chatbot output
No federal AI liability legislation enacted as of June 2026
Canada: The Air Canada Precedent
The most legally clean ruling in the entire AI liability landscape came not from a US federal court but from the British Columbia Civil Resolution Tribunal in February 2024. Jake Moffatt relied on Air Canada’s chatbot for information about bereavement fares while booking a flight to attend his grandmother’s funeral. The chatbot gave him incorrect information. Air Canada later refused to honor the discount, arguing its chatbot was effectively a “separate legal entity” for which the company bore no responsibility.
Tribunal Member Christopher C. Rivers dismissed that argument directly. Air Canada is responsible for all information on its website, the ruling stated, whether it comes from a static page or an AI chatbot. Customers cannot be expected to distinguish between human-provided and AI-provided information. Damages awarded: CAN$812.02. Precedent established: priceless.
This is the foundational principle now being applied in every jurisdiction: AI has no legal personality. The company does. The company owns the output.
The EU: The December Deadline That Rewrites Everything
The EU moved fastest and furthest. The EU Product Liability Directive (Directive 2024/2853) came into force on December 8, 2024. It explicitly includes software, including AI systems, within the definition of “product” subject to strict liability. AI providers typically qualify as “manufacturers.” Cloud-based AI, on-device AI, and SaaS products are all covered. Member states must transpose this into national law by December 9, 2026, which is six months from today.
The directive contains a mechanism that should alarm every legal team deploying AI in Europe: a rebuttable presumption of defectiveness. If a defendant fails to meet its disclosure obligations, courts can presume the AI caused the harm. Companies cannot contractually exclude this liability. Non-compliance with the EU AI Act constitutes a product defect. The two frameworks are linked: fail the AI Act audit, and you have just handed plaintiffs a liability hook.
The Product Liability Turn
Understanding why product liability matters here requires understanding what it was built to do. Product liability law evolved to handle mass-distributed manufactured goods where individual causation is hard to prove but the defect is systemic. It assigns liability across a chain: designer, manufacturer, distributor, retailer. It does not require proving that a specific person was negligent. It asks whether the product was defective and whether that defect caused the harm.
Plaintiffs’ attorneys discovered this framing fits AI systems better than any other available doctrine. As attorneys Amy Wong and Jin J. To of K&L Gates wrote in March 2026: “Early AI cases that began through adjacent doctrines, consumer protection, privacy, defamation, and IP, are now consolidating around product liability.” The reason is structural. Product liability “is built to evaluate mass-distributed technologies through the lenses of defect, warnings, and foreseeability, with liability that can extend across a chain of entities.”
The key tactical insight driving this consolidation: plaintiffs are not suing the model. They are suing the deployed product experience, the interface, the defaults, the absence of guardrails, and the marketing claims. This sidesteps the First Amendment entirely. You are not claiming the AI’s speech is unlawful. You are claiming the product was defectively designed to reach and manipulate vulnerable users without adequate warnings.
Key Shift for Legal Teams
Product liability reaches upstream to model developers AND downstream to enterprise deployers. If you are using a third-party AI model and it causes harm to your customer, your vendor’s terms of service are not a liability shield. Courts are testing theories that extend liability across the entire supply chain.
The First Amendment Wildcard
There is one argument that could unravel the entire product liability wave. If a higher court rules that chatbot outputs are constitutionally protected speech, most of these tort claims fail. Plaintiffs would need to satisfy the demanding Supreme Court test for unlawful incitement to violence. That is a very high bar.
Judge Conway’s ruling in Garcia was explicit that she was “not prepared” to treat AI output as speech, but that was a motion-to-dismiss ruling, the lowest legal threshold. The Foundation for Individual Rights and Expression filed an amicus brief in Garcia pressing exactly this question. The settlement prevented the appellate ruling that would have resolved it. Per analysis from the American Enterprise Institute, without binding higher-court precedent, every new AI harm case is re-litigating the same threshold questions from scratch, creating expensive and inconsistent outcomes for everyone.
The Insurance Gap Is Now Contractual
The AI liability gap was theoretical until January 2026. Then it became contractual.
In January 2026, the Insurance Services Office introduced new endorsement forms giving commercial general liability carriers the option to formally exclude generative AI exposures from standard policies. Before that, the coverage was “silent”: ambiguous enough that a company might or might not be covered depending on how their specific incident was characterized. After January 2026, insurers can simply write “GenAI excluded” into the contract. Many are doing exactly that.
“AI is changing the risk landscape faster than traditional frameworks can adapt, and the organizations that invest early in transparent governance, scenario analysis and insurance alignment will be best positioned to adopt AI safely and to turn risk into a source of long-term advantage.”
Brent Rieth, Head of Global Cyber Solutions, Aon
The data behind this transition is stark. Of companies that experienced AI-related losses and made claims in 2026, just over half were covered in full. 44% were only partially covered. 3% were entirely uninsured. That is according to Gallagher’s 2026 AI Adoption research. Nearly half of all companies that suffered an AI-related loss and tried to claim on their insurance did not get the full amount they expected.
AI incidents themselves are growing at roughly 50% year-over-year, according to WTW’s Willis Research Network. 2025 exceeded 2024’s total before the year had ended. The volume of incidents is increasing faster than insurance capacity is being created to cover them.
There is a structural concern beyond just pricing. Josephine Wolff, Professor of Cybersecurity Policy at Tufts University’s Fletcher School and a specialist in insurance and cybersecurity policy, identifies a systemic risk that goes beyond individual corporate exposure:
“It is not yet clear whether insurers will embrace having a role in managing AI risks and, if so, which risks they will be willing to cover and which they may view as fundamentally too large or unpredictable to insure.”
Josephine Wolff, Associate Dean for Research, The Fletcher School, Tufts University (May 2026)
The concern she is raising is real. AI risk has a concentration problem that traditional catastrophe insurance does not. Geographic catastrophes like hurricanes and earthquakes affect specific regions. An AI defect in a widely adopted foundation model can trigger simultaneous harm and claims across thousands of organizations globally. There is no geographic limit. The risk is potentially uninsurable by conventional actuarial methods.
The insurance industry went through this same inflection point with cyber risk in the mid-2010s. Silent cyber gave way to explicit exclusions, which drove the creation of dedicated cyber insurance lines, which matured into a multi-billion dollar market. AI liability is at that same silent-to-explicit inflection point right now. The companies that acted during the silent cyber phase and built dedicated coverage while premiums were low were in a fundamentally better position than those who discovered the exclusion at renewal time. The window for that kind of strategic preparation is closing.
Boards Are in the Crosshairs
A survey published in 2026 by Diligent Institute and Corporate Board Member found that only 8% of boards rate themselves as having strong AI expertise. Yet 40% of directors named technological developments including AI as the single most challenging issue to oversee. 66% of directors already use AI for their own board work, and only 22% have governance processes governing their own usage of it.
This mismatch between exposure and expertise is not just embarrassing. Under Delaware’s Caremark doctrine, it is a legal liability.
Caremark derivative suits allow shareholders to sue board members personally for failing to adequately oversee risks that then caused the company financial harm. Cleary Gottlieb’s January 2026 board guidance publication identifies AI governance failures as a specific Caremark exposure. If a company suffers a major AI-related loss and the board had no designated AI risk owner, no regular reporting cadence on AI deployments, and no policy framework for third-party AI tools, those facts become evidence of a breach of the fiduciary duty of oversight.
88% of businesses now use AI in at least one function, according to Cleary Gottlieb’s analysis. The board fiduciary duty has not been narrowly construed for decades. It will not be narrowly construed here either.
“In 2026, we anticipate that the pace of AI regulation will remain unpredictable and increasingly stringent.”
Nithya Das, General Manager, Governance at Diligent
There is also a gap between the perceived threat and the actual one. A Sentry Insurance survey cited in the March 2026 Gallagher Re report found that 69% of US executives believe a single AI-related verdict could shut their company down. Yet only 17% list AI lawsuits as a top business threat in their current risk registers. They fear the outcome. They are not managing the cause. That is the definition of a governance failure.
What Companies Must Do Now
The EU’s December 9, 2026 transposition deadline is the most concrete forcing function available. Any AI-powered product placed on the EU market after that date is subject to strict product liability across 27 member states. That deadline is six months away. Here is what legal, compliance, and board teams should already be doing.
Audit every AI deployment against the EU PLD’s “product” definition if you operate in Europe or sell to European customers. Cloud-based AI qualifies. If you are unsure, assume it does and work backwards from there.
Map your AI supply chain and find the indemnification gaps. The enterprise deploying a third-party model bears liability for that model’s outputs under current US and EU frameworks. Your vendor contract’s limitation-of-liability clause was written before this legal landscape existed. Review it with this exposure in mind.
Commission an explicit AI coverage review of every relevant policy: CGL, D&O, E&O, professional indemnity. Ask specifically whether GenAI is excluded under current or upcoming renewal terms. Do not wait for a claim to find out.
Put AI explicitly on the board risk register with a named executive accountable for AI risk governance. This is not just best practice. It is Caremark protection. Document that the board is receiving regular reporting on AI deployments, known risks, and mitigation actions.
Document every testing, safety, and deployment decision for every AI system in production. This documentation becomes the evidentiary backbone of any legal defense. Courts and regulators will ask for it. Having it does not guarantee a win, but not having it is effectively a concession.
EU Deadline Alert
The EU Product Liability Directive requires member state transposition by December 9, 2026. After that date, AI providers are treated as manufacturers under strict liability law across 27 countries. Non-compliance with the EU AI Act constitutes a product defect. This is not future risk. This is a compliance date six months from today.
The Arguments Against the Wave
The liability wave has real legal and structural critics. Their arguments deserve attention from anyone building strategy around this issue.
Existing Law May Already Be Enough
The UK Jurisdiction Taskforce’s draft Legal Statement takes an explicitly optimistic view: English law, including existing tort doctrine and contract principles, can in principle address AI harms without new legislation. The contrarian case is that AI-specific liability regimes generate compliance overhead without improving victim outcomes, while suppressing beneficial AI deployment. Kevin Frazier, a policy researcher at AI Frontiers, argued in June 2025 that “in the absence of federal legislation, the burden of managing AI risks has fallen to judges and state legislators, actors lacking the tools needed to ensure consistency, enforceability, or fairness.”
He has a point about fragmentation. Over 1,000 AI bills were introduced at the federal and state level in the 2025 legislative session. AI products are not built on a bespoke basis for niche geographic markets. A patchwork of dozens of state laws creates compliance chaos without solving the underlying problem.
The First Amendment Could Reverse Everything
The American Enterprise Institute has argued directly that the entire AI liability wave is built on a legally fragile foundation. The Garcia ruling was at the motion-to-dismiss stage, the lowest legal threshold. If an appellate court holds that AI outputs are constitutionally protected speech, most tort claims evaporate. The Garcia settlement prevented exactly the appellate ruling that would have resolved this. Until a binding higher-court decision exists, plaintiffs and defendants will keep relitigating the same threshold questions.
The EU’s Two-Framework Problem
Academic analysis by legal scholar Philipp Hacker identifies a coherence problem in the EU’s dual-track approach: the AI Act handles ex-ante compliance, the PLD handles ex-post liability. The PLD does not define safety standards; it links liability to AI Act compliance. But AI Act compliance does not address individual rights of compensation. Victims can fall between the two frameworks. Hacker’s recommendation is a single, fully harmonizing regulation rather than two miscoordinated directives.
One More Thing to Scrutinize
The 978% lawsuit growth figure is striking, but it conflates copyright infringement cases (the largest category at 11.9%) with personal injury and harm cases, which are legally and factually very different. Boards receiving messaging about exploding AI litigation should ask specifically which type of litigation is relevant to their actual deployment profile before recalibrating risk budgets.
FAQ: AI Liability Law 2026
Who is liable when AI causes harm?
Under current law in the US, UK, EU, and Canada, AI systems have no legal personality and cannot themselves be held liable. Liability flows to the humans and organizations that developed, deployed, or used the AI. Courts are consistently treating AI as a tool, meaning the deploying organization owns both the benefits and the legal exposure from its outputs, even when those outputs are generated by a third-party model it did not build.
Can an AI company be sued for wrongful death?
Yes. The 2024 filing of Garcia v. Character Technologies established that wrongful death claims against AI chatbot companies can proceed in US federal court. Judge Anne Conway denied Character.AI’s motion to dismiss in May 2025, treating the chatbot as a product and rejecting First Amendment defenses. Character.AI and Google settled in January 2026. Additional wrongful death suits against OpenAI are currently pending in California.
What is the EU AI Product Liability Directive?
The EU Product Liability Directive (Directive 2024/2853) came into force in December 2024 and explicitly includes software and AI systems in the definition of “product” subject to strict liability. EU member states must transpose it into national law by December 9, 2026. After that date, AI providers qualify as manufacturers and cannot contractually exclude liability for defects, including AI Act non-compliance.
Is a company responsible for what its AI chatbot says?
Yes, according to current rulings in both the US and Canada. In Moffatt v. Air Canada (2024), British Columbia’s Civil Resolution Tribunal ruled that Air Canada could not disclaim responsibility for its chatbot’s misinformation by calling it a “separate legal entity.” Companies are responsible for all information on their platforms, whether it comes from a human employee or an automated system.
What is the AI liability gap?
The AI liability gap refers to the mismatch between where AI harm is occurring and where legal and insurance frameworks have clear rules. In January 2026, the Insurance Services Office introduced endorsements allowing carriers to formally exclude generative AI from standard commercial general liability policies, converting the theoretical gap into a contractual one. Companies that assumed coverage exists may find at renewal that it no longer does.
Do boards of directors face personal liability for AI decisions?
Potentially yes, under Caremark doctrine in Delaware. Boards of companies that suffer financial losses from AI failures may face shareholder derivative suits alleging directors breached their fiduciary duty of oversight. Cleary Gottlieb identified this as a specific board-level exposure in January 2026, noting that 88% of businesses use AI in at least one function while board AI expertise remains critically low across the S&P 500.
Can AI chatbot output be protected by the First Amendment?
This is the most consequential unresolved question in AI liability law. Defendants in US cases have argued chatbot outputs are protected speech, which would shield them from most tort claims. Judge Conway in Garcia ruled she was “not prepared” to treat AI output as speech at the pleading stage. That was not a binding appellate decision. The Garcia settlement prevented the ruling that would have resolved this, leaving it open for every subsequent case.
Where This Goes in the Next 18 Months
The next 18 months will not produce clarity. They will produce more cases, more settlements that prevent clarity, and one hard regulatory deadline that will force companies to treat AI liability as a compliance issue whether courts have resolved the doctrine or not.
The EU’s December 9, 2026 transposition deadline is the single most consequential near-term forcing function in global AI liability law. For the first time, a major jurisdiction with global market reach has legislated that software is a product under strict liability, and that manufacturer status attaches to AI providers. Companies that operate in Europe and have not yet aligned their vendor contracts, insurance coverage, technical documentation, and board governance against this framework have roughly 166 days to do so.
Watch three things. First, whether any US appellate court issues a binding ruling on the First Amendment question currently evaded by the Garcia settlement. Second, whether the AI LEAD Act or CHATBOT Act advances past the Senate Judiciary Committee, given the bipartisan coalition behind both. Third, whether the EU AI Act’s Digital Omnibus receives formal European Parliament adoption by July 7, 2026 as expected, which would solidify the link between AI Act compliance and product liability exposure across the single market.
The companies that treat this as a compliance checkbox will be the defendants in the cases NeuralWired covers next year. The ones that treat it as a strategic design constraint now will build the documentation, governance, and insurance infrastructure that actually holds up in court.
Our Read
The insurance industry’s move from silent coverage to formal exclusion is the clearest leading indicator available. Insurers do not price risk ahead of its time. When they start excluding AI formally in January 2026, they are signaling that the actuarial models are breaking down. That is worth more attention than any single court ruling.
Stay ahead of AI law, governance, and enterprise risk. Subscribe to The Neural Loop, NeuralWired’s weekly briefing for technology decision-makers, at neuralwired.com/newsletter.
By NeuralWired Staff · June 20, 2026 · 12 min read
In April 2026, Uber’s engineering organization ran out of its entire annual AI coding budget two-thirds of the way through the year. Two months later, Microsoft pulled back most internal developer access to Claude Code over the same problem: cost. Neither company is careless with money. Both got caught by the same math now hitting finance teams across the industry: token prices are falling, but the bill keeps climbing.
If part of your job in 2026 is figuring out how to reduce LLM inference cost across an enterprise deployment, “wait for prices to drop further” stopped being a strategy the moment it failed at Uber and Microsoft. What works instead is an actual cost architecture, built from seven specific moves. Some you can ship this week. Some take a quarter to stand up properly.
Quick answer: Per-token LLM prices have fallen as much as 280-fold since 2022, yet enterprise AI bills keep rising. The reason is agentic workflows, which burn 5 to 30 times more tokens per task than a simple chatbot query, according to Gartner, with adoption accelerating faster than unit prices fall. Cutting your real bill takes architecture, not patience: prompt caching, smart model routing, inference-stack tuning, agentic spend controls, sound self-host-versus-API math, FinOps-grade attribution, and pre-deployment cost modeling.
Why Falling Token Prices Won’t Reduce Your LLM Inference Cost
Here’s the number every “AI is getting cheaper” headline traces back to. Gartner forecasts that by 2030, running inference on a one-trillion-parameter model will cost providers more than 90% less than it did in 2025, with LLMs overall becoming up to 100 times more cost-efficient than the earliest 2022-era models of similar size, per Gartner’s March 2026 forecast. Stanford’s AI Index already clocked a 280-fold drop in GPT-3.5-equivalent inference pricing between late 2022 and late 2024.
None of that is showing up as savings on enterprise invoices. Gartner says so explicitly, and so does the analyst who built the forecast.
“Chief Product Officers (CPOs) should not confuse the deflation of commodity tokens with the democratization of frontier reasoning.”
Will Sommer, Senior Director Analyst, Gartner, via Gartner
Translation: cheap tokens fund better models, not smaller bills. Demand, meanwhile, is exploding underneath the price drop. Agentic models require 5 to 30 times more tokens per task than a standard chatbot exchange, per Gartner, and Goldman Sachs projects global token consumption will climb roughly 24-fold by 2030, reaching something like 120 quadrillion tokens a month. That’s Jevons Paradox playing out in real time: a 160-year-old economic principle stating that efficiency gains tend to increase total consumption rather than reduce it. Cheaper tokens have historically unlocked more AI usage, not lower total spend.
This has also stopped being a quiet, internal cost-center problem. An AI consultant told Axios that one unnamed enterprise reportedly burned through roughly $500 million in Claude API spend in a single month after failing to set employee usage limits (treat that figure as reported, not officially confirmed; no company has put its name on it). What is confirmed: the Linux Foundation announced a new standards body, the Tokenomics Foundation, in the first week of June 2026, modeled directly on how the FinOps Foundation standardized cloud-cost discipline a decade earlier. When an industry spins up a dedicated standards body to police a cost problem, that problem has stopped being optional to manage.
The 7-Step Framework to Reduce LLM Inference Cost at Enterprise Scale
Treat the list below as a stack, not a checklist. The first two steps are mechanical and fast, most teams see results within days. The last three are organizational and slower, taking a quarter to stand up properly, but they’re what stops the bill from doubling again next year.
Step
What it fixes
Time to first results
1. Prompt caching
Repeated context reprocessed on every single call
Days
2. Model routing & cascading
Frontier pricing applied to tasks a small model could handle
1–2 weeks
3. Inference-stack tuning
Batching and decoding choices mismatched to traffic
2–4 weeks
4. Agentic token-sprawl control
Ungoverned agents multiplying spend with no budget ceiling
2–4 weeks
5. Self-host vs. API math
Hidden personnel costs erasing on-paper savings
4–6 weeks
6. FinOps-grade attribution
No one can say which team or agent is spending what
1–2 quarters
7. Pre-deployment cost modeling
Cost surprises discovered after a feature ships
Ongoing
Step 1: Turn On Prompt Caching First
If you do exactly one thing this week, do this one. Prompt caching stores the computed representation of a prompt’s repeated prefix, things like system instructions, tool definitions, and reference documents, so later calls skip reprocessing it from scratch. Anthropic made it generally available on December 17, 2024, pricing cached input tokens at roughly 10% of standard input cost, with cache writes running 1.25 to 2 times standard pricing depending on how long the cache is held.
Anthropic’s own figures claim up to 90% cost reduction and 85% latency reduction on long prompts. Vendor claims are easy to discount, except this one has independent backing: a 2026 academic evaluation titled “Don’t Break the Cache” ran the first comprehensive third-party test across three major LLM providers on long-horizon agentic tasks and found real-world savings of 41 to 80%. That’s the single most defensible number in this whole article: a vendor claim and an independent study landing in the same range.
“We’re excited to use prompt caching to make Notion AI faster and cheaper, all while maintaining state-of-the-art quality.”
Simon Last, Co-founder, Notion, via Anthropic
Implementation here is an engineering task, not a procurement project. Most teams can audit their cache hit-rate and restructure prompts (static content first, variable content last) inside a single sprint.
Step 2: Route and Cascade, Don’t Just Pay Frontier Prices for Everything
Routing sends each request to the cheapest model that can actually handle it. Cascading starts cheap and escalates only when a quality check fails. Stanford’s FrugalGPT, the paper that founded this whole technique, showed up to 98% cost reduction while matching the best individual model’s performance. UC Berkeley’s RouteLLM project later trained a classifier that hit 95% of GPT-4-level quality at 85% lower cost on MT-Bench, and comparable quality at 45% lower cost on MMLU.
Treat those percentages as proof the technique works, not as a number to promise finance. Both figures are tied to one specific model pairing on two specific benchmarks. Your prompts and your traffic will produce a different result, so run the eval on your own workload before it goes into a budget deck.
We already broke down the small-versus-frontier pricing tables, the self-hosting break-even math, and named enterprise case studies in our companion piece, GPT-5 vs Small Language Models: 2026 Enterprise Cost. If routing is the step you want to go deep on, that’s where the depth lives. Here, the point is narrower: routing is one piece of a seven-piece architecture, not the whole fix.
Step 3: Tune the Inference Stack to Your Actual Traffic
This is where “obvious” optimizations get dangerous. Speculative decoding is marketed as a clean win: predict several tokens ahead, verify them in parallel, cut latency and cost together. At small batch sizes (16 or fewer concurrent requests), independent energy-efficiency research found it cuts cost by up to roughly 29%. At large batch sizes (128 concurrent requests), the same technique increased total energy cost by roughly 25.65%.
Same technique, opposite result, depending entirely on traffic pattern. Batching, hardware allocation, and decoding strategy aren’t settings to copy from a blog post. They’re decisions that need your own load data behind them, and most teams haven’t measured their traffic closely enough to know which side of that line they’re actually on.
Step 4: Put a Leash on Agentic Token Sprawl
This is the fastest-growing line item, and the one with the least governance attached to it. EY’s analysis found the cost of a single agentic customer-service interaction rose from roughly $0.04 in 2023 to $1.20 in 2026, a roughly 30-fold increase, driven by orchestrated multi-tool agent workflows replacing simple linear chatbot exchanges.
The fix is governance, not a model swap: per-agent token budgets, hard ceilings on tool-call chains, and visibility into which agent, team, or feature is generating which slice of the bill. We covered the broader shadow-AI version of this problem, agents spun up without IT’s knowledge, quietly multiplying spend nobody’s tracking, in AI Agent Sprawl: The Shadow AI Crisis Hitting Enterprise. If ungoverned agent proliferation is your specific problem, start there.
Step 5: Get the Self-Host vs. API Math Right
Self-hosting looks cheaper on a per-token spreadsheet, and often isn’t, once the team required to run it gets added in. Maintaining a fine-tuned or self-hosted model typically costs $180,000 to $300,000 a year per ML engineer, and round-the-clock coverage adds another $800,000 to $1.2 million annually. Run that math forward and the break-even point lands around 500,000 tokens per day of sustained load. Below that, API-based smaller models beat self-hosting on total cost. Above it, self-hosting can pay off, assuming the team is already in place rather than hired specifically for this.
(If you’re staffing up purely to bring a model in-house, you’ve likely already lost the math before writing a line of code.)
Step 6: Build FinOps-Grade Cost Attribution
The share of FinOps teams managing AI spend rose from 31% to a projected 98% in two years, according to a survey of 1,192 practitioners representing more than $83 billion in annual cloud spend. That’s not a niche trend. That’s an entire discipline getting rebuilt around one new line item.
“In April and May, I started hearing from companies: ‘Oh my god, we are 3x over our entire 2026 token budget and it’s only April.’ We started hearing existential crises, and the whole conversation shifted from tokenmaxxing and ‘go fast’ to ‘we need guardrails, how do we control this?’”
J.R. Storment, Executive Director, FinOps Foundation, via TechCrunch
The Tokenomics Foundation, announced by the Linux Foundation in the first week of June 2026 and set to formally launch in July, exists to standardize exactly this: canonical metrics like cost-per-intelligence and tokens-per-watt, the same way the FinOps Foundation standardized cloud-cost discipline a decade ago.
“AI is forcing FinOps to answer a harder question. It’s not ‘what did we spend?’, it’s ‘what did we actually get out of that spend?’ The hardest part of AI isn’t building it, it’s proving it was worth it.”
Rajeev Laungani, Head of Product, Virtasant, via Virtasant
Practically, this means cost attribution by team, feature, and agent, not just one line on a monthly invoice. Build it before finance asks for it. At this point, they will.
Step 7: Model Cost Before You Ship, Not After
Engineering platform Jellyfish analyzed production usage data across its customer base and found the developers consuming the most AI tokens were roughly twice as productive, but used ten times the tokens to get there. Per-developer token consumption rose roughly 18.6-fold in nine months.
Is that a good trade? Nobody actually knows yet, and that’s the real problem with treating cost optimization as a purely engineering exercise.
“Whether extreme spend pays off comes down to the ultimate business value of shipped code (e.g. revenue), which most companies still can’t measure.”
Nicholas Arcolano, Head of Research, Jellyfish, via TechCrunch
The shift this forces: a cost model needs to exist before a feature ships, not get reconstructed from an invoice afterward. Our deeper reporting on why so many AI deployments never get to prove that value lives in Enterprise AI Failure Rate 2026: MIT Says 95% Miss ROI.
Where This Framework Breaks Down
Every one of the seven steps above is real and verifiable. None of them reverses the underlying economics, and an honest article says so.
Jevons Paradox is the structural problem. Efficiency gains increase total consumption rather than reducing it, and that’s exactly what’s happening with token pricing. Optimization slows the rate at which your bill grows. It does not reliably make the bill go down once agentic adoption is already underway across your organization.
Gartner’s own analyst makes the sharpest version of this argument, and it’s worth taking seriously precisely because it comes from the firm that published the optimistic 90%-by-2030 number in the first place. Token deflation, in his framing, helps providers fix their own margins long before any of it reaches the enterprise customer.
“The customer isn’t going to see all of this money.”
Will Sommer, Senior Director Analyst, Gartner, via CIO Dive
Measurement itself is still broken, too, which undercuts any specific savings percentage offered without an attribution system already in place.
“Even getting clarity on relatively basic metrics, like the number of tokens being used, works differently in different areas. It’s very fragmented across providers and even across services within a single provider.”
Jon Thompson, CTO, Virtasant, via Virtasant
Our read: this framework will slow your bill’s growth rate. It will not reliably shrink the bill itself, not while agentic adoption is still in its land-grab phase across the industry. The honest claim is “stop runaway growth and start measuring,” not “halve your invoice by next quarter.” Anyone promising the second one is selling something.