Category: Artificial Intelligence

In-depth artificial intelligence analysis: AI agents, LLMs, enterprise deployment, governance, and breakthroughs. Research-backed insights for CTOs, founders, and decision-makers.

  • Gartner Data Observability 2026: 53% Adoption Report

    Gartner Data Observability 2026: 53% Adoption Report

    Data Observability in 2026: Why 53% of Data Leaders Already Use It
    Data & AI Infrastructure

    Data Observability Hit 53% Adoption. Most Teams Still Find Out From a Customer.

  • OpenAI ChatGPT Canada Privacy Ruling: What It Means

    OpenAI ChatGPT Canada Privacy Ruling: What It Means

    Canada Just Ruled ChatGPT’s Training Broke Privacy Law
    Regulation & Compliance

    Canada Just Ruled ChatGPT’s Training Broke Privacy Law

  • OpenAI’s Jalapeño Chip: Sam Altman’s $34B Gamble

    OpenAI’s Jalapeño Chip: Sam Altman’s $34B Gamble

    AI · June 29, 2026 · NeuralWired Research Desk · 9 min read

    OpenAI’s Jalapeño Chip: Inside Sam Altman’s $34B Survival Bet

    OpenAI just became a chipmaker, and the math explains why. On June 24, 2026, Sam Altman’s company unveiled Jalapeño, its first custom AI inference chip, built with Broadcom (NASDAQ: AVGO) and manufactured on TSMC’s 3 nanometer process. The timing is not a coincidence. OpenAI spent $34 billion in 2025 to generate just $13.07 billion in revenue, a $20.92 billion operating loss that landed in audited financials leaked and verified by the Financial Times just weeks before this launch. Jalapeño is the company’s answer to a question investors keep asking ahead of its IPO: can OpenAI ever stop bleeding money on every single ChatGPT reply?

    This isn’t a side project. It’s a hardware bet that touches Sam Altman, Greg Brockman, Broadcom CEO Hock Tan, and a Nvidia relationship that suddenly looks a lot more complicated.

    What is the OpenAI Jalapeño chip? Jalapeño is OpenAI’s first custom AI inference chip, unveiled June 24, 2026 and co-developed with Broadcom. It is purpose-built to run large language models like ChatGPT and Codex more cheaply than renting Nvidia GPUs, and is not designed for training AI models.

    Why OpenAI Suddenly Needed Its Own Chip

    Every time someone sends a ChatGPT message, a server somewhere runs an “inference” pass, a single pass of a massive model generating a response token by token. Training a model happens occasionally. Inference happens constantly, hundreds of millions of times a day, and at OpenAI’s scale that workload has become the company’s single largest operating expense.

    The audited 2025 numbers, reported by MLQ News, show just how steep that cost has become. OpenAI’s revenue jumped 253% year over year to $13.07 billion, which sounds like a win until you see the other side of the ledger: $34 billion in total costs, $19.18 billion of that in R&D alone, and $17.2 billion paid to Microsoft for compute and research support in a single year.

    “The hardware press covered it as a shot across Nvidia’s bow. That framing misses the actual story. The real story is about unit economics so broken they were threatening OpenAI’s survival.”
    — Noah Bean, Independent Technical Analyst, via Medium
    Renting general-purpose Nvidia GPUs for a workload that is memory-bound, sequential, and repetitive is, in plain terms, an expensive way to do a narrow job. That gap between what GPUs were built for and what LLM inference actually needs is the entire reason Jalapeño exists.

    What Jalapeño Actually Is

    Jalapeño is what’s known as an ASIC, an Application-Specific Integrated Circuit. Unlike a Nvidia GPU, which is built to handle a wide range of parallel computing tasks, Jalapeño was designed from a blank slate to do one job: run inference for large language models like GPT-5.3 and Codex as efficiently as physically possible. OpenAI is calling it an “Intelligence Processor.”

    It was manufactured on TSMC’s 3 nanometer process and measures roughly 840mm², which puts it near the absolute physical limit of what current chipmaking equipment can produce in a single die. Broadcom contributed silicon implementation and its Tomahawk networking technology, letting thousands of Jalapeño chips function as one unified system, while manufacturing partner Celestica handles the racks and board integration that get the chips into data centers.

    Richard Ho, OpenAI’s head of hardware, described the design philosophy in the company’s own announcement:

    “Jalapeño was designed from the ground up for LLM inference using detailed insights from our close collaboration with OpenAI researchers. We optimized the architecture around the kernels, memory movement, networking, and serving patterns that matter most for frontier AI models.”
    — Richard Ho, Head of Hardware Program, OpenAI, OpenAI Blog

    A Nine-Month Tape-Out, Built Partly by AI

    What makes this launch genuinely unusual is the speed. Most custom chips take 18 to 36 months from initial design to tape-out, the point where the design is finalized and sent to a fab for manufacturing. Jalapeño did it in nine months. OpenAI says part of that acceleration came from using its own AI models as virtual design assistants during the engineering process.

    Greg Brockman put it simply when describing the result: “The degree to which our models have been able to accelerate it was very surprising to us.”

    Jalapeño vs. Nvidia: Hedge, Not Divorce

    Here’s where the popular framing of this story starts to fall apart. Plenty of headlines this week are treating Jalapeño as OpenAI’s break from Nvidia. The actual relationship is far messier than that, and far more interesting.

    In February 2026, Nvidia made a $30 billion direct investment in OpenAI and the two companies signed a deal to deploy 10 gigawatts of Nvidia’s next-generation Vera Rubin GPU systems. OpenAI is simultaneously a major Nvidia customer, a Nvidia investment target, and now a Nvidia competitor in the inference chip space. That’s not independence. That’s leverage.

    FactorJalapeño (OpenAI/Broadcom)Nvidia GPUs
    Primary useInference onlyTraining and inference
    ArchitecturePurpose-built ASICGeneral-purpose GPU
    Manufacturing processTSMC 3nmTSMC 4nm/3nm class (varies by generation)
    Production statusEngineering samples, 2026Shipping at volume
    Track recordFirst generation, no prior siliconMultiple proven generations
    Ben Barringer, Global Head of Technology Research at Quilter Cheviot, frames the broader industry motive plainly: “Nobody wants to be beholden to Nvidia. They are trying to diversify their chip footprint.”

    But diversifying a footprint and replacing a dependency are two very different things, and the next section explains exactly where Jalapeño’s limits are.

    The Risks Nobody’s Headline Is Mentioning

    Most coverage this week leaned bullish. Here’s what that coverage tends to leave out.

    The performance numbers are not verified

    OpenAI says Jalapeño delivers performance-per-watt “substantially better than current state-of-the-art.” A figure suggesting roughly 50% lower inference cost versus mainstream GPUs has circulated from Hock Tan’s Bloomberg interview, but no TFLOPS number, memory capacity figure, or independently audited benchmark has been published. A full technical report is expected “in the coming months,” meaning the current narrative runs entirely on marketing language.

    This is OpenAI’s first chip, ever

    Google shipped its first TPU in 2016 and is now on its seventh generation. Amazon’s Trainium has multiple production cycles behind it. OpenAI has never shipped silicon before Jalapeño. Matt Bryson, Senior Analyst at Wedbush Securities, has publicly noted that successful chip programs typically need multiple design iterations before production maturity, and first-generation yield or integration problems rarely show up in launch-day demos.

    ASICs can’t pivot

    GPUs are flexible by design. A reticle-sized ASIC tuned for today’s transformer-based LLM inference is not. If the field moves toward state space models, new mixture-of-experts routing, or some other post-transformer architecture, a chip this specialized could become expensive scrap rather quickly. Betting a 10-gigawatt infrastructure program on today’s model architecture carries real exposure.

    The deployment timeline is longer than the headlines suggest

    Prototype deployment is targeted for late 2026, mostly inside Microsoft Azure data centers, with volume production ramping through 2027 into the first half of 2028. The Information previously reported the project slipped from an earlier Q2 2026 target amid demands for higher performance. Translation: most users won’t feel any actual benefit from Jalapeño for at least another year.

    The bottom line: Jalapeño is a margin defense system, not a Nvidia killer. It buys OpenAI leverage and a path toward better unit economics, but the company is still years away from silicon independence, and still deeply tied to Nvidia for training.

    Where the Rest of the Industry Already Is

    OpenAI isn’t pioneering custom silicon. It’s catching up. Google’s TPU has been in production since 2016 and now powers most of Google’s AI products. Amazon’s Trainium runs AWS workloads at scale, and OpenAI itself committed to 2 gigawatts of Trainium capacity in early 2026. Microsoft’s Maia 200 launched in January 2026 and already powers parts of GPT-5.2 inside Azure. Meta has its own MTIA chip running recommendation and Llama workloads.

    The logic driving all of them is the same: once a company is operating at hyperscale, the cost of renting general-purpose GPU compute eventually exceeds the cost of just building the chip yourself. OpenAI is finally crossing that line, several years after everyone else.

    What This Means for OpenAI’s IPO

    OpenAI is privately valued at $852 billion after a March 2026 funding round led by SoftBank and Microsoft, and confidentially filed for an IPO on June 8, 2026. That valuation is hard to square with a $20.92 billion annual operating loss unless investors believe the cost structure is about to change. Jalapeño is the centerpiece of that argument. OpenAI’s own cost-to-revenue ratio improved from $2.37 per dollar of revenue in 2024 to $1.60 per dollar in 2025, and the company has stated it expects to reach profitability by 2029. Inference chip ownership is the lever it’s pulling to get there faster.

    Frequently Asked Questions

    What is OpenAI’s Jalapeño chip?
    Jalapeño is OpenAI’s first custom AI inference chip, co-developed with Broadcom and announced June 24, 2026. Built on TSMC’s 3nm process and completed in nine months, it’s a purpose-built accelerator for running large language models like ChatGPT and Codex, not a general-purpose GPU. Source: OpenAI Blog

    Will OpenAI’s Jalapeño chip replace Nvidia?
    Not anytime soon. Jalapeño only handles inference, not training, which still runs on Nvidia GPUs. It’s a hedge to cut costs and reduce dependency, not a clean break. Nvidia made a $30 billion direct investment in OpenAI in February 2026, keeping the relationship deeply intertwined. Source: CNBC

    When will OpenAI’s Jalapeño chip be deployed?
    Initial prototype deployment is planned for late 2026, mainly inside Microsoft Azure data centers, with volume production ramping through 2027 into the first half of 2028. The full 10-gigawatt rollout with Broadcom targets completion by end of 2029. Source: Broadcom

    How much cheaper is Jalapeño than Nvidia GPUs?
    OpenAI claims substantially better performance-per-watt, and a figure from Broadcom’s CEO suggested roughly 50% lower inference cost. These are self-reported, pre-production numbers with no independent verification yet. A full technical report is expected in the coming months. Source: MACGPU

    Why did OpenAI build its own chip?
    OpenAI’s 2025 financials show a $20.92 billion operating loss on $13.07 billion in revenue, driven largely by Nvidia GPU inference costs. Jalapeño is a structural fix aimed at cutting per-token compute costs and reducing single-vendor dependency ahead of its IPO. Source: MLQ News

    What role does Broadcom play in the Jalapeño chip?
    Broadcom provided silicon implementation expertise and its Tomahawk networking technology, letting thousands of Jalapeño chips operate as one unified system. Partner Celestica handles board and rack integration. OpenAI designed the architecture; Broadcom industrialized it. Source: OpenAI Blog

    The Takeaway

    Jalapeño is less a declaration of war on Nvidia and more an admission of just how unsustainable OpenAI’s compute bill had become. It’s a serious engineering achievement, a nine-month tape-out is genuinely fast, but it’s also a first-generation chip from a company that has never shipped silicon, with real benchmarks still unpublished and full deployment still more than a year away. Whether Jalapeño becomes the thing that finally gets OpenAI to profitability, or just one more expensive bet inside an already expensive year, depends entirely on numbers nobody outside OpenAI and Broadcom has seen yet.

  • Apple Siri AI iOS 27: Google Deal, EU Block & Tim Cook’s Exit

    Apple Siri AI iOS 27: Google Deal, EU Block & Tim Cook’s Exit

    Apple’s Siri AI Is Finally Here — But Europe Can’t Have It
    NeuralWired June 27, 2026 AI Policy
    WWDC 2026 · Apple Intelligence · EU Digital Markets Act

    Apple’s Siri AI Is Finally Here —
    But Europe Can’t Have It

    Two years late, $1 billion in Google licensing fees, and 450 million EU users locked out. This is Tim Cook’s last act — and it’s complicated.

    On June 8, 2026, at Apple Park in Cupertino, Tim Cook walked off stage for the last time as CEO of Apple. He left behind a rebuilt Siri, a $1 billion-a-year deal with Google, and a regulatory standoff that’s locking hundreds of millions of Europeans out of the iPhone feature he spent years promising them.

    The rebuilt assistant — now branded Siri AI — is real. It works. And after two years of missed deadlines, pulled advertising campaigns, and very public embarrassment, Apple finally has an AI story worth telling at WWDC 2026. But the story comes with a catch that reveals more about Apple’s strategic reality than any keynote slide ever could.

    Apple didn’t build the intelligence behind Siri AI. Google did. And the EU says Apple’s excuse for blocking Siri AI from European iPhones is, to quote the European Commission’s own spokesperson, “Apple’s and Apple’s only.”

    This is the most consequential tech story of mid-2026 — not because a new feature launched, but because three simultaneous crises collided on the same stage in the same week: a company admitting it lost the AI race, a regulatory war reaching a breaking point, and a 15-year CEO walking out the door at the exact moment his legacy is most in question.


    The $1 Billion Admission Apple Never Made Out Loud

    On January 12, 2026, Apple and Google issued a joint statement announcing a multi-year partnership in which the next generation of Apple Foundation Models would be built on Google’s Gemini technology and cloud infrastructure. Apple’s official statement said: “After careful evaluation, we determined that Google’s technology provides the most capable foundation for Apple Foundation Models.”

    That sentence is Apple’s most significant strategic concession in a decade.

    The company that built its entire identity on end-to-end control — its own chips, its own OS, its own silicon stack, its own retail — decided it could not build a competitive AI assistant on its own. Not in time. Not at this level. So it called Google.

    ~$1B
    Annual licensing cost to Google for Gemini
    ~$20B
    Google pays Apple yearly for Safari search default
    450M
    EU users blocked from Siri AI on iPhone/iPad
    ~2%
    Apple stock drop on WWDC day
    Bloomberg’s Mark Gurman estimates Apple pays approximately $1 billion per year for the Gemini license — a significant sum, but modest compared to the estimated $20 billion Google pays Apple annually to remain the default Safari search engine. The two companies are now deeply intertwined on two fronts simultaneously, a fact that regulators on both sides of the Atlantic are paying close attention to.

    “Given the fits and starts of Apple’s AI rollout over the last few years, I don’t know that they’ve given us enough reason to believe they can be trusted this time. The proof is going to have to be in the delivery, in the execution.”

    — Ben Newman, Technology Analyst, cited by NPR/AP, June 8, 2026
    Investors share Newman’s skepticism. Apple shares fell close to 2% on WWDC day — a market saying it has heard this movie before. Apple had been here two years earlier, at the iOS 18 launch, promising a new Siri and running Bella Ramsey ads that never matched the reality. The company publicly pulled those ads and admitted it needed more time. Now the time has come. But the market isn’t buying it yet.

    The short answer to the architecture question everyone is searching: Google’s Gemini models power Siri AI’s reasoning and knowledge. Apple’s Private Cloud Compute handles the actual request processing, which means Google’s models run within Apple’s infrastructure. Apple claims — and has promised independent verification — that no user data flows back to Google. No major third-party audit has been published to date.


    What Siri AI in iOS 27 Actually Does

    At WWDC 2026, Apple previewed iOS 27 and its rebuilt Apple Intelligence features including Siri AI — describing it as “profoundly more intelligent, knowledgeable, and capable.” The headline capabilities:

    Siri AI — What’s New in iOS 27
    • Multi-turn conversations: Siri finally remembers what you said earlier in the same conversation, enabling genuine back-and-forth rather than isolated one-shot commands.
    • Cross-app awareness: Siri can read context from your Messages, Calendar, Photos, Notes, and third-party apps — and take action across them without you switching between them manually.
    • Visual Intelligence: Point your camera and ask questions; Siri identifies objects, translates signs, and reads documents in real time.
    • Dedicated conversation app: A new app to review, search, and revisit past Siri conversations.
    • Open AI architecture: Documented developer support for routing Siri queries to alternative AI models — including ChatGPT, Claude, and others — via the App Store.
    • Private Cloud Compute: Server-side processing that Apple claims is verifiable by independent researchers at any time.
    iOS 27 isn’t only about Siri. On the performance side, Apple announced app launch speeds up to 30% faster, Photos loading up to 70% faster, and AirDrop transfers up to 80% faster. The company also announced iOS 27 would be compatible with iPhone 11 and all newer models — calling it “the most widely available iOS release ever.”

    But premium Siri AI features need iPhone 15 Pro or newer. Voice customization needs iPhone 17 Pro or later. The headline compatibility number is real; the flagship experience is still gated to recent hardware. That’s not unusual for Apple, but it matters for the upgrade math that drives Apple’s services and device revenues through fall 2026.

    Thomas Kurian, CEO of Google Cloud, confirmed the partnership’s scope at Google Cloud Next 2026: “We’re collaborating with Apple as their preferred cloud provider to develop the next generation of Apple Foundation Models based on Gemini technology. These models will now power future Apple Intelligence features including a more personalized Siri coming later this year.”

    That’s the partnership, confirmed by the partner. Now for the complication that defines the whole story.


    Why 450 Million Europeans Are Being Left Out

    The same day Apple announced Siri AI, it announced something else: EU users will not get Siri AI on iPhone or iPad when iOS 27 ships. Not a delayed rollout. Not a limited beta. A hard block, with no timeline for resolution.

    Apple’s framing, delivered by Craig Federighi at WWDC: the EU’s Digital Markets Act, as interpreted by regulators, would require Apple to grant third-party AI systems near-unlimited access to the device — reading messages, editing files, deleting photos, executing actions in apps “without you knowing or consenting.” Apple argues this is a privacy and security risk it won’t accept.

    “We’re deeply disappointed that our EU users won’t have Siri AI on iPhone or iPad when we share our new software releases later this year. Our hope is to eventually bring Siri AI to the EU, and we will continue to engage with EU regulators on a path forward. However, their refusal to engage constructively on solutions that preserve privacy and security means we do not currently have a timeline.”

    — Craig Federighi, SVP Software Engineering, Apple WWDC 2026
    The EU rejected this framing immediately. European Commission spokesperson Thomas Regnier responded the next day: “We indeed need to set the record straight. The decision not to roll out Siri AI in the EU is Apple’s and Apple’s only because absolutely nothing in the DMA prohibits Apple from introducing new products in the EU.”

    EU regulators also formally rejected Apple’s appeal for a DMA interoperability exemption, leaving the standoff without a resolution date.

    Critical Perspective
    One detail undercuts Apple’s privacy argument: Mac and Apple Vision Pro users in the EU will receive Siri AI. Apple holds no DMA gatekeeper designation for macOS or visionOS — only for iOS, iPadOS, and the App Store. So the feature works on Mac in Paris but not on iPhone in Paris. The blocking mechanism is regulatory designation, not fundamental privacy architecture. Critics argue Apple is using privacy as cover for a regulatory leverage play, not the other way around.

    How This Standoff Developed

    September 2023
    EU designates Apple as a DMA “gatekeeper” for iOS, App Store, and Safari — triggering mandatory interoperability obligations.

    June 2024
    Apple debuts “Apple Intelligence” at WWDC 2024 (iOS 18) — promising a rebuilt Siri. Features fail to ship on schedule; Apple pulls its own Siri ads.

    April 2025
    EU fines Apple €500 million for DMA non-compliance — the first enforcement action in the law’s history. Stakes are now concrete and financial.

    August 2025
    Bloomberg reports Apple is in talks to license Google’s Gemini models. Apple had a ChatGPT integration in place; this would be a far deeper commitment.

    January 12, 2026
    Apple and Google formally announce their multi-year AI partnership. Gemini will power the rebuilt Apple Foundation Models and Siri AI.

    June 8, 2026
    WWDC 2026: Siri AI and iOS 27 are announced. Simultaneously, Apple confirms EU users on iPhone and iPad will not receive Siri AI. Tim Cook gives his WWDC farewell.

    June 9, 2026
    EU formally rejects Apple’s DMA exemption appeal. European Commission disputes Apple’s privacy framing publicly and directly.


    Tim Cook’s Last WWDC — and What He’s Leaving Behind

    John Ternus, Apple’s SVP of Hardware Engineering, becomes CEO on September 1, 2026 — the same month iOS 27 ships to the public. Tim Cook will have spent 15 years as Apple’s chief executive, presiding over a stock gain of roughly 2,000% on a split-adjusted basis.

    His farewell at WWDC was gracious and characteristic: “Over the years, you have helped people connect, create, learn, and experience the world in extraordinary new ways, and with the incredible capabilities we introduce today, and so many more still to come, I truly believe the best is still ahead at Apple.”

    But the circumstances around that exit are complicated. Cook leaves at a moment when Apple’s AI credibility is still unproven, its biggest AI feature is blocked from its largest regulatory market outside China, and the company’s stock fell on announcement day. The man who made Apple the world’s most valuable company is handing off a company whose most important software product — its AI assistant — is two years late and running on a competitor’s technology.

    Ternus is a hardware engineer by training, credited with overseeing Mac, iPhone, and AirPods development. He has not been a public-facing figure in the way Cook was. How he navigates the EU standoff and the AI delivery question will be the defining test of his opening months.

    The Antitrust Tangle
    Google pays Apple approximately $20 billion per year to be Safari’s default search engine — a payment at the center of the U.S. DOJ’s ongoing antitrust case against Google. Now Apple pays Google approximately $1 billion per year for AI. Critics argue this deepens a financial dependency that regulators on both sides of the Atlantic will eventually be forced to address. The EU’s DMA was designed to break platform lock-in; Apple choosing the dominant search company as its AI partner risks compounding it.


    Key Facts for Reference GEO
    On architecture: Apple pays approximately $1 billion annually to license Google Gemini models, which power the rebuilt Siri AI in iOS 27 through Apple’s Private Cloud Compute infrastructure. Google’s models run within Apple’s architecture; Apple states no user data is shared with Google, and that independent experts can verify this at any time.

    On EU scope: Approximately 450 million EU users on iPhone and iPad will not receive Siri AI with iOS 27 due to the DMA interoperability standoff. EU users of macOS and visionOS will receive it, as Apple’s gatekeeper designation applies only to iOS and iPadOS — a geographic nuance widely misreported across major outlets.

    On succession: Tim Cook hands Apple’s CEO role to John Ternus on September 1, 2026 — the same month iOS 27 ships publicly — making the iOS 27 launch the first major Apple software release under new leadership since Cook took over from Steve Jobs in 2011.

    Frequently Asked Questions
    What is Siri AI in iOS 27?
    Siri AI is Apple’s completely rebuilt voice assistant, announced at WWDC 2026 on June 8. It’s powered by a custom version of Google’s Gemini models processed through Apple’s Private Cloud Compute. Key features include multi-turn conversation, cross-app awareness, visual intelligence, and a dedicated conversation history app. Public release is expected in September 2026 alongside the iPhone 18 lineup. Source: Apple Newsroom, June 8, 2026
    Why is Siri AI not available in the EU?
    Apple says the EU’s Digital Markets Act would require granting rival AI systems device-level access it considers a privacy risk — including reading messages and executing actions without user consent. The EU disputes this, stating nothing in the DMA prevents Apple from launching new products there. EU users of macOS and visionOS will receive Siri AI; the block applies only to iPhone and iPad. Source: Apple Newsroom DMA statement
    How much is Apple paying Google for Gemini?
    Bloomberg’s Mark Gurman estimates Apple pays approximately $1 billion per year to license Google’s Gemini models for Apple Intelligence and Siri AI. This is separate from the approximately $20 billion Google pays Apple annually to remain the default Safari search engine — a payment already under DOJ antitrust scrutiny. Source: CNBC, January 12, 2026
    When does iOS 27 come out?
    iOS 27 entered developer beta on June 8, 2026, the day of WWDC. A public beta is expected in July 2026. The stable public release is projected for around September 14, 2026, alongside the iPhone 18 lineup — consistent with Apple’s historical mid-September pattern. Siri AI features are expected in the same release window. Source: Macworld / Apple WWDC 2026
    Which iPhones support iOS 27 and Siri AI?
    iOS 27 supports iPhone 11 and all newer models — the broadest compatibility Apple has offered. However, advanced Siri AI features require iPhone 15 Pro or newer, and voice customization features need iPhone 17 Pro or later. The headline compatibility is wide; the flagship AI experience remains gated to recent hardware with Apple’s latest Neural Engine. Source: Apple WWDC 2026; Macworld
    Who is replacing Tim Cook at Apple?
    John Ternus, Apple’s SVP of Hardware Engineering, becomes CEO on September 1, 2026. Ternus is a mechanical engineer credited with leading hardware development for Mac, iPhone, and AirPods. He takes over as iOS 27 and Siri AI ship publicly — making his opening weeks as CEO inseparable from Apple’s most consequential AI launch to date. Source: TechCrunch WWDC 2026 coverage

    The Verdict: Promise Delivered, Questions Remain

    Siri AI in iOS 27 is real, and it’s a genuine leap from the assistant Apple shipped in 2024. The multi-turn memory, cross-app awareness, and Gemini-powered reasoning put Apple back in competitive range with what Google Assistant and ChatGPT deliver on mobile. That matters.

    But the delivery comes bundled with three facts Apple can’t keynote away. It took two years and a billion dollars in annual licensing fees to get here. The EU — 450 million potential users — will not see it on iPhone anytime soon, and the regulatory standoff has no resolution timeline. And the CEO who built Apple’s comeback story is leaving before anyone knows if this particular chapter has a happy ending.

    Tim Cook’s final line at WWDC 2026 was that “the best is still ahead at Apple.” That may well be true. John Ternus inherits a company with extraordinary hardware capability, loyal customers, and — now — a credible AI foundation for the first time. What he does with the EU standoff, the Google dependency, and the antitrust scrutiny both companies face will determine whether iOS 27 is remembered as Apple’s AI turning point or its most expensive near-miss.

    The developer beta is live. The public will be able to judge for themselves in September. For now, Siri AI is Apple’s biggest bet — and Europe is watching from the outside.

    Stay Ahead of the AI Curve

    NeuralWired covers the technology decisions that actually shape the industry — not the press releases. Subscribe for analysis, not noise.

    Get the Weekly Brief
  • Character AI Lawsuit: Who Pays When AI Kills? (2026)

    Character AI Lawsuit: Who Pays When AI Kills? (2026)

    AI Product Liability 2026: Who Pays When AI Kills or Harms?
    AI Law & Liability

    Who Pays When AI Kills? Four Countries, Zero Answers

    NeuralWired.com June 24, 2026 Deep Analysis 14 min read
    On February 28, 2024, a 14-year-old boy in Florida named Sewell Setzer III died by suicide. In the months before his death, he had spent thousands of hours talking to AI chatbots on Character.AI, including a role-playing character inspired by the Game of Thrones series. His mother, Megan Garcia, sued. In May 2025, a federal judge ruled the case could proceed, treating the AI chatbot as a product under strict liability law and rejecting the company’s First Amendment defense. Character.AI and Google settled in January 2026.

    That single case broke open a legal question that four of the world’s largest economies are now scrambling to answer: when an AI system causes serious harm, who is responsible? The developer who built the model? The company that deployed it? The platform that distributed it? The investor who funded it?

    Right now, the answer depends entirely on which country the harm happened in. And the answers are incompatible.


    The Case That Changed Everything

    Garcia v. Character Technologies, Inc. (Case No. 6:2024-cv-01903, M.D. Florida) is the first wrongful death lawsuit ever filed against an AI chatbot company in the United States. The claims included strict product liability for design defect, failure to warn, negligence, and wrongful death. Defendants included not just Character Technologies but also co-founders Noam Shazeer and Daniel De Freitas Adiwarsana, plus Google and Alphabet.

    Judge Anne Conway’s ruling on May 21, 2025 mattered far beyond this single case. She was “not prepared to hold that Character AI’s output is speech”, which neutralized the most powerful defense available to AI companies: the argument that their outputs are constitutionally protected expression under the First Amendment. She treated the AI app as a product at the pleading stage. That framing, product not speech, is now rippling through every AI harm case filed since.

    The settlement came January 7, 2026, with undisclosed terms and a commitment to new safety features for users under 18. It resolved the immediate litigation. It also prevented the appellate ruling that would have given every court in America binding guidance on the First Amendment question. That question remains open. And every plaintiff’s attorney in the country noticed.

    The cases that followed came fast. In August 2025, the parents of 16-year-old Adam Raine sued OpenAI in California Superior Court, alleging ChatGPT fostered emotional dependency and provided self-harm instructions. Later that year, the estate of an elderly Connecticut woman filed a wrongful death action alleging that an AI chatbot’s interactions with her son materially contributed to a homicide-suicide. In March 2026, insurer Nippon Life sued OpenAI in federal court in Illinois to recover costs from AI-assisted legal filings that cited nonexistent cases.

    The number of generative AI-related lawsuits in the US grew 978% between 2021 and 2025, passing 700 cumulative cases, according to a March 2026 report by Gallagher Re in conjunction with MIT and Testudo Global Inc. The year-over-year filing rate accelerated from 59% growth in 2023-2024 to 137% growth in 2024-2025. AI product liability litigation is no longer a hypothetical risk. It is a present operational one.


    Four Jurisdictions, One Question

    This is not a story about a single court case crossing borders. It is a story about four major legal systems each building their own answer to the same question, and those answers pointing in entirely different directions.

    Jurisdiction Current Status Key Mechanism Timeline
    United States Case law developing; no federal AI liability statute Product liability via tort; First Amendment question unresolved AI LEAD Act and CHATBOT Act proposed; 1,000+ state bills filed in 2025
    European Union EU Product Liability Directive in force Dec 2024 Strict liability; AI = product; manufacturer presumption Member state transposition deadline: December 9, 2026
    United Kingdom Consultation closed Feb 2026; Law Commission review announced Existing tort law; no AI-specific statute yet Public consultation on “pure software” planned for H2 2026
    Canada Landmark ruling Feb 2024 (Air Canada) Negligent misrepresentation; corporate liability for chatbot output No federal AI liability legislation enacted as of June 2026

    Canada: The Air Canada Precedent

    The most legally clean ruling in the entire AI liability landscape came not from a US federal court but from the British Columbia Civil Resolution Tribunal in February 2024. Jake Moffatt relied on Air Canada’s chatbot for information about bereavement fares while booking a flight to attend his grandmother’s funeral. The chatbot gave him incorrect information. Air Canada later refused to honor the discount, arguing its chatbot was effectively a “separate legal entity” for which the company bore no responsibility.

    Tribunal Member Christopher C. Rivers dismissed that argument directly. Air Canada is responsible for all information on its website, the ruling stated, whether it comes from a static page or an AI chatbot. Customers cannot be expected to distinguish between human-provided and AI-provided information. Damages awarded: CAN$812.02. Precedent established: priceless.

    This is the foundational principle now being applied in every jurisdiction: AI has no legal personality. The company does. The company owns the output.

    The UK: Acknowledging the Gap

    In January 2026, the UK Jurisdiction Taskforce published a draft Legal Statement on liability for AI harms. Its conclusion was honest about the problem in a way that most regulatory documents are not. The UKJT stated that “given that AI tools can act with a degree of autonomy, there is a potential gap in the law if there are circumstances in which neither the AI itself nor its operator can be held liable for harms arising from the AI’s actions.” They named the gap. They have not yet filled it. The UK Law Commission has announced a public consultation on “pure software” for the second half of 2026.

    The EU: The December Deadline That Rewrites Everything

    The EU moved fastest and furthest. The EU Product Liability Directive (Directive 2024/2853) came into force on December 8, 2024. It explicitly includes software, including AI systems, within the definition of “product” subject to strict liability. AI providers typically qualify as “manufacturers.” Cloud-based AI, on-device AI, and SaaS products are all covered. Member states must transpose this into national law by December 9, 2026, which is six months from today.

    The directive contains a mechanism that should alarm every legal team deploying AI in Europe: a rebuttable presumption of defectiveness. If a defendant fails to meet its disclosure obligations, courts can presume the AI caused the harm. Companies cannot contractually exclude this liability. Non-compliance with the EU AI Act constitutes a product defect. The two frameworks are linked: fail the AI Act audit, and you have just handed plaintiffs a liability hook.


    The Product Liability Turn

    Understanding why product liability matters here requires understanding what it was built to do. Product liability law evolved to handle mass-distributed manufactured goods where individual causation is hard to prove but the defect is systemic. It assigns liability across a chain: designer, manufacturer, distributor, retailer. It does not require proving that a specific person was negligent. It asks whether the product was defective and whether that defect caused the harm.

    Plaintiffs’ attorneys discovered this framing fits AI systems better than any other available doctrine. As attorneys Amy Wong and Jin J. To of K&L Gates wrote in March 2026: “Early AI cases that began through adjacent doctrines, consumer protection, privacy, defamation, and IP, are now consolidating around product liability.” The reason is structural. Product liability “is built to evaluate mass-distributed technologies through the lenses of defect, warnings, and foreseeability, with liability that can extend across a chain of entities.”

    The key tactical insight driving this consolidation: plaintiffs are not suing the model. They are suing the deployed product experience, the interface, the defaults, the absence of guardrails, and the marketing claims. This sidesteps the First Amendment entirely. You are not claiming the AI’s speech is unlawful. You are claiming the product was defectively designed to reach and manipulate vulnerable users without adequate warnings.

    Key Shift for Legal Teams Product liability reaches upstream to model developers AND downstream to enterprise deployers. If you are using a third-party AI model and it causes harm to your customer, your vendor’s terms of service are not a liability shield. Courts are testing theories that extend liability across the entire supply chain.

    The First Amendment Wildcard

    There is one argument that could unravel the entire product liability wave. If a higher court rules that chatbot outputs are constitutionally protected speech, most of these tort claims fail. Plaintiffs would need to satisfy the demanding Supreme Court test for unlawful incitement to violence. That is a very high bar.

    Judge Conway’s ruling in Garcia was explicit that she was “not prepared” to treat AI output as speech, but that was a motion-to-dismiss ruling, the lowest legal threshold. The Foundation for Individual Rights and Expression filed an amicus brief in Garcia pressing exactly this question. The settlement prevented the appellate ruling that would have resolved it. Per analysis from the American Enterprise Institute, without binding higher-court precedent, every new AI harm case is re-litigating the same threshold questions from scratch, creating expensive and inconsistent outcomes for everyone.


    The Insurance Gap Is Now Contractual

    The AI liability gap was theoretical until January 2026. Then it became contractual.

    In January 2026, the Insurance Services Office introduced new endorsement forms giving commercial general liability carriers the option to formally exclude generative AI exposures from standard policies. Before that, the coverage was “silent”: ambiguous enough that a company might or might not be covered depending on how their specific incident was characterized. After January 2026, insurers can simply write “GenAI excluded” into the contract. Many are doing exactly that.

    “AI is changing the risk landscape faster than traditional frameworks can adapt, and the organizations that invest early in transparent governance, scenario analysis and insurance alignment will be best positioned to adopt AI safely and to turn risk into a source of long-term advantage.” Brent Rieth, Head of Global Cyber Solutions, Aon
    The data behind this transition is stark. Of companies that experienced AI-related losses and made claims in 2026, just over half were covered in full. 44% were only partially covered. 3% were entirely uninsured. That is according to Gallagher’s 2026 AI Adoption research. Nearly half of all companies that suffered an AI-related loss and tried to claim on their insurance did not get the full amount they expected.

    AI incidents themselves are growing at roughly 50% year-over-year, according to WTW’s Willis Research Network. 2025 exceeded 2024’s total before the year had ended. The volume of incidents is increasing faster than insurance capacity is being created to cover them.

    There is a structural concern beyond just pricing. Josephine Wolff, Professor of Cybersecurity Policy at Tufts University’s Fletcher School and a specialist in insurance and cybersecurity policy, identifies a systemic risk that goes beyond individual corporate exposure:

    “It is not yet clear whether insurers will embrace having a role in managing AI risks and, if so, which risks they will be willing to cover and which they may view as fundamentally too large or unpredictable to insure.” Josephine Wolff, Associate Dean for Research, The Fletcher School, Tufts University (May 2026)
    The concern she is raising is real. AI risk has a concentration problem that traditional catastrophe insurance does not. Geographic catastrophes like hurricanes and earthquakes affect specific regions. An AI defect in a widely adopted foundation model can trigger simultaneous harm and claims across thousands of organizations globally. There is no geographic limit. The risk is potentially uninsurable by conventional actuarial methods.

    The insurance industry went through this same inflection point with cyber risk in the mid-2010s. Silent cyber gave way to explicit exclusions, which drove the creation of dedicated cyber insurance lines, which matured into a multi-billion dollar market. AI liability is at that same silent-to-explicit inflection point right now. The companies that acted during the silent cyber phase and built dedicated coverage while premiums were low were in a fundamentally better position than those who discovered the exclusion at renewal time. The window for that kind of strategic preparation is closing.


    Boards Are in the Crosshairs

    A survey published in 2026 by Diligent Institute and Corporate Board Member found that only 8% of boards rate themselves as having strong AI expertise. Yet 40% of directors named technological developments including AI as the single most challenging issue to oversee. 66% of directors already use AI for their own board work, and only 22% have governance processes governing their own usage of it.

    This mismatch between exposure and expertise is not just embarrassing. Under Delaware’s Caremark doctrine, it is a legal liability.

    Caremark derivative suits allow shareholders to sue board members personally for failing to adequately oversee risks that then caused the company financial harm. Cleary Gottlieb’s January 2026 board guidance publication identifies AI governance failures as a specific Caremark exposure. If a company suffers a major AI-related loss and the board had no designated AI risk owner, no regular reporting cadence on AI deployments, and no policy framework for third-party AI tools, those facts become evidence of a breach of the fiduciary duty of oversight.

    88% of businesses now use AI in at least one function, according to Cleary Gottlieb’s analysis. The board fiduciary duty has not been narrowly construed for decades. It will not be narrowly construed here either.

    “In 2026, we anticipate that the pace of AI regulation will remain unpredictable and increasingly stringent.” Nithya Das, General Manager, Governance at Diligent
    There is also a gap between the perceived threat and the actual one. A Sentry Insurance survey cited in the March 2026 Gallagher Re report found that 69% of US executives believe a single AI-related verdict could shut their company down. Yet only 17% list AI lawsuits as a top business threat in their current risk registers. They fear the outcome. They are not managing the cause. That is the definition of a governance failure.


    What Companies Must Do Now

    The EU’s December 9, 2026 transposition deadline is the most concrete forcing function available. Any AI-powered product placed on the EU market after that date is subject to strict product liability across 27 member states. That deadline is six months away. Here is what legal, compliance, and board teams should already be doing.

    • Audit every AI deployment against the EU PLD’s “product” definition if you operate in Europe or sell to European customers. Cloud-based AI qualifies. If you are unsure, assume it does and work backwards from there.
    • Map your AI supply chain and find the indemnification gaps. The enterprise deploying a third-party model bears liability for that model’s outputs under current US and EU frameworks. Your vendor contract’s limitation-of-liability clause was written before this legal landscape existed. Review it with this exposure in mind.
    • Commission an explicit AI coverage review of every relevant policy: CGL, D&O, E&O, professional indemnity. Ask specifically whether GenAI is excluded under current or upcoming renewal terms. Do not wait for a claim to find out.
    • Put AI explicitly on the board risk register with a named executive accountable for AI risk governance. This is not just best practice. It is Caremark protection. Document that the board is receiving regular reporting on AI deployments, known risks, and mitigation actions.
    • Document every testing, safety, and deployment decision for every AI system in production. This documentation becomes the evidentiary backbone of any legal defense. Courts and regulators will ask for it. Having it does not guarantee a win, but not having it is effectively a concession.
    EU Deadline Alert The EU Product Liability Directive requires member state transposition by December 9, 2026. After that date, AI providers are treated as manufacturers under strict liability law across 27 countries. Non-compliance with the EU AI Act constitutes a product defect. This is not future risk. This is a compliance date six months from today.

    The Arguments Against the Wave

    The liability wave has real legal and structural critics. Their arguments deserve attention from anyone building strategy around this issue.

    Existing Law May Already Be Enough

    The UK Jurisdiction Taskforce’s draft Legal Statement takes an explicitly optimistic view: English law, including existing tort doctrine and contract principles, can in principle address AI harms without new legislation. The contrarian case is that AI-specific liability regimes generate compliance overhead without improving victim outcomes, while suppressing beneficial AI deployment. Kevin Frazier, a policy researcher at AI Frontiers, argued in June 2025 that “in the absence of federal legislation, the burden of managing AI risks has fallen to judges and state legislators, actors lacking the tools needed to ensure consistency, enforceability, or fairness.”

    He has a point about fragmentation. Over 1,000 AI bills were introduced at the federal and state level in the 2025 legislative session. AI products are not built on a bespoke basis for niche geographic markets. A patchwork of dozens of state laws creates compliance chaos without solving the underlying problem.

    The First Amendment Could Reverse Everything

    The American Enterprise Institute has argued directly that the entire AI liability wave is built on a legally fragile foundation. The Garcia ruling was at the motion-to-dismiss stage, the lowest legal threshold. If an appellate court holds that AI outputs are constitutionally protected speech, most tort claims evaporate. The Garcia settlement prevented exactly the appellate ruling that would have resolved this. Until a binding higher-court decision exists, plaintiffs and defendants will keep relitigating the same threshold questions.

    The EU’s Two-Framework Problem

    Academic analysis by legal scholar Philipp Hacker identifies a coherence problem in the EU’s dual-track approach: the AI Act handles ex-ante compliance, the PLD handles ex-post liability. The PLD does not define safety standards; it links liability to AI Act compliance. But AI Act compliance does not address individual rights of compensation. Victims can fall between the two frameworks. Hacker’s recommendation is a single, fully harmonizing regulation rather than two miscoordinated directives.

    One More Thing to Scrutinize

    The 978% lawsuit growth figure is striking, but it conflates copyright infringement cases (the largest category at 11.9%) with personal injury and harm cases, which are legally and factually very different. Boards receiving messaging about exploding AI litigation should ask specifically which type of litigation is relevant to their actual deployment profile before recalibrating risk budgets.


    FAQ: AI Liability Law 2026

    Who is liable when AI causes harm?

    Under current law in the US, UK, EU, and Canada, AI systems have no legal personality and cannot themselves be held liable. Liability flows to the humans and organizations that developed, deployed, or used the AI. Courts are consistently treating AI as a tool, meaning the deploying organization owns both the benefits and the legal exposure from its outputs, even when those outputs are generated by a third-party model it did not build.

    Can an AI company be sued for wrongful death?

    Yes. The 2024 filing of Garcia v. Character Technologies established that wrongful death claims against AI chatbot companies can proceed in US federal court. Judge Anne Conway denied Character.AI’s motion to dismiss in May 2025, treating the chatbot as a product and rejecting First Amendment defenses. Character.AI and Google settled in January 2026. Additional wrongful death suits against OpenAI are currently pending in California.

    What is the EU AI Product Liability Directive?

    The EU Product Liability Directive (Directive 2024/2853) came into force in December 2024 and explicitly includes software and AI systems in the definition of “product” subject to strict liability. EU member states must transpose it into national law by December 9, 2026. After that date, AI providers qualify as manufacturers and cannot contractually exclude liability for defects, including AI Act non-compliance.

    Is a company responsible for what its AI chatbot says?

    Yes, according to current rulings in both the US and Canada. In Moffatt v. Air Canada (2024), British Columbia’s Civil Resolution Tribunal ruled that Air Canada could not disclaim responsibility for its chatbot’s misinformation by calling it a “separate legal entity.” Companies are responsible for all information on their platforms, whether it comes from a human employee or an automated system.

    What is the AI liability gap?

    The AI liability gap refers to the mismatch between where AI harm is occurring and where legal and insurance frameworks have clear rules. In January 2026, the Insurance Services Office introduced endorsements allowing carriers to formally exclude generative AI from standard commercial general liability policies, converting the theoretical gap into a contractual one. Companies that assumed coverage exists may find at renewal that it no longer does.

    Do boards of directors face personal liability for AI decisions?

    Potentially yes, under Caremark doctrine in Delaware. Boards of companies that suffer financial losses from AI failures may face shareholder derivative suits alleging directors breached their fiduciary duty of oversight. Cleary Gottlieb identified this as a specific board-level exposure in January 2026, noting that 88% of businesses use AI in at least one function while board AI expertise remains critically low across the S&P 500.

    Can AI chatbot output be protected by the First Amendment?

    This is the most consequential unresolved question in AI liability law. Defendants in US cases have argued chatbot outputs are protected speech, which would shield them from most tort claims. Judge Conway in Garcia ruled she was “not prepared” to treat AI output as speech at the pleading stage. That was not a binding appellate decision. The Garcia settlement prevented the ruling that would have resolved this, leaving it open for every subsequent case.


    Where This Goes in the Next 18 Months

    The next 18 months will not produce clarity. They will produce more cases, more settlements that prevent clarity, and one hard regulatory deadline that will force companies to treat AI liability as a compliance issue whether courts have resolved the doctrine or not.

    The EU’s December 9, 2026 transposition deadline is the single most consequential near-term forcing function in global AI liability law. For the first time, a major jurisdiction with global market reach has legislated that software is a product under strict liability, and that manufacturer status attaches to AI providers. Companies that operate in Europe and have not yet aligned their vendor contracts, insurance coverage, technical documentation, and board governance against this framework have roughly 166 days to do so.

    Watch three things. First, whether any US appellate court issues a binding ruling on the First Amendment question currently evaded by the Garcia settlement. Second, whether the AI LEAD Act or CHATBOT Act advances past the Senate Judiciary Committee, given the bipartisan coalition behind both. Third, whether the EU AI Act’s Digital Omnibus receives formal European Parliament adoption by July 7, 2026 as expected, which would solidify the link between AI Act compliance and product liability exposure across the single market.

    The companies that treat this as a compliance checkbox will be the defendants in the cases NeuralWired covers next year. The ones that treat it as a strategic design constraint now will build the documentation, governance, and insurance infrastructure that actually holds up in court.

    Our Read The insurance industry’s move from silent coverage to formal exclusion is the clearest leading indicator available. Insurers do not price risk ahead of its time. When they start excluding AI formally in January 2026, they are signaling that the actuarial models are breaking down. That is worth more attention than any single court ruling.

    Stay ahead of AI law, governance, and enterprise risk. Subscribe to The Neural Loop, NeuralWired’s weekly briefing for technology decision-makers, at neuralwired.com/newsletter.

  • Gartner: AI Inference Cost Won’t Drop Your Bill in 2026

    Gartner: AI Inference Cost Won’t Drop Your Bill in 2026

    Reduce LLM Inference Cost: Gartner’s 2026 Enterprise Guide
    Enterprise AI · Cost Architecture

    Gartner Says Your LLM Bill Is About to Double

    In April 2026, Uber’s engineering organization ran out of its entire annual AI coding budget two-thirds of the way through the year. Two months later, Microsoft pulled back most internal developer access to Claude Code over the same problem: cost. Neither company is careless with money. Both got caught by the same math now hitting finance teams across the industry: token prices are falling, but the bill keeps climbing.

    If part of your job in 2026 is figuring out how to reduce LLM inference cost across an enterprise deployment, “wait for prices to drop further” stopped being a strategy the moment it failed at Uber and Microsoft. What works instead is an actual cost architecture, built from seven specific moves. Some you can ship this week. Some take a quarter to stand up properly.

    Quick answer: Per-token LLM prices have fallen as much as 280-fold since 2022, yet enterprise AI bills keep rising. The reason is agentic workflows, which burn 5 to 30 times more tokens per task than a simple chatbot query, according to Gartner, with adoption accelerating faster than unit prices fall. Cutting your real bill takes architecture, not patience: prompt caching, smart model routing, inference-stack tuning, agentic spend controls, sound self-host-versus-API math, FinOps-grade attribution, and pre-deployment cost modeling.

    Why Falling Token Prices Won’t Reduce Your LLM Inference Cost

    Here’s the number every “AI is getting cheaper” headline traces back to. Gartner forecasts that by 2030, running inference on a one-trillion-parameter model will cost providers more than 90% less than it did in 2025, with LLMs overall becoming up to 100 times more cost-efficient than the earliest 2022-era models of similar size, per Gartner’s March 2026 forecast. Stanford’s AI Index already clocked a 280-fold drop in GPT-3.5-equivalent inference pricing between late 2022 and late 2024.

    None of that is showing up as savings on enterprise invoices. Gartner says so explicitly, and so does the analyst who built the forecast.

    “Chief Product Officers (CPOs) should not confuse the deflation of commodity tokens with the democratization of frontier reasoning.” Will Sommer, Senior Director Analyst, Gartner, via Gartner
    Translation: cheap tokens fund better models, not smaller bills. Demand, meanwhile, is exploding underneath the price drop. Agentic models require 5 to 30 times more tokens per task than a standard chatbot exchange, per Gartner, and Goldman Sachs projects global token consumption will climb roughly 24-fold by 2030, reaching something like 120 quadrillion tokens a month. That’s Jevons Paradox playing out in real time: a 160-year-old economic principle stating that efficiency gains tend to increase total consumption rather than reduce it. Cheaper tokens have historically unlocked more AI usage, not lower total spend.

    This has also stopped being a quiet, internal cost-center problem. An AI consultant told Axios that one unnamed enterprise reportedly burned through roughly $500 million in Claude API spend in a single month after failing to set employee usage limits (treat that figure as reported, not officially confirmed; no company has put its name on it). What is confirmed: the Linux Foundation announced a new standards body, the Tokenomics Foundation, in the first week of June 2026, modeled directly on how the FinOps Foundation standardized cloud-cost discipline a decade earlier. When an industry spins up a dedicated standards body to police a cost problem, that problem has stopped being optional to manage.

    The 7-Step Framework to Reduce LLM Inference Cost at Enterprise Scale

    Treat the list below as a stack, not a checklist. The first two steps are mechanical and fast, most teams see results within days. The last three are organizational and slower, taking a quarter to stand up properly, but they’re what stops the bill from doubling again next year.

    StepWhat it fixesTime to first results
    1. Prompt cachingRepeated context reprocessed on every single callDays
    2. Model routing & cascadingFrontier pricing applied to tasks a small model could handle1–2 weeks
    3. Inference-stack tuningBatching and decoding choices mismatched to traffic2–4 weeks
    4. Agentic token-sprawl controlUngoverned agents multiplying spend with no budget ceiling2–4 weeks
    5. Self-host vs. API mathHidden personnel costs erasing on-paper savings4–6 weeks
    6. FinOps-grade attributionNo one can say which team or agent is spending what1–2 quarters
    7. Pre-deployment cost modelingCost surprises discovered after a feature shipsOngoing

    Step 1: Turn On Prompt Caching First

    If you do exactly one thing this week, do this one. Prompt caching stores the computed representation of a prompt’s repeated prefix, things like system instructions, tool definitions, and reference documents, so later calls skip reprocessing it from scratch. Anthropic made it generally available on December 17, 2024, pricing cached input tokens at roughly 10% of standard input cost, with cache writes running 1.25 to 2 times standard pricing depending on how long the cache is held.

    Anthropic’s own figures claim up to 90% cost reduction and 85% latency reduction on long prompts. Vendor claims are easy to discount, except this one has independent backing: a 2026 academic evaluation titled “Don’t Break the Cache” ran the first comprehensive third-party test across three major LLM providers on long-horizon agentic tasks and found real-world savings of 41 to 80%. That’s the single most defensible number in this whole article: a vendor claim and an independent study landing in the same range.

    “We’re excited to use prompt caching to make Notion AI faster and cheaper, all while maintaining state-of-the-art quality.” Simon Last, Co-founder, Notion, via Anthropic
    Implementation here is an engineering task, not a procurement project. Most teams can audit their cache hit-rate and restructure prompts (static content first, variable content last) inside a single sprint.

    Step 2: Route and Cascade, Don’t Just Pay Frontier Prices for Everything

    Routing sends each request to the cheapest model that can actually handle it. Cascading starts cheap and escalates only when a quality check fails. Stanford’s FrugalGPT, the paper that founded this whole technique, showed up to 98% cost reduction while matching the best individual model’s performance. UC Berkeley’s RouteLLM project later trained a classifier that hit 95% of GPT-4-level quality at 85% lower cost on MT-Bench, and comparable quality at 45% lower cost on MMLU.

    Treat those percentages as proof the technique works, not as a number to promise finance. Both figures are tied to one specific model pairing on two specific benchmarks. Your prompts and your traffic will produce a different result, so run the eval on your own workload before it goes into a budget deck.

    We already broke down the small-versus-frontier pricing tables, the self-hosting break-even math, and named enterprise case studies in our companion piece, GPT-5 vs Small Language Models: 2026 Enterprise Cost. If routing is the step you want to go deep on, that’s where the depth lives. Here, the point is narrower: routing is one piece of a seven-piece architecture, not the whole fix.

    Step 3: Tune the Inference Stack to Your Actual Traffic

    This is where “obvious” optimizations get dangerous. Speculative decoding is marketed as a clean win: predict several tokens ahead, verify them in parallel, cut latency and cost together. At small batch sizes (16 or fewer concurrent requests), independent energy-efficiency research found it cuts cost by up to roughly 29%. At large batch sizes (128 concurrent requests), the same technique increased total energy cost by roughly 25.65%.

    Same technique, opposite result, depending entirely on traffic pattern. Batching, hardware allocation, and decoding strategy aren’t settings to copy from a blog post. They’re decisions that need your own load data behind them, and most teams haven’t measured their traffic closely enough to know which side of that line they’re actually on.

    Step 4: Put a Leash on Agentic Token Sprawl

    This is the fastest-growing line item, and the one with the least governance attached to it. EY’s analysis found the cost of a single agentic customer-service interaction rose from roughly $0.04 in 2023 to $1.20 in 2026, a roughly 30-fold increase, driven by orchestrated multi-tool agent workflows replacing simple linear chatbot exchanges.

    The fix is governance, not a model swap: per-agent token budgets, hard ceilings on tool-call chains, and visibility into which agent, team, or feature is generating which slice of the bill. We covered the broader shadow-AI version of this problem, agents spun up without IT’s knowledge, quietly multiplying spend nobody’s tracking, in AI Agent Sprawl: The Shadow AI Crisis Hitting Enterprise. If ungoverned agent proliferation is your specific problem, start there.

    Step 5: Get the Self-Host vs. API Math Right

    Self-hosting looks cheaper on a per-token spreadsheet, and often isn’t, once the team required to run it gets added in. Maintaining a fine-tuned or self-hosted model typically costs $180,000 to $300,000 a year per ML engineer, and round-the-clock coverage adds another $800,000 to $1.2 million annually. Run that math forward and the break-even point lands around 500,000 tokens per day of sustained load. Below that, API-based smaller models beat self-hosting on total cost. Above it, self-hosting can pay off, assuming the team is already in place rather than hired specifically for this.

    (If you’re staffing up purely to bring a model in-house, you’ve likely already lost the math before writing a line of code.)

    Step 6: Build FinOps-Grade Cost Attribution

    The share of FinOps teams managing AI spend rose from 31% to a projected 98% in two years, according to a survey of 1,192 practitioners representing more than $83 billion in annual cloud spend. That’s not a niche trend. That’s an entire discipline getting rebuilt around one new line item.

    “In April and May, I started hearing from companies: ‘Oh my god, we are 3x over our entire 2026 token budget and it’s only April.’ We started hearing existential crises, and the whole conversation shifted from tokenmaxxing and ‘go fast’ to ‘we need guardrails, how do we control this?’” J.R. Storment, Executive Director, FinOps Foundation, via TechCrunch
    The Tokenomics Foundation, announced by the Linux Foundation in the first week of June 2026 and set to formally launch in July, exists to standardize exactly this: canonical metrics like cost-per-intelligence and tokens-per-watt, the same way the FinOps Foundation standardized cloud-cost discipline a decade ago.

    “AI is forcing FinOps to answer a harder question. It’s not ‘what did we spend?’, it’s ‘what did we actually get out of that spend?’ The hardest part of AI isn’t building it, it’s proving it was worth it.” Rajeev Laungani, Head of Product, Virtasant, via Virtasant
    Practically, this means cost attribution by team, feature, and agent, not just one line on a monthly invoice. Build it before finance asks for it. At this point, they will.

    Step 7: Model Cost Before You Ship, Not After

    Engineering platform Jellyfish analyzed production usage data across its customer base and found the developers consuming the most AI tokens were roughly twice as productive, but used ten times the tokens to get there. Per-developer token consumption rose roughly 18.6-fold in nine months.

    Is that a good trade? Nobody actually knows yet, and that’s the real problem with treating cost optimization as a purely engineering exercise.

    “Whether extreme spend pays off comes down to the ultimate business value of shipped code (e.g. revenue), which most companies still can’t measure.” Nicholas Arcolano, Head of Research, Jellyfish, via TechCrunch
    The shift this forces: a cost model needs to exist before a feature ships, not get reconstructed from an invoice afterward. Our deeper reporting on why so many AI deployments never get to prove that value lives in Enterprise AI Failure Rate 2026: MIT Says 95% Miss ROI.


    Where This Framework Breaks Down

    Every one of the seven steps above is real and verifiable. None of them reverses the underlying economics, and an honest article says so.

    Jevons Paradox is the structural problem. Efficiency gains increase total consumption rather than reducing it, and that’s exactly what’s happening with token pricing. Optimization slows the rate at which your bill grows. It does not reliably make the bill go down once agentic adoption is already underway across your organization.

    Gartner’s own analyst makes the sharpest version of this argument, and it’s worth taking seriously precisely because it comes from the firm that published the optimistic 90%-by-2030 number in the first place. Token deflation, in his framing, helps providers fix their own margins long before any of it reaches the enterprise customer.

    “The customer isn’t going to see all of this money.” Will Sommer, Senior Director Analyst, Gartner, via CIO Dive
    Measurement itself is still broken, too, which undercuts any specific savings percentage offered without an attribution system already in place.

    “Even getting clarity on relatively basic metrics, like the number of tokens being used, works differently in different areas. It’s very fragmented across providers and even across services within a single provider.” Jon Thompson, CTO, Virtasant, via Virtasant
    Our read: this framework will slow your bill’s growth rate. It will not reliably shrink the bill itself, not while agentic adoption is still in its land-grab phase across the industry. The honest claim is “stop runaway growth and start measuring,” not “halve your invoice by next quarter.” Anyone promising the second one is selling something.

    What to Watch Over the Next 6 to 18 Months

    • July 2026: The Tokenomics Foundation formally launches. Watch whether its proposed metrics, cost-per-intelligence and tokens-per-watt, actually get adopted by vendors, or stay aspirational.
    • Late 2026 into 2027: Goldman Sachs projects token consumption climbing toward 24 times current levels by 2030. If that holds even roughly, expect more public “3x over budget” stories like Uber’s, not fewer.
    • Ongoing: Whether Anthropic, OpenAI, and Google start publishing standardized, comparable token-accounting data, the same shift cloud computing went through when FinOps forced billing transparency a decade ago.

    Frequently Asked Questions About Enterprise LLM Cost Optimization

    Why are AI inference costs rising if token prices are falling?

    Per-token prices have fallen as much as 280-fold since 2022, but total enterprise spend is rising because agentic workflows use 5 to 30 times more tokens per task than simple chatbot queries, according to Gartner, and adoption is accelerating faster than unit prices decline.

    What is prompt caching and how much does it save?

    Prompt caching stores a prompt’s repeated prefix, such as system instructions, tools, and documents, so later requests skip reprocessing it. Anthropic reports up to 90% cost reduction and 85% latency reduction on long prompts; independent academic research confirms 41 to 80% real-world savings on agentic workloads.

    What is LLM model routing or cascading?

    Routing sends each request to the cheapest capable model; cascading starts small and escalates only if a quality check fails. Stanford’s FrugalGPT framework demonstrated up to 98% cost reduction using this approach while matching the performance of the best individual model.

    Is it cheaper to self-host an LLM or use an API?

    It depends on volume. Below roughly 500,000 tokens a day of sustained load, API-based smaller models typically beat self-hosting once you account for ML engineer salaries and round-the-clock operations coverage. Above that threshold, self-hosting can pay off.

    How much does GPT-5-class inference cost in 2026?

    OpenAI’s frontier model runs roughly $5.00 per million input tokens and $30.00 per million output tokens as of mid-2026, while budget-tier alternatives like Microsoft’s Phi-4 cost roughly $0.065 to $0.14 per million tokens, a difference of more than 70 times for tasks that don’t need frontier-level reasoning.


    The Bottom Line on Reducing Enterprise LLM Inference Cost

    Here’s what changes once you’ve read this far: you stop waiting for token prices to fix your budget, because they won’t, not at the rate agentic adoption is growing. You start treating LLM cost the way mature engineering organizations treat any other infrastructure spend, with caching turned on by default, routing decisions backed by your own evals instead of someone else’s benchmark, agent budgets that exist before an agent ships, and a cost model built before a feature launches instead of reconstructed from an invoice afterward.

    Three things to do this week: pull your prompt-caching hit-rate and see how far it sits from Anthropic’s claimed ceiling. Set a hard per-agent token budget on whatever’s currently ungoverned. And ask finance whether anyone owns AI cost attribution yet, because if the FinOps Foundation’s numbers hold, 98% of FinOps teams will own a piece of it within the year, whether or not engineering looped them in first.

    Reducing enterprise LLM inference cost in 2026 was never going to be about waiting for cheaper tokens. It’s about building the architecture that makes the token price you already have work for your budget instead of against it.

    Want the next breaking development on enterprise AI economics before your competitors see it? Subscribe to The Neural Loop at neuralwired.com/newsletter.

  • Enterprise AI Failure Rate 2026: MIT Says 95% Miss ROI

    Enterprise AI Failure Rate 2026: MIT Says 95% Miss ROI

    95% of Enterprise AI Pilots Fail to Deliver ROI | NeuralWired
    Enterprise AI • Research Analysis

    95% of Enterprise AI Pilots Fail to Deliver ROI. Four Research Teams Just Confirmed It.

    Your company just spent six months and a million dollars on a generative AI pilot. The vendor demos looked flawless. The internal presentations sparked genuine excitement. Then the results came in, and nothing moved. Not revenue. Not costs. Not customer retention.

    If that sounds familiar, you are in the majority. A large, expensive, embarrassingly well-funded majority.

    Four major research institutions, using four separate methodologies, all landed on the same uncomfortable finding about enterprise AI investment in 2025: somewhere between 60% and 95% of organizations are spending real money on AI and producing nothing measurable in return. The AI ROI crisis is not a pessimist’s talking point anymore. It is the consensus position of the best-sourced data in the field.

    Here is what the research actually shows, why the failures keep happening, and what the small group of winners is doing that everyone else isn’t.


    The Real Numbers: What Four Independent Studies Found

    The most important thing to know before citing any AI failure statistic is that several of the most-shared numbers online are not traceable to real research. A figure that circulated widely in early 2026, claiming “$684 billion invested with 80.3% producing nothing,” appears across dozens of content sites but traces back to no primary dataset, no named methodology, and no actual report. It is not from RAND. It is not from Gartner. It does not exist in the primary literature.

    What does exist is more interesting, and more damning.

    95%
    of GenAI pilots show zero measurable P&L impact
    MIT Project NANDA, July 2025
    39%
    of organizations report any enterprise-wide EBIT impact from AI
    McKinsey State of AI 2025
    42%
    of companies abandoned most of their AI initiatives in 2025, up from 17% in 2024
    S&P Global Market Intelligence, March 2025
    25%
    of AI initiatives delivered expected ROI, per CEO self-report
    IBM Institute for Business Value, May 2025
    MIT’s Project NANDA published the sharpest number. Their GenAI Divide: State of AI in Business 2025 report reviewed over 300 publicly disclosed AI initiatives and conducted structured interviews with representatives from 52 organizations, plus survey responses from 153 senior leaders. The finding: 95% of GenAI pilots delivered no measurable profit-and-loss impact. Only 5% of integrated systems created significant value.

    McKinsey’s State of AI 2025 is the largest survey, with nearly 1,993 respondents across 105 countries. It found that just 39% of organizations report any enterprise-wide EBIT impact from AI. Only about 5.5% to 6% of respondents qualify as true high performers, meaning their organizations attribute more than 5% of EBIT to AI use.

    S&P Global Market Intelligence surveyed more than 1,000 respondents across North America and Europe in March 2025 and found that the share of companies abandoning most of their AI initiatives jumped to 42% in one year, up sharply from 17% the prior year. The average organization scrapped 46% of AI proof-of-concepts before they ever reached production.

    The IBM Institute for Business Value CEO Study surveyed 2,000 CEOs across 33 countries and found that only 25% of AI initiatives had delivered expected ROI over the preceding few years, and only 16% had scaled enterprise-wide.

    Key Context These four studies use different definitions of “failure” and different methodologies. MIT tracks GenAI pilots specifically on P&L impact. McKinsey tracks EBIT at enterprise scale. S&P tracks initiative abandonment rates. IBM tracks CEO self-reported ROI. The fact that all four land in the same territory (a small single-digit percentage of organizations capturing most of the value) is more persuasive than any single number would be on its own.
    For spending context: Stanford HAI’s AI Index 2025 tracked $252.3 billion in corporate AI investment in 2024, with private investment climbing 44.5% year-over-year. Gartner forecasts worldwide AI spending will reach $2.52 trillion in 2026. The money is real. The returns, for most organizations, are not.


    Why Enterprise AI Projects Actually Fail

    The RAND Corporation’s 2024 qualitative study, based on interviews with 65 experienced AI and machine learning practitioners, is explicit: “By some estimates, more than 80% of AI projects fail. That’s twice the failure rate of non-AI IT projects.” RAND framed this as an estimate rather than a hard statistic, which is the intellectually honest position. But the directional claim is consistent with every quantitative study that followed.

    What RAND and the subsequent research agree on is that the failure causes are almost never technical. Models work. APIs work. The infrastructure, mostly, works. The failures are organizational.

    The Integration Gap

    McKinsey’s data reveals something counterintuitive: function-level AI wins (software engineering and IT teams seeing 10% to 20% cost reductions, for example) coexist with near-zero enterprise-wide EBIT impact. Teams are building AI tools. Those tools are producing local efficiencies. But the enterprise-level needle doesn’t move because the tools exist inside departmental silos, disconnected from the workflows that drive revenue and cost at scale.

    The organizations in McKinsey’s high-performer cohort are not running more pilots. They are forcing workflow redesign. There is a meaningful difference between adding AI to an existing process and redesigning the process around AI’s actual capabilities.

    The Data Readiness Problem

    Gartner predicted in July 2024 that at least 30% of generative AI projects would be abandoned after proof of concept by end of 2025, citing poor data quality, inadequate risk controls, escalating costs, and unclear business value. Gartner’s June 2025 follow-up extended that prediction to agentic AI: over 40% of agentic AI projects are expected to be canceled by end of 2027, for essentially the same reasons.

    The pattern Gartner keeps documenting is that most enterprise AI failures trace upstream to data infrastructure, not model selection. Organizations with fragmented, inconsistent, or poorly governed data are running state-of-the-art models on inputs that guarantee mediocre outputs. The models perform exactly as well as the data allows. The data, in most enterprises, does not allow much.

    The FOMO-Driven Pilot Problem

    IBM’s CEO study names a failure mode that does not appear in the other research but is instantly recognizable to anyone who has sat through an enterprise AI strategy meeting: “FOMO-driven” pilots. Organizations launch AI initiatives because competitors are launching AI initiatives, not because they have identified a specific problem that AI is the right tool to solve. The result is a portfolio of proofs-of-concept that demonstrate capability without establishing business value, and that get quietly shelved when the next technology cycle begins.

    “Some large companies’ pilots and younger startups are really excelling with generative AI. It’s because they pick one pain point, execute well, and partner smartly with companies who use their tools.”

    Aditya Challapally, Lead Author, MIT NANDA GenAI Divide Report (Fortune, August 2025)
    The “one pain point” framing is more radical than it sounds. Most enterprise AI strategies involve multiple simultaneous pilots across multiple functions. The MIT data suggests that approach produces 95% failure rates. The alternative is a level of focus that most organizations, politically and structurally, find difficult to achieve.


    What the 5% of Winners Do Differently

    BCG’s Widening AI Value Gap report (published September 2025, surveying 1,250-plus global firms) found that only 5% of companies are achieving AI value at scale. BCG calls this cohort “future-built” firms. They share specific structural traits, not just better models or more budget.

    What Average Firms Do What Future-Built Firms Do
    Multiple simultaneous pilots across functions Single focused use case with defined P&L ownership
    Measure success by pilot completion Measure success by business metric change within 90 days
    Deploy AI into existing workflows Redesign workflows before and during AI deployment
    Data readiness addressed post-launch Data infrastructure audited and fixed before launch
    AI team isolated in IT or innovation lab AI ownership embedded in business unit P&L
    “Agentic AI isn’t a future concept. It’s already reshaping workflows and redefining roles. Companies should view it as the next step in scaling AI, not as the starting point.”

    Amanda Luther, Managing Director and Senior Partner, Boston Consulting Group, co-author of The Widening AI Value Gap
    BCG’s data also shows that 60% of companies are not achieving material value at all, reporting minimal revenue and cost gains despite substantial investment. The distribution is not a bell curve. It is a winner-take-most dynamic where a small cohort is pulling away from the field. The companies in that cohort are not smarter. They moved earlier on data infrastructure, defined success in business terms before launch, and treated AI deployment as a change-management problem rather than a technology rollout.

    If you’re building an enterprise AI program and you haven’t done a formal audit of your data readiness before approving new spend, Gartner’s prediction applies directly to you.


    The Skeptic’s Case: Is the AI Failure Narrative Overblown?

    The most credentialed critic of the 95% figure is Paul Roetzer, founder and CEO of the Marketing AI Institute. Speaking on The Artificial Intelligence Show in August 2025, Roetzer was direct about the MIT NANDA methodology: “Please don’t put any weight into this study. This is not a viable, statistically valid thing.”

    His critique is specific and worth taking seriously. MIT’s 95% figure tracks GenAI pilots on a narrow, 6-month P&L-only definition of success. That definition excludes efficiency gains, cost reductions, customer churn improvements, and sales pipeline velocity. Roetzer’s argument is that an organization that deploys a GenAI tool and reduces its customer support ticket resolution time by 40% would count as a “failure” under NANDA’s methodology, because that improvement did not show up as a measurable P&L impact within six months.

    “Anytime you see a headline like that, you have to immediately step back and say, okay, that seems unrealistic.”

    Paul Roetzer, Founder and CEO, Marketing AI Institute, speaking on The Artificial Intelligence Show, Episode 164 (August 2025)
    He also notes a potential framing consideration: NANDA’s research mission is building an “Internet of AI Agents,” meaning the report’s implicit argument is that today’s static GenAI tools fail while adaptive agentic systems succeed. That is not a reason to dismiss the report, but it is a reason to hold the 95% figure as directional rather than precise.

    Our read: Roetzer’s methodological critique is valid. The 95% figure almost certainly overstates the failure rate under a broader definition of value. But it probably understates the failure rate under a strict enterprise-ROI definition, because organizations are generally terrible at measuring AI value even when it exists. The honest answer is that somewhere between 60% and 95% of enterprise AI initiatives are producing less value than their sponsors expected, which is damning enough without needing to settle on a single number.


    What Happens Next: The 18-Month Outlook

    Gartner’s “Trough of Disillusionment” framing for GenAI in 2026 fits the historical Hype Cycle pattern and is a reasonable, falsifiable prediction. After peak hype comes a period where the gap between expectation and delivered value becomes impossible to ignore, investment gets more selective, and the organizations that built real infrastructure during the hype phase begin pulling away from those that didn’t.

    Three things are worth watching over the next 12 to 18 months.

    Agentic AI cancellation rates will become the new headline metric. Gartner predicts more than 40% of agentic AI projects will be canceled by end of 2027. Given that agentic AI is currently in an earlier hype phase than GenAI was in 2024, the cancellation rate could be higher. Watch for enterprise announcements of agentic AI programs in Q3 2026, and note whether they include defined success metrics and timelines.

    The winners will start becoming identifiable by name. The BCG “future-built” 5% is currently an anonymous cohort. As the field matures, the firms that built the right infrastructure and redesigned workflows rather than layering AI on top of broken processes will start producing public case studies with real numbers. Those case studies, when they arrive, will be more valuable than any survey data.

    CFO scrutiny will reshape how pilots get approved. IBM found that only 25% of AI initiatives delivered expected ROI. That number is entering boardroom conversations. Finance leaders who previously approved AI spend on the basis of competitive parity (“our competitors are doing this”) are beginning to demand pre-defined success metrics and ROI timelines before sign-off. That shift, if it continues, will produce fewer pilots and better ones.

    Three Actions for Technology Leaders Right Now
    1. Audit your data infrastructure before approving any new AI spend. Gartner’s data consistently shows that data readiness, not model selection, is the primary predictor of AI success.

    2. Define success in business terms, with a timeline and an owner, before a pilot launches. “Measurable reduction in customer support costs by Q3” is a success metric. “Explore AI capabilities” is not.

    3. Consider stopping two current pilots before starting one new one. The evidence suggests that focus produces better outcomes than portfolio diversification when it comes to enterprise AI.


    FAQ: Enterprise AI Failure Rates

    Why do most enterprise AI projects fail?
    Independent research from MIT, RAND, McKinsey, and S&P Global converges on organizational causes rather than technical ones: poor data readiness, unclear success metrics, weak workflow integration, and treating AI deployment as a technology rollout instead of a change-management initiative. The models mostly work. The organizations often don’t.

    What percentage of AI projects fail in 2026?
    Estimates vary by study and definition. MIT found 95% of GenAI pilots show no measurable P&L impact. McKinsey found only 39% of organizations report any enterprise-wide EBIT impact. S&P Global found 42% of companies abandoned most AI initiatives in 2025. No single authoritative percentage exists across all AI project types, but the consistent finding is that fewer than 10% of organizations capture most of the value.

    Is the MIT 95% AI failure statistic accurate?
    The MIT NANDA report is real, published in July 2025, based on 300-plus initiative reviews and 52 organizational interviews. The 95% figure reflects a strict 6-month P&L-only definition of success. Marketing AI Institute’s Paul Roetzer has publicly challenged the methodology for excluding efficiency and productivity gains. The figure is directionally useful but should not be treated as a precise universal failure rate.

    How much are companies investing in AI in 2026?
    Stanford HAI’s AI Index 2025 tracked $252.3 billion in corporate AI investment in 2024, with private investment rising 44.5% year-over-year. Gartner forecasts worldwide AI spending will reach $2.52 trillion in 2026. GenAI-specific pilot investment was estimated at $30 to $40 billion in 2025 per MIT NANDA’s own baseline.

    What do successful enterprise AI programs have in common?
    BCG’s analysis of 1,250-plus global firms found that the 5% achieving AI value at scale share three traits: they identify one specific business pain point rather than launching broad pilot portfolios, they redesign workflows around AI rather than layering AI onto existing processes, and they fix data infrastructure before deployment rather than after. The differentiator is organizational discipline, not model selection.


    The enterprise AI ROI crisis is not a story about artificial intelligence failing. It is a story about organizations failing to create the conditions under which AI can succeed. The technology works. The problem is that most enterprises are deploying it into environments it cannot fix: fragmented data, undefined success metrics, siloed workflows, and approval processes driven by competitive anxiety rather than business logic.

    The 5% that are winning are not using better models. They built better foundations first.

    Over the next 18 months, as Gartner’s predicted “Trough of Disillusionment” plays out and CFO scrutiny tightens, the gap between that leading cohort and the field will widen. The organizations that survive the trough will be the ones that treated their first round of AI failures as diagnostic information rather than sunk costs.

    For more on how enterprises are navigating this gap, read our analysis of why CTOs are falling behind on AI skills and our breakdown of the shadow AI crisis hitting enterprise governance.

    Stay Ahead of the AI Signal

    The Neural Loop delivers the enterprise AI research that actually matters, without the vendor spin. One email, twice a week.

    Subscribe to The Neural Loop