← Back to front page
United States · Business magazines · Entrepreneur

Your Business Is Losing Money on AI You Don’t Control — Here’s Why.

Published by Entrepreneur · United States 11 h ago
Your Business Is Losing Money on AI You Don’t Control — Here’s Why.
Entrepreneur

Detailed summary

Every silent AI update breaks your workflow, and you pay your provider an 85% margin to fix what it broke.

Ask yourself: how many times has your team asked for more budget due to inconsistent behavior from GPT or Claude? In Harvard Data Science Review, Stanford and UC Berkeley researchers Lingjiao Chen, Matei Zaharia and James Zou tested identical prompts on GPT-4 and GPT-3.5 across snapshots three months apart. GPT-4’s prime-number accuracy fell from 84.0% in March 2023 to 51.1% in June, while its chain-of-thought boost collapsed from 24.4% to -0.1%.

Everyday workflows suffered similar drops. On a happy-number task, GPT-4’s accuracy fell from 83.6% to 35.2%, while directly executable code plummeted from 52.0% to 10.0% because extra formatting broke pipelines. Instruction-following on answer extraction collapsed from 99.5% to 0.5% under the same model name and API.

A 2024 Carnegie Mellon and HKUST study by Wanqin Ma, Chenyang Yang and Christian Kästner found that 58.8% of prompt and model combinations lost accuracy after an API update, and 70.2% of those drops exceeded 5 percentage points. Across updates, 10.9% of individual predictions regressed and 63.8% of those failures occurred at maximum confidence, breaking working predictions 87.9% of the time even when overall accuracy rose.

Researchers Emanuele La Malfa and colleagues at Oxford and the Alan Turing Institute warned in a 2025 AAAI paper — first published in Journal of Artificial Intelligence Research — that language-model providers deprecate models on short schedules, collect prompts under commercial licenses and alter serving layers while keeping your pinned model ID unchanged. The end customer takes the hit and is forced to reinvest in adapting to another model that’s not smarter but cheaper to run.

Anthropic is currently defending against a consolidated consumer class action in California federal court (In re Claude Service Degradation Litigation, No. 3:26-cv-07699-RFL) alleging that the company wrongfully degraded its paid Claude Pro ($20/mo), Max 5x ($100/mo), and Max 20x ($200/mo) tiers between March 4 and May…

Opening of the article, excerpted from Entrepreneur. To read the rest, open the article on the publisher's site.

Read the full article on Entrepreneur Sign in to save

MarketNews shows the headline and summary published by the outlet. The full article is on the publisher's website. (www.entrepreneur.com)

Also worth reading