← Retour à la une
États-Unis · Magazines éco · Entrepreneur

Your Business Is Losing Money on AI You Don’t Control — Here’s Why.

Publié par Entrepreneur · États-Unis il y a 9 h
Your Business Is Losing Money on AI You Don’t Control — Here’s Why.
Entrepreneur

Résumé détaillé

Every silent AI update breaks your workflow, and you pay your provider an 85% margin to fix what it broke.

Ask yourself: how many times has your team asked for more budget due to inconsistent behavior from GPT or Claude? In Harvard Data Science Review, Stanford and UC Berkeley researchers Lingjiao Chen, Matei Zaharia and James Zou tested identical prompts on GPT-4 and GPT-3.5 across snapshots three months apart. GPT-4’s prime-number accuracy fell from 84.0% in March 2023 to 51.1% in June, while its chain-of-thought boost collapsed from 24.4% to -0.1%.

Everyday workflows suffered similar drops. On a happy-number task, GPT-4’s accuracy fell from 83.6% to 35.2%, while directly executable code plummeted from 52.0% to 10.0% because extra formatting broke pipelines. Instruction-following on answer extraction collapsed from 99.5% to 0.5% under the same model name and API.

A 2024 Carnegie Mellon and HKUST study by Wanqin Ma, Chenyang Yang and Christian Kästner found that 58.8% of prompt and model combinations lost accuracy after an API update, and 70.2% of those drops exceeded 5 percentage points. Across updates, 10.9% of individual predictions regressed and 63.8% of those failures occurred at maximum confidence, breaking working predictions 87.9% of the time even when overall accuracy rose.

Researchers Emanuele La Malfa and colleagues at Oxford and the Alan Turing Institute warned in a 2025 AAAI paper — first published in Journal of Artificial Intelligence Research — that language-model providers deprecate models on short schedules, collect prompts under commercial licenses and alter serving layers while keeping your pinned model ID unchanged. The end customer takes the hit and is forced to reinvest in adapting to another model that’s not smarter but cheaper to run.

Anthropic is currently defending against a consolidated consumer class action in California federal court (In re Claude Service Degradation Litigation, No. 3:26-cv-07699-RFL) alleging that the company wrongfully degraded its paid Claude Pro ($20/mo), Max 5x ($100/mo), and Max 20x ($200/mo) tiers between March 4 and May…

Début de l'article, extrait de Entrepreneur. Pour lire la suite, ouvrez l'article chez le média.

Lire l'article complet sur Entrepreneur Connectez-vous pour sauvegarder

MarketNews présente le titre et le résumé publiés par le média. L'article complet se lit sur le site de l'éditeur. (www.entrepreneur.com)

À lire aussi