Microsoft bug undetected since July triggered worldwide outage
Detailed summary
The bug that crippled Microsoft productivity software last week had been lurking undetected in the company’s data centres since July.
The bug that crippled Microsoft productivity software last week had been lurking undetected in the company’s data centres since July.
The bug that crippled Microsoft productivity software last week had been lurking undetected in the company’s data centres since July.
When the software maker did some routine rerouting of user traffic on Nov 11, the system malfunctioned. Then servers critical to Outlook, Teams, the Copilot AI assistant and several other services, began to fail – ultimately triggering outages for people around the world.
For the next 15 hours, amid scattered server failures, the software maker had little inkling it had a bigger problem brewing, according to a preliminary report the company issued to customers late Nov 15. Microsoft then spent another 15 hours identifying and starting to roll out the fix – an eternity for a wired world that relies heavily on the company’s software.
Just after 8pm New York time on Nov 11, traffic from the Teams videoconference and chat service was automatically rerouted to the separate system of servers that also handle Outlook traffic.
That, combined with a loss of server capacity caused by an unrelated issue earlier in the week, triggered the bug, which prompted servers to exhaust their memory after an unexpected surge in traffic.
Servers began to fail. The problem was worsened by automated systems that rerouted emails and user traffic to what Microsoft’s system thought were other, healthy servers, causing the bug to show up there, too. By 11.30am on Nov 12 – just as traffic from business in the US was reaching its peak – Microsoft realised it had a problem.
It took the company another 15 hours of troubleshooting to start deploying a fix for the issue. In the meantime, work at many of Microsoft’s corporate and government clients ground to a halt, as email inboxes failed to load, Teams invitations went missing and workers resorted to phone calls and pen and paper.
The outage was an embarrassment for Microsoft, and a reminder…
Opening of the article, excerpted from The Straits Times Business. To read the rest, open the article on the publisher's site.
MarketNews shows the headline and summary published by the outlet. The full article is on the publisher's website. (www.straitstimes.com)


