logoalt Hacker News

drillsteps5 • yesterday at 10:23 PM • 1 reply • view on HN

Currently (17:22EST):

> Previous status: We're continuing to work through restarting and validating the affected servers to safely return them to service, and we're exploring opportunities to expedite this process. In parallel, we're assessing whether reverting the small number of recent configuration updates we identified could help accelerate recovery.

If failures started at some point in time then something must have changed just prior to that. If no changes in traffic were detected (no DDOS) then it must have been a change, be it code or config. Duuuh.


Replies

esseph • yesterday at 11:26 PM

> then something must have changed just prior to that

Not at all, they could have simply hit an unexpected behavior for their infra they hadn't seen, tested, or expected before. Global scale infra gets very, very complex, and tbh this is Microsoft... they're not very good at it.

➕ show 1 reply