logoalt Hacker News

aenis • today at 3:29 AM • 2 replies • view on HN

I think it's not generally 'much better' to use alerts. People - end users - are by now quite used to seeing things go down for a while. No biggie. But a infra oopsie can kill a company in ways a short outage won't.

And its of course not just people yolo'ing with AI. People were quite capable of causing such outages themselves just fine. Distributed, serverless systems are hard.


Replies

bluGill • today at 5:54 PM

Alerts are only good if somebody responds to them each and every single time. If you don't have someone with authority who can respond to every alert and will do that as part of their job, then they're worthless. Part of responding of course is understanding what it means.

traceroute66 • today at 9:44 AM

> I think it's not generally 'much better' to use alerts.

Anyone who says its 'much better' to use alerts instead of hard caps needs to Google 'alert fatigue'.

Alerts are soft. You ignore them or miss them, nothing happens except you spending $$$$$$$$$$ more.

Great if you're the cloud provider raking in the cash, but a poor way to run your infrastructure.

Hard caps force you to implement correctly (to control costs in the first place) and have correct monitoring in place (to keep a healthy cap buffer).

So it means you can't just vibecode some slop and blindly devops it via Github CI/CD. You actually need to think and reason about your infrastructure.