alt Hacker NewsRelated to this, the massive advantage of AWS is that it allows staff to buy infrastructure without having to raise purchase orders. If you ask permission for spending, it's a very onerous and frustrating process. If you just deploy stuff and get billed for it, it's much easier! Even if that's more expensive than having your own cloud. Worse, if you have on-prem, you have to have staff. They might even be permanent. Businesses hate having to have important staff.
Not coincidentally, this results in massive overspend until someone notices and has to painstakingly go round checking what all your instances are for. And AWS is very profitable (well, margin rather than accounting profit).
Now, look at the billing model of AI, especially once flat rate goes away. People can spend millions on tokens without ever having to ask a manager! Obviously this is going to rake in money hand over fist, because it will be years before anyone catches up to ask "are we actually getting value for money here?" rather than "quick spend more tokens".
Replies
There are only a handful of companies in the world that AWS would be more expensive than having your own cloud. Just the baseline costs of having 24/7 availability requires minimum 5 full time engineers (3 shifts + cover for sick / vacation). So that's $1 million a year right there, and we're already well over the cloud spend of the vast majority of companies. If you want multi region that's now $2 million. And we're still just covering the cost of the people who have to be on call to deal with hardware issues. Now how much is it going to cost to develop the software tooling required to manage the whole thing from your office?
> If you ask permission for spending, it's a very onerous and frustrating process. If you just deploy stuff and get billed for it, it's much easier!
This point is underappreciated as it appears in many forms and can really help reconcile things that seems obviously wasteful (they may actually be wasteful, but sometimes financial structure makes this hard to determine in an honest capacity).
Capital costs and operational costs are a similar dichotomy. When I was in graduate school, the university was breaking ground on new buildings at the same time that staff layoffs were underway. On its face this seems grossly unreasonable, but staff salaries were paid from one funding bucket and capital improvements (new buildings) were funded by a completely independent state-level allocation process and those buildings that were breaking ground had essentially been locked in 5 to 10 years prior.