Memory in the cloud isn't free either.

1. Make shit inefficient software for basic tasks

2. Say it's infeasible to have enough compute locally to do basic tasks

3. Force usage of centrally controlled, subscription-based cloud software.

4. Capitalism win???!

Concidently, I asked Claude yesterday whether we have crossed the point that there is more compute and memory in the cloud or in personal computers.

It claims fp8 and fp16 has had higher throughput in the cloud since 2023.

fp32 and general computing still has more compute than personal computers.

And that memory is at the crossover point, but at this point only 10% of memory is going to personal computers, so the next few years will radically change the pc to cloud memory ratios.

https://claude.ai/public/artifacts/8733239a-328b-4aaa-8d76-0...

Anyway, all of this made me a (tiny bit) sad. It is the gradual end of general purpose computing you own, and the start of everything just being cloud compute that someone else owns and you rent.