alt Hacker NewsConcidently, I asked Claude yesterday whether we have crossed the point that there is more compute and memory in the cloud or in personal computers.
It claims fp8 and fp16 has had higher throughput in the cloud since 2023.
fp32 and general computing still has more compute than personal computers.
And that memory is at the crossover point, but at this point only 10% of memory is going to personal computers, so the next few years will radically change the pc to cloud memory ratios.
https://claude.ai/public/artifacts/8733239a-328b-4aaa-8d76-0...
Anyway, all of this made me a (tiny bit) sad. It is the gradual end of general purpose computing you own, and the start of everything just being cloud compute that someone else owns and you rent.
Replies
It's interesting to note that the total compute forecast to be deployed in 2026-2027 is more than the amount that has been deployed during human history.
I agree with the sentiment, but there is a devils' advocate argument:
Most compute loads are bursty. Most PCs and phones sit idle almost all the time. It's an inefficient use of capital. In the cloud you can be idle and then suddenly command 1000X more power than any affordable PC could ever have... for 10 seconds... then be idle again. Those kinds of work loads aren't possible to realize on a PC without massively overbuying hardware.
I'd like to see more research on secure private cloud computing. Homomorphic encryption has gotten better but is still very slow, but there's other approaches that can help quite a bit but don't require much of a performance hit. Look into secure multiparty computation, reversible anonymization, etc.
I don't think personal computing will die, but I think it'll go back to being a hobbyist and pro thing like it was from its birth in the 1970s up until the middle 1990s. In the 1980s the average person did not own a computer, or if they did it was just to play some games. The average person was not loading BASIC programs off bootleg tapes and calling BBSes.
BTW I've been thinking a lot lately about how AI could save personal computing by allowing us to create an off-ramp from the present rats nest of complexity to something saner and simpler. Just thoughts right now but it's interesting.
Nobody cares what Claude said. Why not tell us what you think?
> It is the gradual end of general purpose computing you own, and the start of everything just being cloud compute that someone else owns and you rent.
A few thoughts...
(a) There've never been more general purpose computers than there are right now. Spec progress may stall for consumer products due to the price increases, but the demand for workstations is not going to go down that much; they're critical items to get work done. Many are hoping this means a return to memory efficiency; the 8GB Macbook Neo is a good sign that this is something Apple believes to some extent also.
(b) We've arguably been doing this since the 90s. A website (especially in the days of the heavy backend and more passive client) is cloud compute that someone else owns. You rent it by paying them in the form of looking at ads...
(c) There are a lot of companies and people working on making sure you have every chance to run your AI locally. It's surprisingly good now and keeps getting better. At some point we'll see the same oscillation that we always do from thin client to fat client as the latency advantage of working at the edge starts to win out. How long until I have a laptop with a Talaas chip in it running a basic local model at 16000 tok/sec that is just good enough to use A2A to reach a more powerful agent running elsewhere if I need it?