logoalt Hacker News

modzuyesterday at 3:15 PM2 repliesview on HN

brains do it with 20 watts because theyre analog. llms require massive amounts of power and this isnt changing any time soon without a breakthrough


Replies

Arwillyesterday at 6:19 PM

There are arguments that the brain is quantum, as in parts of it locally using quantum effects. Which if true, might make a counter-argument, as there will be bigger data centers needed if the goal is to simulate the brain classically.

On the other side, advancement in quantum computers would make current LLM inference much faster. Because of the extreme cooling needed, i dont think the energy demand would become less.

With AI companies talking about AGI, i sometimes wonder if they really need the machines for serving inference to customers, or they have a formula for computational capacity that could run an AGI, and they just want to reach that level.

show 4 replies
dofmyesterday at 3:22 PM

And a breakthrough in hardware, specifically.

show 1 reply