logoalt Hacker News

Retric • yesterday at 1:09 PM • 1 reply • view on HN

The ratio between a single pass and multiple passes is unchanged when you throw more processing power at both.

In a human 30ms vs 3-4 seconds is a 1:100 ratio. Single vs multiple passes with an LLM varies but a 1:100 ratio isn’t unrealistic. So with enough compute and the right workload single vs multiple pass LLM could sit in that exact same 30ms vs 3-4 second timeframe.


Replies

hoppp • yesterday at 2:30 PM

Multiple passes doesn't make it system 2. The defining characteristic of system 2 is consciousness which is expensive and slows down the system.

So to talk about system 2 in AI we need to talk about consciousness. As long as AI is not officially conscious there is no System 2 thinking implemented

➕ show 1 reply