logoalt Hacker News

mentalgearyesterday at 8:15 PM1 replyview on HN

Maybe you haven't noticed that the "Bitter Lesson" had itself a "Bitter Lesson" - that scaling pure data and compute did not lead to AGI: diminishing training returns, GPT-5 disappointment, even openAI stating it was the last 'pure scale' model.

The path forward all big llm providers ("ai" labs) have gone is neuro-symbolic (even though they publicly would never labeled it as such to not admit critics like Gary Marcus were right - even though all their actions actually point in that direction).


Replies

hbogertyesterday at 8:26 PM

Neuro symbolic, rly? Can you please elaborate what it is that made you conclude that?

show 1 reply