alt Hacker News100% LLM’s are very unlikely to get there. They’re fundamentally not suited to thinking like we do. They work on the abstraction of what we’ve written down, which is a good trick but barely hold it together when things get hard/novel.
However, all the confident “it’s fine” votes assume we never invent a better architecture than LLM’s. Given the level of investment and race between countries, it’s not a reliable bet. It’s much, much harder to guarantee safety than it is to find ways it could go wrong.
Replies
I agree with this. It's concerning where we might be after several more large breakthroughs. None of the technology we have right now seems likely to get to that level
Erm investing in risky projects requires expected returns that get delivered.
We will soon find out if the party ends or continues to go on.
Hype might get you capital gains. But cash flows matter.
[dead]
> They’re fundamentally not suited to thinking like we do
LLMs with CoT are Turing-complete. So, theoretically, they can implement any kind of finitely describable algorithm (barring super-Turing computations).