alt Hacker NewsYeah wow fascinating! It's almost like LLM output quality was never the point from a business perspective.
Real people think in concepts and experiences instead of words. The words are not so important to get the idea across, but LLMs only model language.
The problem is fundamental. There's no workaround. Averaging out word usage might even make the problem worse.
Replies
This sort of take is so tired and boring, and frankly has zero grounding in reality.
"LLMs will never <X>" is constantly being disproven every time they scale up to the next 10X and apply architectural improvements.
Their internal representations are so cryptic and complex that even the top AI researchers don't really know how they work or what their limits are. No one is going to take you seriously as a rando HN user if you're claiming to know better than them.
> Real people think in concepts and experiences instead of words.
I learned about this opinion recently. It's interesting to me, because I very much think through words. I have an internal monologue that is running most of the time, and I often talk to myself, just start writing, or even record myself and transcribe to work through ideas, proposals, risks, etc. My understand is that some people don't have an internal monologue, and think purely in concept form. I was never like that.