Which is a new architecture.
It's not "some new kind of architecture comes along". It's been done before many many times and it's a very basic change, turning off a specific optimization. And it's a perfectly good style of LLM so "inherent flaw" isn't true either.
alt Hacker News
It's not "some new kind of architecture comes along". It's been done before many many times and it's a very basic change, turning off a specific optimization. And it's a perfectly good style of LLM so "inherent flaw" isn't true either.