What I don't see in the comments: "I had a specific problem I couldn't solve with the previous version of this LLM. But the improvements in this version unlocked the solution for me."
What I do see in the comments: subjective improvement in text generation, possibly lower cost, some optimism about code generation, but some skepticism too.
I use coding agents. To me they are very useful. But what I spend on them isn't going to support trillions of dollars in investment.
Commenters here likely haven't used it long enough to give non-superficial reactions. The customer quotes on the release page are all about it solving new problems, fwiw. We'll likely find out in the next few days how it really performs.
But yes, we might end up hitting the issue of "most jobs aren't solving hard problems" increasingly. The bigger potential benefit is higher trustworthiness, reliability/thoroughness, and squishy human things; people will likely continue to pay large premiums for those. "Solve it well and save time, long term". Those can be harder to see on a benchmark.
We rarely upgrade our phones or MacBooks because the newer version can do something the previous one literally couldn’t. Often it’s the efficiency, speed, battery life, etc, combined, that lets us push the hardware further.
I get your point, but we can only have groundbreaking leaps once in a blue moon. That doesn’t mean incremental improvements aren’t useful.
I think the trillions are built on expectations that your employer won't need to pay you a salary anymore.
I agree. But it seems like this site has become so radicalized that this measured take is now anathema.
I had two sessions this morning that prior fable and sol sessions were stuck on, where iterations just resulted in _different_ bugs. (One kind of tricky fe layout problem, the other was a backend refactoring that was complicated by trying to aggregate a couple prior sessions that crashed).
I summarized each into new fable 5.1 sessions, and both seem to have arrived at reasonable solutions that only need a few nits revised before they are commit worthy.