logoalt Hacker News

mixdup • yesterday at 5:25 PM • 10 replies • view on HN

Another piece of evidence on the pile that the sudden panic and desire to "slow down" is because they're hitting the plateau on capability

Which, honestly, is fine. A lot of juice to squeeze in efficiency and even if models got zero more capable, making the capability that is already here cheaper is a huge win for everyone (except Nvidia)


Replies

luma • yesterday at 6:05 PM

Some version of this claim has been made for the past 4 years. There's a data cliff, there's no more compute to buy, the financials don't make sense and all of these orgs will be out of business by end of quarter.

Not once has any of these predictions come true, the pace of progress has continued on it's exponential trajectory since ChatGPT first came to the public's attention.

So why now? What is special about today that suggests all of this is coming to a screeching halt despite all evidence to the contrary?

➕ show 9 replies
CuriouslyC • yesterday at 5:38 PM

It's not so much that they're hitting a plateau in capability, as we're saturating long horizon benchmarks and it's not greatly improving general usability. On the other hand, newer models have been amazing for people interested in 3d, graphics, video editing, etc. The difference between Opus 5.5/Astra and earlier models is night and day even if for many coding tasks they're not a revolution.

➕ show 1 reply
sebzim4500 • yesterday at 5:58 PM

Is there anything that could happen that you wouldn't use as evidence that they are hitting a plateau?

It just seems like these claims are constant and looking back the calls of 'plateau' between 2023 and 2025 were clearly false, why should we think it's different now?

➕ show 1 reply
LPisGood • yesterday at 5:30 PM

Nvidia can start putting weights in silicon if model development slows down.

theturtletalks • yesterday at 5:32 PM

I think they are hitting compute restrictions. And buying compute right now can be 3-4X. And the costs are increasing. If they train a larger model and demand is high, that’s a lot of compute for Codex subscriptions, which is a loss leader for them. Especially Pro 20X which they just nerfed to 10X.

serf • yesterday at 5:30 PM

>Another piece of evidence on the pile that the sudden panic and desire to "slow down" is because they're hitting the plateau on capability

if true then LLM related AI (post-post AI winter AI?) is probably one of the fastest inception-to-plateau tech sectors to have ever existed.

We're still improving transistors on a somewhat routine basis.

➕ show 1 reply
semiquaver • yesterday at 5:28 PM

What universe do you live in that you can look at the past six months and see anything like a plateau in capability?

Edit: removed a comment that was uncharitable and rude, for which I apologize.

➕ show 4 replies
colechristensen • yesterday at 5:35 PM

>Another piece of evidence on the pile that the sudden panic and desire to "slow down" is because they're hitting the plateau on capability

I think it's more a token-cost-demand plateau. They've reached the scale and investor trillions to which they can't 10x the hardware cost of inference any more. They can't afford to compete by eating costs and there isn't appetite for more expensive inference.

So in order that they don't bankrupt each other they're looking for the legal cartel behavior coordinating a stop to growth by convincing governments to regulate them into stopping.

There's a lot of juice to squeeze in efficiency but only so much whereas it seemed like capability was going to continue to scale with parameter count.

Maybe it's good news for everyone that model capability is now going to scale on semiconductor cost meaning huge players are going to be very motivated to make semiconductors cheap.

xienze • yesterday at 5:38 PM

> sudden panic and desire to "slow down" is because they're hitting the plateau on capability

I don't think that's the motivation, it's because both companies want to IPO and the _only_ way to even hope to be profitable is to do a whole lot less training, which costs a fortune. But unless Chinese labs go along with this gentleman's agreement (they won't), slowing down on training will bring about the inevitable Chinese model parity date more rapidly. At which point the game is well and truly over for OpenAI and Anthropic. Bit of a pickle they've gotten themselves into with the emphasis on being best, with premium prices to match.

➕ show 1 reply
azan_ • yesterday at 5:50 PM

> Another piece of evidence on the pile that the sudden panic and desire to "slow down" is because they're hitting the plateau on capability

People were talking about plateau for years already.