logoalt Hacker News

pimeystoday at 11:49 AM1 replyview on HN

Internal reports from company? Maybe not. I'm just saying you have to eval eval eval if you are working in this industry. There's a ton of victories in price, and price is right now the key thing all the customers are talking about.

It's not always Chinese models. For example GLM 5.2 just did not work for us at all. And Gemini is still the best cheap model for non-text agents.

If you don't have a good eval set and if you don't check the models weekly, you are missing on things. And Opus 4.8 is still the absolute quality king for agentic tasks. Too bad it's so expensive.

And the clearest thing here is that Fable, Opus, and Sol are all too expensive. I'd say a healthy 75% cut to token prices and they are back in competition.


Replies

c16today at 12:57 PM

> I'd say a healthy 75% cut to token prices and they are back in competition.

Surely you don't want them to be the reason the bubble bursts?

show 1 reply