logoalt Hacker News

LaurensBER • today at 6:02 PM • 3 replies • view on HN

Another day where the Pareto frontier is moved up and to the left!

I haven't tried this model yet but Deepseek and the GLM 5.3 series do feel like "enough" for a lot of tasks, it's pretty amazing to see that we're still getting better and cheaper models all the time.

I only wished they would focus more on wall clock time. For a hobby project I do not mind that a cheaper model takes twice as long but at work it's hard to justify using a "cheaper" model if the time per task is so much higher than the frontier models.

The amount of time that it took to complete a benchmark is almost never shown in these kind of releases.


Replies

theanonymousone • today at 6:04 PM

> Another day where the Pareto frontier is moved up and to the left!

It actually hasn't, it seems: https://news.ycombinator.com/item?id=50151775

rskeens • today at 6:11 PM

Would place DS 4.1 1017 roughly equivalent to GLM 5.3 which means it's targeted to price rather than direct capability. Probably why they listed DS adjacent in the comparison table when according to their results more expensive models are beaten by it.

➕ show 1 reply
antisthenes • today at 6:10 PM

You do realize that there exist multiple Pareto frontiers, at least for every arbitrary combination of parameters for a given benchmark?

Obviously your marketing team is going to use the Pareto frontier where your model has improved the most and compares favorably against competitors.