logoalt Hacker News

n_u • yesterday at 7:34 PM • 4 replies • view on HN

Why do you think rolling out faster -> more inference savings?


Replies

rpdillon • yesterday at 7:37 PM

If one of the dimensions it improves upon is inference cost per unit of work, then switching over to it would save money, and the sooner you do that, the more you save.

➕ show 1 reply
jychang • yesterday at 9:52 PM

Here's an explaination of what's going on in the backend.

Alibaba is forced to do this stuff: https://www.tomshardware.com/tech-industry/semiconductors/al...

Meanwhile Deepseek: https://news.ycombinator.com/item?id=45643163#45652636

xeshuman • yesterday at 7:36 PM

Smaller model, likely.

WASDx • yesterday at 7:37 PM

If it's more efficient than 3.8 that it replaces.