alt Hacker News2.5x the scaling efficiency, so 4 times the price? What is happening here? Did the subsidies dry up with the discrepancy between chinese and US models?
Replies
petu • today at 3:29 PM
It's also 2.8x parameter count (1T -> 2.8T), likely higher activation per token (50B?).
Scaling efficiency simply means if you took the first small model and scaled it up to the big model it would take 2.5x the resources to run. Not the that larger model is going to be any cheaper.
Kind of like scaling your personal automobile to the weight of a semi, the semi is still going to be far more efficient in moving cargo, not that the semi will cost the same to operate as the original car.