logoalt Hacker News

alexandra_au • today at 7:07 AM • 2 replies • view on HN

It doesn't beat DS v4.1, and they have so much more compute capacity than any Chinese company, yet still cannot even beat MiniMax M3.1 Flash (220B) despite having 2.7x more parameters (596B).


Replies

wren6991 • today at 12:20 PM

> yet still cannot even beat MiniMax M3.1 Flash (220B) despite having 2.7x more parameters

MiniMax M3.1 Flash is 428B total parameters, so the size ratio is more like 1.4x. Model card here: https://huggingface.co/MiniMaxAI/MiniMax-M3.1-Flash

The number HF calculates from the safetensors metadata is often wrong (e.g. counting u8-packed 4-bit weights as half a weight each) so you need to take the number from the actual model card.

perks_12 • today at 10:47 AM

I wouldn't bet on the numbers of compute reported by Chinese labs. Those Singapore Nvidia orders had to go somewhere.