I thought it would be interesting to look at some key figures vs another contemporary model in the same weight class (DeepSeek V4.1 Flash)
DS V4.1F Beam
LM total params 552B 501B
LM active params (prefill) 8B 23B
LM active params (decode) 16B 23B
N-gram/PLE params 196B 0
Pretrain tokens 45T 28T
Disk KV bytes/token (FP4) 890 No information
Vision Yes (pretrain) No
Weights available Yes (launch day) "This month"
Weights licence MIT Apache 2.0
At first blush the benchmarks are impressive, but to paraphrase Linus: "Talk is cheap, show me the weights." :-)
yeah agreed, let's normalize "show me the weights" in this era