logoalt Hacker News

wren6991 • today at 10:28 PM • 1 reply • view on HN

I thought it would be interesting to look at some key figures vs another contemporary model in the same weight class (DeepSeek V4.1 Flash)

                                DS V4.1F            Beam
    LM total params             552B                501B
    LM active params (prefill)  8B                  23B
    LM active params (decode)   16B                 23B
    N-gram/PLE params           196B                0
    Pretrain tokens             45T                 28T
    Disk KV bytes/token (FP4)   890                 No information
    Vision                      Yes (pretrain)      No
    Weights available           Yes (launch day)    "This month"
    Weights licence             MIT                 Apache 2.0
At first blush the benchmarks are impressive, but to paraphrase Linus: "Talk is cheap, show me the weights." :-)

Replies

laybak • today at 10:29 PM

yeah agreed, let's normalize "show me the weights" in this era