alt Hacker NewsIs this the largest ever open weight model release by parameter count? I think it is.
Replies
Mercuriusdream • today at 4:53 PM
KIMI K3 was the biggest open weight release afaik; It is 2.8T-A100B if I'm correct
Is this the largest ever open weight model release by parameter count? I think it is.
KIMI K3 was the biggest open weight release afaik; It is 2.8T-A100B if I'm correct
No, Kimi k3 is 2.8T params. This is 2.4T params but ~5TB weights because it was released in bf16 and ~2.5TB for the fp8 version. Kimi k3 launched with QAT 4bit, so ~1.5TB weights.