alt Hacker Newsjust curious, how do we know that le chonk isn't just a fine-tuned chinese model? and/or distilled from US models?
Replies
Iolaum • yesterday at 3:17 PM
Once it's open weight people will be able to inspect and compare it's tokenizer, architecture etc and tell.
➕ show 1 reply
karp773 • yesterday at 8:16 PM
It would not take them so long to train it. Their pace would be closer to the Chinese models.
It's in the announcement: "ML4 was trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral’s own datacenters in Europe".
https://mistral.ai/news/mistral-large-4/