These benchmark numbers are insane. The days when China was 6 months behind are over? How are they doing this with so much less resources than the US??? I have so much respect for the researchers there
Mythos/Fable-class models have been around for at least 4 months internally in the US, and Kimi still isn't quite there, so I'd say the 6-months is still about right.
Backed by Alibaba, so not really resource constrained, but obviously much less than Ant/OAI. They did a spectacular job, congrats!
I'm not sure where "so much less resources" comes from. Training the best model has nothing to do with having the most NVIDIA GPUs around. If that were true then xAI would have the best model. It comes down to the quality of data, research, and financial backing.