This is adapted from Microsoft research's YOCO. It was known for a while(2024!).

Yes, credit to Deepseek for actually scaling it up and releasing a frontier flash LLM.

Edit: the rest of this thread has become a US China infowar theory culture war. I am not of either of these countries and the above comment isnt meant to implicitly support either "side".