alt Hacker NewsAre you sure about that ? Because the very next tweet says:
> Distillation can be legitimate: AI labs use it to create smaller, cheaper models for their customers.Are you sure about that ? Because the very next tweet says:
> Distillation can be legitimate: AI labs use it to create smaller, cheaper models for their customers.
That's just in reference to the technique itself. They're basically saying it's okay for Google to use distillation to train Gemini N Flash using Gemini N-1 Pro (which they do).