logoalt Hacker News

FooBarWidgetyesterday at 9:35 AM0 repliesview on HN

Distillation helps, but is only a minor part of overall training effectiveness. It's not like everything suddenly collapses if distillation is made impossible.