alt Hacker NewsYou can argue that reverse engineering anything is as hard if not harder than engineering something. I can’t imagine distillation is any different.
You can argue that reverse engineering anything is as hard if not harder than engineering something. I can’t imagine distillation is any different.
Distillation is objectively easier than training a model from scratch, that's why all these Chinese labs are doing it.