If turning other peoples copyrighted work into a model is transformative enough to be protected then so is distilling that model into a different, better, model.
The models were built using copyrighted works, so why can't models be built using other models?
The models were built using copyrighted works, so why can't models be built using other models?