Moreover, reading a copyrighted book and learning from it is not theft.
Generating a set of weights is not learning.
Great! Neither is distillation then.
Machines are not humans.
Generating a set of weights is not learning.