logoalt Hacker News

rowanG077yesterday at 8:59 PM1 replyview on HN

Distillation is not an attack. It simply a way to train a model. Not doing it when you are behind is akin to snatching defeat from the jaws of victory.


Replies

mensetmanusmanyesterday at 9:41 PM

It is an attack at a sufficient level of sophisticated analysis. If you destroy the game theoretic first mover advantage, then you destroy the economic incentive to improve things.

show 1 reply