logoalt Hacker News

slibhbtoday at 7:41 PM1 replyview on HN

Of course it matters. Regardless of whether distillation is legal, there is a difference between training a model with and without distillation. For one thing, the distilled model wouldn't exist without the model it distilled.

Also, companies that use distillation may be competitive but seem unlikely to surpass the companies that are training these models from scratch.


Replies

bilbo0stoday at 9:31 PM

>but seem unlikely to surpass the companies that are training these models from scratch

Then why is it a problem?

Another serious question.

Trying to get my head around what the root of the objection is here. There must be some fear, but if that fear is not a fear of being surpassed in the market, then what is the fear?

show 2 replies