logoalt Hacker News

vonneumannstanyesterday at 7:45 PM4 repliesview on HN

Crazy how their models always come out after the US labs and just lag the performance of top models. Almost like they are performing distillation attacks... how strange.


Replies

twobitshifteryesterday at 8:50 PM

distillation attack? why the violent word choice? When OpenAI crawled Github was that an attack?

MaxPockyesterday at 7:48 PM

Do you have moat if your advanced model can be distilled in a month or two ?

rowanG077yesterday at 8:59 PM

Distillation is not an attack. It simply a way to train a model. Not doing it when you are behind is akin to snatching defeat from the jaws of victory.

show 1 reply
PepegaRoachyesterday at 9:31 PM

[dead]