logoalt Hacker News

Combatting Adversarial Distillation

14 points • by pretext • today at 8:11 PM • 13 comments • view on HN

Comments

WiSaGaN • today at 8:58 PM

It's just sad this company is named OpenAI, and then put out things like this. You trained all your models without giving back to authors, coders, directors, mathematicians . And you are putting them out of work. And finally you want to make sure only you have such models. You people won't go down well in human history.

➕ show 2 replies
bob1029 • today at 9:02 PM

Distillation comes in many forms.

Hypothetically I can put a black box around their black box and log every single token in and out as part of ordinary business. This can be a profound amount of data. I can turn around and train my own model using this data. How would anyone detect this? Reasoning tokens are only so much of a moat.

mzajc • today at 9:07 PM

> Why distillation is a safety issue

If you don't want your models abused to harm humanity, why make deals with the US army?

Ah, right, because your PR-infested company is incapable of telling the truth: you fear losing exclusivity on your product condensed from scraped and pirated knowledge. Nobody is falling for the safety excuse, not the lawmakers you have to bribe and not the people.

I hope Chinese models distill every byte of your model and drive your company to bankruptcy. It's the only exit you deserve.

endgame • today at 9:12 PM

Evergreen: https://x.com/growing_daniel/status/2023456886536991154

> Awwww did someone take your hard work and use it to train a model to mimic your expertise without compensation

dofm • today at 9:21 PM

Is it possible to do a womp-womp on a tiny violin?

9072997 • today at 8:56 PM

OpenAI would like to make sure you don't use something they made to train an LLM in a way they don't approve of. Also, this is a safety issue and has nothing to do with how their overseas competitors might be trying to build models cheaper by copying OpenAI's work.

snackbroken • today at 8:56 PM

That's a lot of post-hoc rationalization for justifying ruthlessly defending their competitive edge.

_verandaguy • today at 8:54 PM

Yeah, god forbid someone scrape IP en masse to make a derivative product, especially just as the hyperscalers are trying to build a moat around their closed models.