logoalt Hacker News

hn993302yesterday at 10:31 PM2 repliesview on HN

There's no moral high ground here, it's just that nobody would invest in training publicly usable models if they could be easily distilled. Not that I think there should be laws against it or that such laws would even work; they're going to have to protect themselves.


Replies

dannywyesterday at 10:56 PM

Fewer people would create scientific or artistic works if they could just be copied or used without protection either; or so is the premise behind copyright and intellectual property; even being deeply embedded into the US Constitution (Art 1, Sec 8, Clause 8).

There is sooo much irony here.

show 1 reply
stale2002today at 2:05 AM

> it's just that nobody would invest in training publicly usable models if they could be easily distilled.

Thats literally what is happening right now though. People are spending hundreds of millions on a training run, and then people are distilling them, fairly easily, and making cost competitive models.

We are seeing all of this in action right now.