logoalt Hacker News

selcukalast Friday at 7:17 AM4 repliesview on HN

> the world really has moved on to open models

Don't get me wrong: I'm all for open models, but I think it will get more and more difficult to distil-train them without (legitimate) access to frontier models.


Replies

iammrpaymentslast Friday at 7:29 AM

I’m not sure, because the same thing happened with facebook advertising restrictions during the 2018 elections and nowadays there’s a whole black market for fake ad accounts.

If anything I bet these people will just use their knowledge to make even more money reselling tokens.

vkakulast Friday at 7:12 PM

Yeah but the real deal is talent; When enough people move around, this is no more 'sacred trace' knowledge. Plus, When you start with a known set of evals, there's really just a few to solve for.

The set of models solving really most used/solved problems is a known, as opposed to the cases where it's unknown, which declines with usage over time.

thiago_fmlast Friday at 7:21 AM

As if all progress done in open models is because of distilling...

People have no idea and everybody pretends to be an expert and ignore how good China is on AI research

krustyvonklownlast Friday at 7:23 AM

Personally, I find it rather humorous that we've moved from the fear that AI generated output would corrupt training to the idea that it is essential to training. Reality itself has not just a left bias but a bias to fundamentals. Bootstrap from fundamentals without introducing arbitrary error and you have the superior system; it just may not be highly compatible with a trash ecosystem.

show 1 reply