logoalt Hacker News

Wurdantoday at 7:41 AM1 replyview on HN

There's no multi-party conspiracy theory required here. Events can have played out exactly as OpenAI and Hugging Face described, and OpenAI can also have reaped a huge amount of free marketing for the capability of their models from all this coverage (including your post). You're telling us to not be doubtful of the boy who cried wolf, when in actual fact the one doing the crying is the one training bigger and badder wolves (and trying to convince us that they hold the key to our safety from wolf attacks[1]).

Also, the last section of your post appears to imply that if the attackers have bigger guns then the only possible solution is to give the defenders bigger guns. You're openly supporting an arms race towards the most capable, least restrained models put in the hands of the most possible people. That's extremely concerning.

[1]: https://openai.com/index/scaling-trusted-access-for-cyber-de...


Replies

simonwtoday at 9:24 AM

I had real trouble deciding how to end this piece.

There's no easy answer here. All of the options are bad in different ways!

As a builder of software, I want access to the best possible tools to help me keep that software secure.

As a user of software, I want my software to be secure and I don't want bad actors to be able to access tool to help them exploit it.

Is the only answer here to have the AI labs make decisions over who gets access to the tools? What if they make mistakes in those decisions?

None of the options look good to me. I don't know what we should do here.

My hunch is that the open weight models are already forcing our hand. The dangerous capabilities are coming to everyone.