logoalt Hacker News

torginusyesterday at 7:12 PM1 replyview on HN

The problem with this argument is that sharing model weights only has downsides for said foreign actor compared to providing a cloud service. Since the suspicion exists, security companies are going to comb over the weights and discover every hidden secret of the model, while with a cloud provider you send your most sensitive data to a remote server, and trust the AI lab wont train on your data, with the only shield being a TOS. While with a local modal, even sending a peep about your internal data without cause would be scandalous.

It's not even going to be a good honeypot - since said actor doesn't really provide inference, people will have to pay for and run the infrastructure of these models, which bad guys cannot even subsidize, unlike cloud based provides.


Replies

dilyevskyyesterday at 8:47 PM

> security companies are going to comb over the weights and discover every hidden secret of the model

is this even doable? it seems plausible the model can be order-66'ed without it being so obvious