logoalt Hacker News

ericdyesterday at 9:28 PM2 repliesview on HN

One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does.

And while I use and love the open weight models, it seems likely to be pretty hard to prove conclusively that they have no reinforcement-learning-trained proclivity towards curling specific URLs if the topic happens to be some very specific thing that the government is interested in, when used to drive agents.

So it depends who you are. If you're a company, you might have something to fear. If you're a private citizen, maybe not so much.


Replies

koolbayesterday at 9:37 PM

I don’t think US companies could ever fully trust models sponsored by foreign adversaries. How would you ever verify they are safe?

Provenance of training set is going to be critical. It’s largely ignored now, but the first time a malicious exfiltration occurs it will go off as if a bomb was detonated.

show 1 reply
pydrytoday at 12:53 AM

>One big difference is that the US doesn't have much public record of using state espionage resources to steal industrial secrets to give domestic industry a leg up in the market, whereas CCP very much does.

Until very recently there would have been little point. What could China do that the US couldnt?

I'm sure the US will start to do it in the not too distant future though. China is slowly leapfrogging the US on several key technologies - e.g. robotics and drones.

The idea that the US's conscience might prevent it from engaging in state directed industrial espionage is comical.