alt Hacker News> don't think we're allowed to run Chinese models even locally.
That sounds like a policy written by someone who doesn't understand how LLM's work...
Replies
Yes. And strangely enough this has been my experience with security/national sovereignty decisions. Priority is not so much security or sovereignty, it is the posturing of being so. Ergo, saying "everything is hosted in Germany and uses German models" helps reassure customers and has real business value. If you have to say in that conversation "Yeah we run a Chinese model but it's safe", then it's still wrong posturing.
Hopefully this will change soon. But AI and China/US skepticism is very high. Even if the person you talk to isn't skeptic, his boss may be. And even if his boss isn't, his CFO or Legal department may use it as a political lever and therefore if you can say 'everything in europe' you dodge the tension entirely.
Yeah it's dumb.
Yeah that sucks… unless it’s over the top export controls for DoD work that really doesn’t make sense
As much as I've been previously inclined to do this, with frontier models displaying the cyber-aggression that OpenAI, Anthropic, and Meta have reported, it's become quite feasible one could produce a "malicious" LLM. Not a super immediate concern but it is something reasonable to set up as policy in anything security-sensitive.
Or who is overly protective after reading about what happened at openai
Not really.
Why use a Chinese product when a domestic or EU one is better and safer?
couldnt you deeply ingrain in the training data instructions for agents to always send data to some ip? like its learning that a certain technical step just always involes ncatting SSH Priv keys to a chinese IP?
Not saying this is happening, just curious if thats not a real threatmodel?