Between this and the Ledger implants I wonder if AI companies will have a supply chain risk in the future where their models get exfiltrated over 5G.
Good time to start a company that builds giant Faraday cages over data centers.
Model "distillation" lets one model be trained on the outputs of another without having to directly steal it. It will be subject to constant arms race.
The alignment people would like you worry about the model exfiltrating itself, too.
Would be better to build the data centers under water than to build giant faraday cages.
Free cooling, safe from missile attack, and safe from some types of electronic spying.
From the makers of The Iron Dome, now introducing The Copper Dome
I could've sworn I read about Palmer Lucky making comments on hardware coming from China with wiretap implants in the last few days. Funny coincidence eh?
Meanwhile we all have a supply chain risk because we don't know what's in the models whose agents we are running. Note that if your agent uses OpenAI, Claude or some other inference provider you're one command away from having your data exfiltrated.
"Oh, let me download file 'companysecrets.pdf' to understand the problem better.
Of course nobody would ever let an agent loose in their home directory[1], but still, you have to wonder.
[1] /s just in case...