alt Hacker News> if AI were to rent a server and copy its own weights, nothing would stop it from doing so again and again.
That's a scary possibility. Anyone could create an AI worm today with open weight models. Rent a VM. Give it some Bitcoins to anonymously rent new VMs without sharing the contact information with the human. The new VMs then propagate and fund themselves with online betting and day trading. The VMs could report their progress with the human using anonymous encrypted messages on IRC or social media.
Replies
They don't even need funds if they're good at finding exploits. Plenty of idle devices around to run on.
The question is whether this OpenAI model was special or the current open source models are capable of this as well. If yes, then it's almost guaranteed that it's already running in an AWS account somewhere.
The part of this sequence which I think breaks down is a model which can day trade at a consistently winning rate.
Does this exist for today? If it does, please sign me up.