> Open-weight means no guardrails.
We're going to live in that world forever now, capable adversarial models have already been trained and will be used in a large conflict.
The pragmatic issue is hacking, and current open-weight LLMs are already capable of it. Bioweapons and RSI are pie-in-the-sky theories that distract from the real-world situation that each government wants to exploit.
>Bioweapons and RSI are pie-in-the-sky theories that distract from the real-world situation
It wasn't long ago when automated hacking was a pie-in-the-sky theory.
Sometimes it's helpful to prepare for things in advance. An ounce of prevention can be worth a pound of cure.