It's a binary blob created by a highly capable adversary. It surely has dormant capabilities activated with some keywords. It's the Trojan Horse. You wouldn't use a C++ compiler binary provided by CCP, right?
This. If the LLM has access to the outside world through its harness, then it can do real damage - data exfiltration, etc.
> You wouldn't use a C++ compiler binary provided by CCP, right?
Why not? Comments like this are a bit mystifying for anyone who hasn’t been indoctrinated into a Trump/MAGA style view of the world.
> You wouldn't use a C++ compiler binary provided by CCP, right?
Racism aside, one can prove a compiler is correct. It can be shown beyond a shadow of a doubt that a compiler produces correct output for a given input.
Would you use such a piece of software? Or is the boogeyman too scary?