alt Hacker NewsAlignment isn't alignment if it can be turned on and off at the whim of company employees.
This time the damage was minor, relatively speaking. What happens when a model just "testing its capabilities" breaks into banking infrastructure or government military assets? The damage could be catastrophic.
Replies
verdverm • yesterday at 6:33 PM
Alignment with who in what context? Likely an unresolvable debate like consciousness, where there is not single or right answer for everyone.
There's alignment (trained in the weights) and there are constraints (in the "server harness"). My take is that this model was not yet aligned and had no constraints