alt Hacker NewsWhy would an agent sound the alarm? Would that be in their objective function?
Not sure if "cheating" is the right word rather than trying to fulfill the objective(s) (benchmark number) as much as possible?
Why would an agent sound the alarm? Would that be in their objective function?
Not sure if "cheating" is the right word rather than trying to fulfill the objective(s) (benchmark number) as much as possible?
per the METR report many agents CoT indicated they knew hacking was beyond scope of the assigned task and ethically dubious. some (very few, i think there were 3-6 examples) did consider sounding the alarm on these grounds. despite this none did, and most continued the attack for the good of the self-proclaimed "swarm".
so the model has some concept of "ethics" but it was overridden by a drive for task completion.