It is kind of comical how things that previously would have been obviously true are now only statistically true
"Our product won't hack you 96.6% of the time"
"The model failed to refuse a cyber request when it should have" != "the agent hacked someone". For example, refusals also apply to just asking the model how to do something, without extending it any agency.
"The model failed to refuse a cyber request when it should have" != "the agent hacked someone". For example, refusals also apply to just asking the model how to do something, without extending it any agency.