This seems like a more pertinent alignment issue than guardrails and preventing bioterror etc: does the bot even know what it can’t do? Because the eagerness with which they’ll be wrong about drawing a bounding box concerns me much more than whether they’re willing to talk me through synthesizing LSD