Instructions are not guardrails. Best case, that just makes it less likely to do it
Even Claude admits this after a bit of prodding.
Even Claude admits this after a bit of prodding.