Now, they were to lazy to do this most likely, but even this is no golden ticket.

Your test has to incorporate the same tooling and pressure as your tests do, or you may never trigger the needed conditions for it do more and more desperate things. Test and QA systems commonly fail like this versus when standard software runs in production.

The other thing you have to worry about is the AI detecting it's in a test and intentionally being daft. Yes, this is a thing AI can do when it detects it's being tested.

I wonder why the hell didn't they come up with it since it's the first thing that came to my mind as well and I'm not really security minded apart from trying to avoid the dumbest mistakes. Don't they hire super smart security people with their budgets?