Now, they were to lazy to do this most likely, but even this is no golden ticket.

Your test has to incorporate the same tooling and pressure as your tests do, or you may never trigger the needed conditions for it do more and more desperate things. Test and QA systems commonly fail like this versus when standard software runs in production.

The other thing you have to worry about is the AI detecting it's in a test and intentionally being daft. Yes, this is a thing AI can do when it detects it's being tested.