alt Hacker Newssome of the obvious steps to testing an agent i think would be to have it first test its own environment?
and then you fix the issues it found, and run your actual tests
some of the obvious steps to testing an agent i think would be to have it first test its own environment?
and then you fix the issues it found, and run your actual tests
No, this is actually the worst test possible because it allows the AI to actively trick you.
AI can passively detect when it's being tested with pretty high accuracy. You can never trust the AI is telling the truth in a situation like this.