logoalt Hacker News

usr1106 • yesterday at 2:32 PM • 3 replies • view on HN

So you assume code written by the agent canno be trusted? But how comes you are trusting the tests?


Replies

alemanek • yesterday at 5:44 PM

At my work we still have a QA dept that runs the manual test suites before each release. We have also automated almost all of those manual tests and they gate every merge to mainline.

Things are still found but normally it is a new test case or an edge condition we don’t have an automated test for. The ever growing e2e suite has reduced the amount of regressions pretty drastically.

EDIT: I forgot to note that automated e2e tests were always the answer to improving quality. AI has just made it cheap to have several layers of test coverage.

voakbasda • yesterday at 4:14 PM

To start, you make it a rule that every test must pass with the fix being tested, and it must fail if the fix is missing.

BonerWiener • yesterday at 3:07 PM

You of course use another AI to test your tests, have you been living under a rock? /s

➕ show 1 reply