logoalt Hacker News

__0x01today at 4:41 AM1 replyview on HN

> Correctness: 1,778 test cases from the official jsonata-js test suite + 2,107 integration tests in the production wrapper.

The AI generated code can still introduce subtle bugs that lead to incorrect behaviour.

One example of this is the introduction of functions into the codebase (by AI) that have bugs but no corresponding tests.

EDIT: correct quotation characters


Replies

sethammonstoday at 7:41 AM

AI will happily update tests to be wrong or miss the intention of the code and test the wrong things.