logoalt Hacker News

buzzin__yesterday at 11:29 AM3 repliesview on HN

So, your conjecture is that the LLM's skill to detect bugs somehow magically disappears the moment they start writing new code?


Replies

williamdcltyesterday at 1:28 PM

I wouldn't say "magically", it's what happens with me and every other engineer I know: we're all detecting bugs and yet we're all writing them too. Not saying that LLMs work the same as humans, but saying it's not a logical fallacy.

ryukopostingyesterday at 12:11 PM

Actually yeah, that would align with my experience with it.

You're absolutely right! Let me fix that.

seanmcdirmidyesterday at 2:49 PM

No, the extra code velocity allowed by AI without proper QA support means there could have been a lot more bugs introduced into products over the last year or so, giving AI more bugs to find. It’s tongue in cheek but not completely uncalled for. It’s been long known that one dishonest way to inflate your bug fix count is to put more bugs into the product to fix. Goodhart’s law is merciless.