logoalt Hacker News

IshKebabyesterday at 9:04 PM3 repliesview on HN

> Is the code bad? It sounds like they had no idea he was using AI. That seems to imply there was nothing wrong with the code as-is. Why not judge it on it's merits?

Anyone that has used AI at all knows this isn't how it works. AI is extremely good at producing plausible-but-wrong outputs. It's literally optimised for plausibility, which happens to coincide with correctness a lot of the time. When it doesn't you get code that seems good and is therefore very difficult to judge on its merits.

With human written code it's a lot easier to tell if it's good or not.

There are exceptions to this - usually if you have some kind of oracle like that security work that used AddressSanitizer to verify security bugs, or if you're cloning a project you can easily compare the behaviour to the original project. Most of the time you don't have that luxury though.


Replies

SchemaLoadyesterday at 11:39 PM

It's also easy to overwhelm reviewers with far more code than they can possibly review. And it's also the hardest stuff to review where the code at surface level looks totally fine, but takes long hours of actual testing to make sure it works.

doug_durhamtoday at 1:58 AM

Just read the code. There is nothing keeping people from reading the code.

show 2 replies
securicattoday at 4:24 AM

Do folks not write tests and review their own code (AI generated or not)?

Also, citation needed:

> With human written code it's a lot easier to tell if it's good or not