logoalt Hacker News

fireryesterday at 8:47 PM1 replyview on HN

From what I understand, the copy fail bug was found by researcher who noticed something weird and then using AI to scan the codebase for instances where that becomes a problem.

I bet that with a slightly looser prompt/harness, the LLM could have found these twin bugs too.

Yet at the same time, I also think that if the human researcher had manually scanned the code, he'd have noticed these bugs too.

FWIW I do think LLMs are great tools for finding vulnerabilities in general. Just that they were visibly not optimally applied in this case.


Replies

aerodexistoday at 3:01 AM

They could also have found all these things at the same time - and are slow-rolling the disclosures.