logoalt Hacker News

nr378 • today at 2:30 PM • 5 replies • view on HN

It seems like OpenAI are trying to frame this as if AI did all the work here, but it's not really true given what Calif say (https://calif.io/php2shell/):

> How did we find this?

> No special harness, or access to models that weren't generally available to everyone were used in the initial bug discovery. I focused on something I had a background in, knew its vulnerability history well, and held a theory that specific bugs lurk within the codebase. This shows that "know your target" is still as applicable as ever, even in the LLM dominated VR age. No model is simply capable of unearthing "all bugs" with simple prompts. At least for now.

> There are some practical research implications here. LLMs may have ingested public historical vuln data, but in their default variant analysis tends to move from the newest and most prominent bugs toward nearby older code. They do not reliably begin with obscure twenty-year-old exploitation primitives. Keeping your own mental catalog of a target's vulnerability history lets you prompt that direction explicitly.


Replies

senordevnyc • today at 4:11 PM

They literally open by saying Calif used GPT 5.6 Sol, which is a widely available model. Yes, the person driving did more than "find all the bugs", but nowhere does OpenAI imply otherwise.

➕ show 1 reply
Jeep_ • today at 2:38 PM

Pure marketing, it's getting increasingly hard to separate actual technical feats of agents from marketing pretentious declarations. Such a terrible environment to navigate right now.

➕ show 4 replies
lukewarm707 • today at 4:10 PM

OpenAI: your misfortune is our PR opportunity

Frieren • today at 2:39 PM

> OpenAI are trying to frame this as if AI did all the work here

CEOs of all big corporations are constantly lying and misleading the public, investors and shareholders. That is a crime. A shame that it is not enforced anymore.

mentalgear • today at 3:52 PM

Just more IPO shilling from the scam-man.

➕ show 1 reply