logoalt Hacker News

trio8453 • yesterday at 12:19 PM • 4 replies • view on HN

How is withdrawing a paper irresponsible?


Replies

jansport123 • yesterday at 12:32 PM

it's like if you vibe coded something and the onus is now on the reviewer and the reviewer tells you your work contains bugs and is messy - that is not acceptable from the reviewers pov - why should the reviewer spend all his human effort, a scarce resource, reviewing your code while you've spent barely a fraction of his effort generating this. OpenAI is a trillion dollar company, surely they can verify stuff before pushing it out? The problem is not that they are solving the problems, they don't care at all about the actual process of doing mathematics. Using compute to mine problems and throwing results in github and letting human reviewers spend effort to correct these is not going to win them any favor. If OpenAI really cared about math, they would have someone on their side who actually understood the results they produced and was able to verify their correctness and educate others.

moregrist • yesterday at 12:23 PM

They only withdrew it after someone pointed out that it was a flawed paper.

In one case by asking Astra to review it.

Not exactly encouraging that they did their homework before publishing results.

➕ show 1 reply
spider-mario • yesterday at 12:28 PM

Withdrawing it, in itself, might not be, but it kind of skips over the part where they have a paper that warrants it in the first place.

mtlmtlmtlmtl • yesterday at 1:12 PM

Withdrawing it isn't irresponsible. I don't even think releasing it is, because that is often the best way to find problems with it; expose it to the wider research community. Doing PR victory laps based on unverified, unfinished work, on the other hand, is. It is well known, even scientifically demonstrated, that retractions or refutations get much less attention than the initial exuberant PR announcement. And thus this practice contributes to misinformation.

And just to preempt the kneejerk whataboutism: Yes, all of academia does this to varying extents, and the mainstream media are also complicit. And that is also irresponsible. And no, that is not an excuse for OpenAI. Especially when you consider that OpenAI actively portray themselves as some kind of moral arbiter on AI and "doing good for humanity". They should be held to the extraordinarily high moral standards they purport to hold themselves to.