logoalt Hacker News

JoshTriplett • today at 7:09 PM • 3 replies • view on HN

Can confirm that current GPT (with no guidance) took 5 minutes to find what it claims are errors with counterexamples. (I have nowhere near the level of state-of-the-art mathematical knowledge and experience needed to validate them. I'm posting this solely as additional confirmation of "there may be issues with this proof that an actual mathematician together with LLM assistance would be able to properly evaluate".)


Replies

amritananda • today at 7:36 PM

I wouldn't be surprised if these models were aligned to extreme skepticism (to the point of hallucination) when e.g. a user proposes a solution to a Millennium Prize Problem.

➕ show 1 reply
tappio • today at 8:11 PM

Did you try the same with the other LLM assisted proofs? I would be curious what your GPT model says about them. I fed Alpöge and Anthropic statement and details to Gemini 4 hydrogen, and it said that there are "major problems and red flags in both the text and the current verification status", and that it is impossible to verify the 250k pages of slop, and there are there are "Extraordinary, unsubstantiated mathematical leaps in the sketch". So I would take these surface level reviews by LLMs with a grain of salt.

Anyhow, I hope that they are both right!

croes • today at 7:16 PM

And that is the problem.

AI claims but too few people can check.

Won‘t get better from now on

➕ show 1 reply