logoalt Hacker News

pavitheran • yesterday at 10:46 PM • 4 replies • view on HN

From the GitHub description: “On average, each result used 3 hours of ChatGPT Pro thinking compute”


Replies

password54321 • yesterday at 10:53 PM

Oh cool, we will all now have a math genius on our computer.

➕ show 2 replies
orlp • yesterday at 11:14 PM

I'd really like some clarity on what that means. E.g. DeepMind has 'cheated' with this in the past, claiming that AlphaZero only took 4 hours to reach super-human chess levels while conveniently leaving out the fact that it was 4 hours x 5000+ TPUs. Sure it's impressive that it only took 4 hours wall-clock but it's very misleading as to cost.

Can we get a number in Blackwell GPU-hours, kWh, or some other compute-scaled metric?

➕ show 3 replies
Jtarii • yesterday at 11:35 PM

That estimate is obviously going to conveniently ignore all the failed runs.

scrlk • yesterday at 11:00 PM

Does this imply that it was a one shot prompt with ChatGPT Pro style models (i.e. best-of-N), rather than the agent swarm approach that was used for Navier-Stokes?

➕ show 1 reply