logoalt Hacker News

underdeserver • today at 5:55 PM • 5 replies • view on HN

I wonder why they didn't show Gemini 4 Carbon's scores on the science benchmarks, especially since Google seems to be pushing it for that -

https://x.com/pushmeet/status/2120814064863461440?s=20

(FD: Google employee, I don't work on Gemini)


Replies

tedsanders • today at 6:24 PM

I work at OpenAI and I made the plots. Gemini 4 Carbon was omitted when we couldn’t find public data, usually cost. No intent to hide anything.

If we missed anything, feel free to point me to it and we can add it.

➕ show 1 reply
holzhaker1 • today at 6:28 PM

they are probably trying to authenticate their phone number to access agy

knuppar • today at 6:00 PM

Yeah it feels shady how Carbon was selectively plotted (or not), unlike Opus/Fable

eknkc • today at 6:21 PM

Probably still waiting for it to finish reasoning on the benchmark. Should be ready in a week or two.

TiredOfLife • today at 5:58 PM

Two posibilities. 1. They couldn't figure out how to actually use those Google models.

2. They launched the benchmark days ago and Gemini is still rereading the file with tasks.