I wonder why they didn't show Gemini 4 Carbon's scores on the science benchmarks, especially since Google seems to be pushing it for that -
https://x.com/pushmeet/status/2120814064863461440?s=20
(FD: Google employee, I don't work on Gemini)
they are probably trying to authenticate their phone number to access agy
Yeah it feels shady how Carbon was selectively plotted (or not), unlike Opus/Fable
Probably still waiting for it to finish reasoning on the benchmark. Should be ready in a week or two.
Two posibilities. 1. They couldn't figure out how to actually use those Google models.
2. They launched the benchmark days ago and Gemini is still rereading the file with tasks.
I work at OpenAI and I made the plots. Gemini 4 Carbon was omitted when we couldn’t find public data, usually cost. No intent to hide anything.
If we missed anything, feel free to point me to it and we can add it.