logoalt Hacker News

Starlevel004 • yesterday at 6:21 PM • 1 reply • view on HN

That terminal bench 4.0 result is... bad? Terra XHigh more expensive than Sol Low and still does worse.

It's very likely this is a next checkpoint of GPT-6 "Sol", over-optimised for the web chat and offered to Codex subscribers as a "please go away" offering.

If this was half the price, I'd be very interested, but at 1/5/0.05? Feels like another panic release because they can't get Astra 6.1 out of the door...


Replies

rockdoe • yesterday at 10:24 PM

Scoring "bad" on Terminal Bench 4.0 can also be a sign that it's cheating less: https://preferencemodel.com/blog/terminal-bench-4-is-saturat...