alt Hacker Newsclaude swe-bench is 80.8 and codex is 56.8
Seems like 4.6 is still all-around better?
Replies
Rudybega • yesterday at 9:59 PM
You're comparing two different benchmarks. Pro vs Verified.
claude swe-bench is 80.8 and codex is 56.8
Seems like 4.6 is still all-around better?
You're comparing two different benchmarks. Pro vs Verified.
Its SWE bench pro not swe bench verified. The verified benchmark has stagnated