alt Hacker NewsThe page is currently tracking Opus 5, which was released July 24 and has not seen any updates since.
30-day average 83% [71-91], last result is 79% [66-88], and it dipped to 75% [61-85] a week ago.
The page is currently tracking Opus 5, which was released July 24 and has not seen any updates since.
30-day average 83% [71-91], last result is 79% [66-88], and it dipped to 75% [61-85] a week ago.
The page says
> We always use the latest available Claude Code release and the SOTA model
They've stepped up the benchmark for each new model. Presumably they're gathering Fable data now.
They also link to Anthropic's public blog post about some degradations, their cause, and how they fixed them. The time period sounds like the "recent weeks" you experienced: https://www.anthropic.com/engineering/a-postmortem-of-three-...