alt Hacker NewsWhatever Opus 5 is doing should not happen.
Prompt was "read and update the config file with new data". This work on 4.6 takes <2 minutes to read the file, parse the new data, and patch.
Opus 5 Result: 43 minutes of pulling containers, running sandboxes, creating testing suites, which included evaluating the entire repo beyond the scope of the config file.
Both: one file modification
Replies
I initially had unbelievably terrible experiences with Opus 5 and Fable in their higher reasoning levels.
I've had WAY better results on medium effort.
IIUC, the consensus seems to be that anything more than medium effort is rarely worth it - and you far more often run into these extreme worst cases than you do with even the lowest effort levels. That definitely coincides with my anecdata.
It's really only worth it if you're hoping to win the lottery asking it to solve an Erdos problem.
The business bottom line depends on tokens, shareholders want to see exactly that.
Yep, they’re lighting tokens on fire with that thing.
AI companies have a financial incentive to burn more tokens than the task actually needs
My experience as well.
Opus 5 is a neverending chain of "Don't do that. Why did you do that? I've told you several times not to do that but you keep doing it."
"Thinking" for more than 10 minutes for every menial question.
And the prose it writes is horrendous, as if you're reading LinkedIn scammers. "The harsh truth! Two roads, one decision! Reality check!"
I avoid Opus 5, and reverted to Opus 4.8 over similar issues. Opus 4.8 is still working great for me!
Thought I was going to be on Claude Code forever.
Recently got approved at work for ChatGPT Pro so I could use Codex.
Blown away by the speed. It feels like using Claude Code for the first time again. I don't think Codex is doing anything revolutionary, just better handling of which requests should go to which model, and having faith in some of the "less powerful" models for more than you would think.
It seems the TUI coding experience is very much an open race. This is motivating me to look at other agents / harnesses as well (maybe Gemini, OpenCode, etc).
Gotta milk the cows.
and ending with: "One thing I need to tell you:" and bunch of AC, R1 and §
Opus 5 in xhigh can't do basic math as well. They dumbed it down to a point where I just cancelled my subscription yesterday. I used to be a $200 subscriber, dropped to $20 after the fable shenanigans, and use it only when I have no usage left with Codex.
/on The prose is load-bearing unbearable — every sentence feels like it was engineered to sound profound rather than to be read.