I noticed Fable decline in quality a couple weeks ago. And I've noticed Opus drop over the last week, even after bumping to a default of Extra High reasoning for almost everything.
Tonight has been maddening with the kinds of absurd mistakes it's repeatedly making. It's so frustrating.
I'm the kind of person that wants something to be consistent and reliable. And Anthropic has been great, except for in this way. Which is enough of a recurring frustration (about every couple months this year) that I genuinely can't wait for other options to catch up. Then I'll be leaving as soon as I can.
I just don't know how long that will be.
>I'm the kind of person that wants something to be consistent and reliable
And people wonder why open models are a big deal, and why some people love them so much, despite being 30% worse than the frontier.
Having control over something that writes most of your code is important.
Bumping to a default of extra high reasoning for almost everything seems ill-advised.
"More reasoning" != "better"
I read somewhere that the test might switch models mid conversation which stops the other from reading the previous model's reasoning. I don't know if that's true, but it sure feels like that quite often in the last days.
> I'm the kind of person that wants something to be consistent and reliable.
Only local AI capable hardware and frontier open weight models can provide that.
Surprised they didn’t wait till after the IPO. Any guesses on how models might change then?
> I'm the kind of person that wants something to be consistent and reliable
Surely everyone is that kind of person.
Who wants to pay for a service that doesn't work properly half the time?
I just cancelled my x20 anthropic sub after their last usage reduction shenanigans, and moved over to DeepSeek and opencode go. Yeah opus is a bit smarter, but not even close to justify the 20x price relative to DeepSeek.
Fable has most definitely been nerfed for the last few weeks, not to mention painfully slow.
Oh don't worry, you can just switch to Fable 5.5 tomorrow, which is the smartest model so far (because the others are dumb now).
I'm a pretty voracious 20x user, and OAI Biz Pro user; however I'm not an engineer by training, a previous tech adjacent dev team leader who always relied on pseudo code and broadening my horizons when dealing with my team. ( AdTech, DTC marketing )
So I'm AI pilled and in another career, and started to think, what if the problem is the inputs? They release Opus X.X and at first it's a rush of their best users, best use cases, upgraded lanes. As weeks go on, adoption increases, cruft uses start to poison the model? Is this how the ongoing evolution works? I'd love to get Sonnet 5.5 and Opus for review in a place where I could reliably daily drive for X months / Y years etc.
I've been using Fable for a couple months as a relatively independent, long-horizon task executor and it worked well. About two weeks ago it completely stopped working. Like ~85% success rate down to ~10% in my workflows.
Totally possible that I'm just hallucinating/projecting/etc or my workflows somehow changed in terms of difficulty, but it's been kind of shocking.