logoalt Hacker News

Someone1234yesterday at 6:36 PM8 repliesview on HN

I'm legitimately out of the loop; what is going on/broken with Opus 5?


Replies

sidrag22yesterday at 6:48 PM

it just doesn't interact good with human beings, and it leaves incredibly strange long winded comments within code filled with session context that will likely not be relevant later on.

Also always seems to have this annoying tendency to leave "questions for you" at the bottom of every output.

Just a high friction human interaction type model, imo should never have even been released, regardless if it scores better on whatever tests, its a horrible experience and a downgrade over past models.

prohoboyesterday at 7:23 PM

Some anecdata:

- It's extremely verbose and often incomprehensible when doing even basic tasks. Like it'll write a giant jargon-filled essay then end it by asking for a judgement call on something that references its own convoluted jargon.

- You can ask it to do research on a topic, and it'll just straight up be lazy, pretending it's really digging deep to find stuff when actually it's just grabbing cached SEO snippets off a search engine.

the-grumpyesterday at 7:13 PM

Fable 5: I give it work, it tells me things that are true and that make sense, it does good work.

Opus 5: I give it work, it makes false statements and draws weird conclusions, I correct it and get it on the right track, it thrashes around but gives me something working though usually buggy.

5.6 Sol is probably on par with Opus 5 on ability but at least it doesn't waste as much of my time.

purpleideayesterday at 6:48 PM

They've nerfed a bunch of models, especially Opus 5. Nobody knows why, but overall things have gone downhill significantly.

fookeryesterday at 8:49 PM

It's worse than 4.8/4.6 and more expensive at the same time.

pramyesterday at 6:59 PM

The comments it makes are so bad, long, and incomprehensible I just strip them all with sed these days.

odirootyesterday at 7:49 PM

It's a great story teller. Not really a good expert though.

greenchairyesterday at 8:17 PM

try sol and you'll see