In the olden days, I enjoyed Opus 3 because it was easy to have it sound way more human than GPT.
Nowadays, with the focus on agentic use and coding, it seems models have all been RLHF’d to death, it’s so incredibly hard to have them write in a different voice than their default. I put together a skill to review its writing and have it edit its own output (e.g. code comments), which does make a difference, but isn’t perfect.
What, if anything, do people do for writing? That feels like a neglected side of LLMs. They’ll make 100 Bash calls referencing ancient commands without batting an eye but heaven forbid they use something other than “load-bearing” while talking. For something trained on “all the human knowledge” it’s incredible how limited their default vocabulary seems to be.
It's why I like Gemini 3.1 Pro. That it sounds much more human than other LLMs is testament to Google's inability to post train.
gemini-2.5-pro-experimental was the GOAT, though. It was an emotional wreck, down in the dumps and feeling terrible for itself after failing to patch a file several times. Very amusing to read, all the while watching it make a mess of my codebase.
Good. I don't want LLMs sounding human. I want the ability to shame and discredit anyone passing the job of prose to a machine. There's an art to writing, and hopefully LLMs never truly get it right.
> Nowadays, with the focus on agentic use and coding, it seems models have all been RLHF’d to death
This has also lead to unrelated associations by which some people went from seeing better coding capabilities and extrapolate to assuming better thinking overall. One only has to watch youtube videos of AI "normies" trying to use LLMs the intended way to see that the improvements on coding doesn't translate to other applications. Basically from AGI "goals" they are now hyperfocused on coding agents, until the next marketing breakthrough rears its head.
Agreed. I think we’re entering an era where some level of specialization for general LLMs is a good thing. Particularly between tuning for agentic use cases (where you want agency with a ton of guardrails and control) and writing which is more creative - you want the model to take the occasional risk and not sound like a monotonic robot. Having trained models first-hand, I can see the distinct use-cases clearly that are odds with one another.
For what it's worth, Anthropic seems to be keeping Opus 3 available on claude.ai, perhaps for this reason, so you're free to use it if you want to.
> Nowadays, with the focus on agentic use and coding, it seems models have all been RLHF’d to death
I don’t get it. If nobody likes this writing style, how can it be the result of human feedback? Something else is going on.
> What, if anything, do people do for writing?
I use a keyboard, personally.