Correct me if I'm wrong, but the harness will always be dependent on the underlying model, and useless without it. All custom harnesses are being built, could be obsolete in the next big-generation-jump of the models.
I might be absolutely wrong, but "harnesses" / cc-derivatives became "good enough" only maybe a year ago max. Before that, people were pushing for gigantic folder structures with custom documents and "pretend you're X" stuff.
My point is, depended on what you're trying to achieve, testing out current-gen harnesses, and nudging your workflows towards them might be better RoI, rather than chasing something that might be throwaway code a quarter later.
Obviously, this really depends on whether you believe model development will speed up or slow down in the upcoming future.
Doesn't apply to every scenario where agents are useful. Think about businesses - most business processes are not optimized this way. They are mostly a conglomeration of hierarchy, relationships, customs, IP, etc. Model development will never cross such paths. Thus, harnesses are needed. A foundational system that covers 80% of business processes has value, and I'm targeting that problem --- https://github.com/rush86999/atom
You are wrong. I honestly am having trouble understanding how you think these things work, and what you believe a harness is in the first place.
There is the standard API that things like openRouter exposes, thats supported by every provider, and all it is, is manipulating a large blob of memory by adding your own words or asking the GPU to append new words.
Everything else around it is window dressing. All providers accept that API, (only Anthropic has blocked access on their consumer subscription tier).
Its how businesses write their 'bots'. Nobody - except the people trying to sell you "magic" - is incentivized to remove that kind of access.
I can switch out openai/anthropic/deepseek/openrouter/kimi/selfhosted at the drop of a hat. Its a big reason you'll see a comment on HN talk about "There is no moat".
Calling them cc-derivatives is wrong. I've seen many features land in other harnesses long before they came to Claude.
The only thing Claude seems to be "cheating" with is that:
- They provide Windows users a unix VM hosted on their servers - I dont want or need that
- They're better 'trained' at doing compaction / providing the illusion of continuity
- They might do automatic model-switching (not sure if they do) - not something i need.
Sure, if you're in the market for magic then dont put time in having your own harness and just accept the lock-in. Since I'm using them so much i think its worth the investment.
A lot of what a custom harness does isn't necessarily interacting with a model, it's the framework around it. Part of harness engineering is figuring out what can be done deterministically to avoid calling an LLM. A generational jump doesn't obsolete those areas, it just means you get the right answer (maybe) faster and easier when you do call the model.
There's a difference between their harness and your harness. The latter can be tuned to your preferences, while the former cannot. A custom harness can do everything that a packaged harness cannot. Good luck getting Claude Code to coordinate with multiple model providers or deeply integrate with your environment.
The point you're making is to be a consumer, which admittedly, is probably best for most people, but it's not going to satisfy the hacker. Normies aren't building custom harnesses, so your argument is DOA for the target demographic.
Also, vendor lock-in. No thanks.
I switched between several local and remote providers and models and over different API (anthropic/openai) and it worked fine, just some minor issues but they were fixed within an hour.
And the system prompt worked great regardless, so i don't think your main point holds, especially as models improves; it isn't throwaway code, but for sure it's evolving constantly, as my own workflow keeps changing.
> My point is, depended on what you're trying to achieve, testing out current-gen harnesses, and nudging your workflows towards them might be better RoI, rather than chasing something that might be throwaway code a quarter later.
Fair point, depends if it's an hobby or you are a developer full time, in the latter case i think it's definitively worth it.