alt Hacker NewsThese draconian "Preserved Thinking" measures they're taking are going to be an absolute pain in the ass. This alone is enough for me to move our API use off their platform entirely. It's a HUGE breaking change that they're trying to dampen by having it not affecting current customers until "in the future", see: https://platform.claude.com/docs/en/build-with-claude/preser...
You're no longer allowed to edit the context anywhere! The whole context is to become append-only, says Anthropic. No more editing the system prompt as the conversation progresses, no more dynamic loading of custom tool calling formats. Everything has to go through their built-in tools API and you aren't allowed to mess with anything in the context if it has any thinking blocks following it. This is the most intrusive "model DRM" we've seen so far!
Replies
You think moving will help you? OpenAI is going to do exactly the same thing soon. Unless you're moving off the frontier entirely, that is.
Interesting, I liked to experiment with a second model "simplifying" and summarizing the previous messages and continue.
Needless to say, it improved output on following messages by whatever metric I cared for.
Not sure why would they prevent it.
I give you a chain of messages, what do you care for what the origin is?
> No more editing the system prompt as the conversation progresses, no more dynamic loading of custom tool calling formats.
Hm, aiui you can support both of these via mid-conversation system turns https://platform.claude.com/docs/en/build-with-claude/mid-co... - and in general you'd want to to preserve the cache and recency of the instruction anyways rather than frankensteining an off-distribution transcript. Not sure though.