logoalt Hacker News

mlauxyesterday at 6:15 PM4 repliesview on HN

Looks like all three breaking changes are patches for inadvertent chain of thought disclosure. Someone found out (don't have the tweet handy) that if you created a bogus "think_deeply" tool and then forced the model to use it, it would output what is believed to be its raw thinking there - I believe the first breaking change stops this. The second two are aimed at people getting Haiku to repeat thinking blocks from other models verbatim (since it can see the decrypted version). I get that in their eyes it's an "exploit" but still kinda disappointing that they patched this


Replies

sippeangeloyesterday at 8:58 PM

These draconian "Preserved Thinking" measures they're taking are going to be an absolute pain in the ass. This alone is enough for me to move our API use off their platform entirely. It's a HUGE breaking change that they're trying to dampen by having it not affecting current customers until "in the future", see: https://platform.claude.com/docs/en/build-with-claude/preser...

You're no longer allowed to edit the context anywhere! The whole context is to become append-only, says Anthropic. No more editing the system prompt as the conversation progresses, no more dynamic loading of custom tool calling formats. Everything has to go through their built-in tools API and you aren't allowed to mess with anything in the context if it has any thinking blocks following it. This is the most intrusive "model DRM" we've seen so far!

show 3 replies
mmaundertoday at 5:04 AM

Making clear the scale of distillation they’re combating.

truenoyesterday at 6:35 PM

[dead]

giancarlostoroyesterday at 6:32 PM

To be fair, I assume they want to hide that not from their customers, but adversaries who use the way Claude models think and reason to refine their own models.

show 2 replies