logoalt Hacker News

orbital-decay • yesterday at 11:08 PM • 2 replies • view on HN

Neither has any relation to the actual reasoning trace. The summary is actively misleading and you'd be surprised how different it is from the raw CoT of the model. Just ignore it.

If you want to see example traces without jailbreaking claude or gpt, see open models that display the CoT without trying to hide it. It's pretty useful sometimes, with usual caveats (it deceptively looks like English but is heavily reward hacked, and it's generally a weak proxy for model's reasoning process).


Replies

jorl17 • yesterday at 11:13 PM

This makes sense. Nonetheless, I find that reading Anthropic's reasoning traces is sometimes a trigger for researching more stuff. Often I'll see models thinking (or fake thinking, whatever) about something and I'll be curious to check out more about that topic if I'm not particularly familiar with it.

deaux • yesterday at 11:58 PM

Off-topic, but this kind of conversation tells me just how little the average HNer still uses LLMs outside of specific coding tasks, or at least pays attention to them. Which in turn explains so many comments. Probably a good thing though.

You're of course completely right. Interestingly the "summaries" have only become more diverged over time. I now believe the big 3 are barely summarizing at all any more. I deem it likely that the small models don't get the CoT at all, they just completely make up something "plausible" solely based on the user message with a little bit of previous context. Much of the time it will be the complete opposite of something I asked for, or barely related.

Anthropic has changed this up multiple times over the last 12m, I'm talking about the iteration that was around the longest this year. I think they changed it again within the last feww weeks and potentially started actually summarizing again.

Your suggestion is the right one. Everyone who uses LLMs for their job should spend some time with open models like Deepseek and see what the thinking actually looks like.