logoalt Hacker News

bunderbunder • today at 4:32 AM • 0 replies • view on HN

You can, but it is also fraught and strange and hard to trust. The logprob on one particular token in light of all previous tokens is just that: a token probability. That’s not really the same thing as an assessment of all the reasoning or chain of thought or whatever that preceded that token.