alt Hacker NewsAre you sure about that? Chain of thought does not need to be semantically useful to improve LLM performance. https://arxiv.org/abs/2404.15758
Replies
kubb • yesterday at 6:08 PM
If you're misusing LLMs to solve TC^0 problems, which is what the paper is about, then... you also don't need the slop lavine. You can just inject a bunch of filler tokens yourself.
still doesn't mean all tokens are useful. it's the point of benchmarks