I don't know what harnesses they run but when I daily tell Claude or others to do X and they indeed do parts of X and then also Y and break A on the way... I'm so tired of asking "but, really?" that I'm not even bothering anymore. The AI folks live in a different world than I live, and whether it's a real world or only in their minds (or only in their articles) I definitely cannot tell anymore. I simply gave up.
Yeesh. Claude still does that? I haven't had that problem since GPT 5.
Some variation of “you’re just using it wrong” is usually the refrain I hear when I talk about things LLM’s are bad at. Anything is possible if you divine the right words to input and fix your harness and set pick the perfect model and…