logoalt Hacker News

jeremyjh • today at 7:01 PM • 1 reply • view on HN

You only need to spend a couple of minutes talking to an LLM about chess to realize it has no understanding of the game. It will produce reasonable sounding explanations for things that are completely wrong. It will make illegal moves. It will hallucinate pieces on squares even when the entire PGN is in the context. There are no prompts you can give it to fix this. I don't really understand how you could create this skill without noticing this.


Replies

Lucasoato • today at 7:05 PM

Will it make illegal moves? I have doubts regarding this, at least for the strongest models like Opus5.5 or Astra.

➕ show 1 reply