The early GPTs were supposedly reasonable at chess but it indeed is not a very useful skill to have for an LLM (Elo 1800 IIRC) which is stronger than most players and for them it could be a useful tool.
Even at higher levels, I think there could be use. The Dvoretsky example on my GitHub is real but it’s not a guarantee you get it and it could just be reiterating from training. What didn’t work for me was forcing it to look at lines in detail, but maybe with larger context and better engineering, you can get the LLM to extract themes from the search tree. With compare and contrast, it could maybe figure out why a move works in one variant and not in another and produce a coherent explanation of this nuance.
I’m not trying this yet because it would take a lot of tokens and I don’t have the time.
alt Hacker News
The early GPTs were supposedly reasonable at chess but it indeed is not a very useful skill to have for an LLM (Elo 1800 IIRC) which is stronger than most players and for them it could be a useful tool.
Even at higher levels, I think there could be use. The Dvoretsky example on my GitHub is real but it’s not a guarantee you get it and it could just be reiterating from training. What didn’t work for me was forcing it to look at lines in detail, but maybe with larger context and better engineering, you can get the LLM to extract themes from the search tree. With compare and contrast, it could maybe figure out why a move works in one variant and not in another and produce a coherent explanation of this nuance.
I’m not trying this yet because it would take a lot of tokens and I don’t have the time.