alt Hacker NewsMy point is that LLMs depend on training data so the code they produce will be stuck in 2022, no new languages, techniques beyond that because new techniques are not in the training data (at least not enough of it for training because most coders are now using LLMs).
Chess/Go continues to progress because it is primarily a human vs human activity, people will always be learning to play chess and chess will continue to develop.
Replies
redox99 • yesterday at 1:12 PM
Pre training data is in large part synthetic these days, and RL data is almost all synthetic.
Computer Chess progress has nothing to do with human vs human activity. AlphaGo Zero used no human game data at all.
➕ show 1 reply
> Chess/Go continues to progress because it is primarily a human vs human activity, people will always be learning to play chess and chess will continue to develop.
AIs are not continuing to get better at chess/go because humans continue to play at levels far below themselves who discover new techniques. They get better because they play against other AIs and discover new techniques that have a higher win rate that way.
I would bet that even if humans stopped playing chess/go and people were still willing to run these AI models against each other they would continue to get better.