>An LLM will learn anything that helps it predict
I'm not sure you quite understand the full meaning of this statement. If you did, your following paragraphs wouldn't follow.
Are you imagining that an LLM tasked with predicting a game continuation is going to play to win instead?
Are you imagining that an LLM tasked with predicting a game continuation is going to play to win instead?