>I mean, an LLM is still fundamentally a next token predictor, right?

Yes, but everything, including the human brain, is "fundamentally" some underlying simpler primitives.

>E.g., “breakout game weights” always look the same regardless of training and model?

Wouldn't this be expected to be roughly the case, given NNs that share the same basic architecture to model the same quite simple thing like a breakout game?