From GP, i.e. the context for this local part of the thread

> Autoregressive LLMs generate tokens one at a time, disputing this is just plain wrong.

next-token prediction i.e. the bit built during pre-training.

at no point in your reply to GP did you specify that you were referring to post-training. respectfully, it seems like this one is on you pal :shrug:

> GPT-2 didn't use any reinforcement learning and is often given as a toy example. That release was 2019 and models now go through a various phases of training with different objective functions and optimizers.

yeah. so? the toy example works for pre-training. see above.