> Like, for every 10th token, instead of outputting the most probable, it outputs the 17th most probable, or something.

Wouldn't you need the prompt to know the probability of the next token?