[Displayingmy ignorance here] So is it possible that the model has learnt which letters are valid continuations? Like, for example, the rule in English "I before E except after C". Could the model just have figured out some simple rules from a small number of examples and is just applying them?