logoalt Hacker News

gilleain • today at 7:56 AM • 1 reply • view on HN

Perhaps. They explain why:

> Shuffling keeps the letters and destroys their order, so the difference in accuracy measures what the model knows about the sequence itself.

So by analogy, if you know a word in English starts with 'Q', you could reasonably predict the next letter would be 'u'. By shuffling, you might encounter the letter Q later on, and not successfully predict a 'u'.

Put another way, the shuffled sequences can only use frequency analysis for prediction, while the unshuffled ones have local and global order signals.


Replies

octoberfranklin • today at 8:11 AM

Yes but what is the source of truth for the next element of a shuffled sequence?

For a natural sequence, the observed molecule in nature is the source of truth.

➕ show 1 reply