logoalt Hacker News

octoberfranklin • today at 7:21 AM • 3 replies • view on HN

Curious: how can there be a correct prediction for the next element of a "shuffled" protein? The shuffled proteins don't occur in real life, so what makes one answer correct and another incorrect?


Replies

tstactplsignore • today at 12:48 PM

It is a negative control in the experiment. Shuffling is a better control than random because it accounts for the raw rates of amino acids in each protein. For example W is very rare, so Claude could beat a truly random generator just by guessing not W. But the signal seen on real sequences is much stronger than that, so it tells you that Claude is doing something more than just guessing 'not W' on real sequences.

➕ show 1 reply
anonymous_sorry • today at 7:32 AM

It is a rather odd control. Is it just to confirm that Claude isn't reading the sequence off disk?

➕ show 1 reply