It's hard to see what the point of this is?
When would one want to predict a full-length unknown protein sequence from only a fragment? Any fragment of any useful length can be back-translated to the DNA sequence and that can be tested against genomic databases (a process called tblastn). And if your protein/gene is not found there, you have no way of knowing whether or not the predicted sequence has any basis in reality.
Testing the model against shuffled sequences is also kinda cheating, as these are no longer random pool of amino acids, but one whose source already exists in the databases.
Probablye because that's only part of the problem.
Doesn't anyone remember the Borderlands Science! mini-game that was in Borderlands 3?
I think the point is probably to improve reasoning about protein design work. If Claude has an innate understanding of protein sequence variation then it is able to just eyeball potential issues in protein designs. To be clear, I'm pretty sure Anthropic would ask claude to design proteins using task specific with conventional tools, but they then want it to be able to look at results and reason about them, akin to an expert. Not sure whether it'll actually help but I think that is the logic.
[0] https://assets.claude.com/30bf50e22a01388bb29bf077ee3f244531...