Do you mean 'skill for a human' or 'Skill for an LLM'? :)
I used to do bioinformatics, although more of the structure side than sequence. Like an information or understanding, it depends on what outcome you want that might benefit from the skill.
I suppose that predicting the next amino acid in a sequence would be useful for, say, reconstructing a protein sequence from fragments. Or constructing evolutionary trees of sequences by predicting the common ancestors?
I guess predicting the next amino acid is about as useful as predicting the next word in a sentence - that is to say the task itself is not interesting but a. there is plenty of data to train on that does not need to be labeled by a human and b. hopefully this meaningfully improve performance on tasks we care about.
an LLM-predicted evolutionary tree seems monumentally useless, since it'll be unstable and you have no guarantees/metrics on any property or quality of the tree itself (parsimony, likelihood, estimated TMRCA, etc.)
I'm not sure how to phrase this correctly sorry, But I suppose the question I have is what comes after say "reconstructing a protein sequence from fragments" -> like what how does one go from this to developing a drug or enzyme. Is being able to predict the next amino acid useful in this process ?
Linking to ML space, is this analogous to knowing the model's weights byheart ? Traditionally this has been not useful to humans and machines, but recently some LLMs have started showing capability to directly edit the model weights to alter the behavious of smaller models. Is that a completely wrong analogy ?
Also I guess what I am partly curious is on how this data ended up in the model. Was it part of the pretraining corpus or was there an RL environment which specifically rewarded this behaviour