logoalt Hacker News

totallygeekyyesterday at 10:19 PM3 repliesview on HN

"Skill" with an LLM is nonsense. It's non-deterministic, so any equal efforts are not to be given equal outcome.


Replies

whatisthisevenyesterday at 10:40 PM

You could say the same when applied to games with high RNG and chance, such as Slay the Spire 2, and yet those with real skill do perform far better than those without. Those with skill can clear the highest difficulties more often than those with lower skill.

Something being "non-deterministic" is orthogonal to whether or not skill plays a role.

farbklangyesterday at 10:31 PM

not equal, but probabisticly better. Best example: give the agent a tight spec and it will perform better compared with a spec that leaves room for interpretation. This is true for all models, more or less. (purely anecdotal of course)

AbrahamParangiyesterday at 11:29 PM

"Skill" at poker is nonsense. It's non-deterministic, so any equal efforts are not to be given equal outcome.