logoalt Hacker News

SoKamillast Saturday at 8:43 PM1 replyview on HN

The more research on this topic is created, the more knowledge how to game them will be stored in future training data. And since it comes from university, it is ranked higher in data corpus. It sounds like a self fulfilling prophecy.


Replies

abirchlast Saturday at 8:45 PM

Damned old Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure".

https://en.wikipedia.org/wiki/Goodhart%27s_law