alt Hacker NewsI believe this is to test the theory that people can detect watermarked text.
Teaching you how to identify watermarked text while the experiment is running would ruin the data.
Replies
ipaddr • today at 10:29 PM
Detecting watermarked text is hard. Detecting AI garbage text is easy but then classfiying the garbage further is beyond us.
Maybe detecting watermarked text is a skill to be attained. Not allowing proper feedback and training will not allow people to notice the difference on time, thus ruining the data?
Best practice is to allow a number (scaled based on complexity of task) of training rounds (with short feedback loops) prior to letting people loose on the regular samples.