logoalt Hacker News

recursiveyesterday at 11:49 PM0 repliesview on HN

None of this works if the testers are collaborating with the trainers. The tests ostensibly need to be arms-length from the training. If the trainers ever start over-fitting to the test, the tester would come up with some new test secretly.