Curious, where did you see the numbers on how much frontier labs are paying for eval data?
I’ve gotten recruiting emails to be a human grader of Claude coded projects. 6 month contract at $150/hour 40hrs/week. Not insanely expansive but also not cheap.
https://getlatka.com/companies/mercor