alt Hacker News> The training data will degrade in quality if more people rely on LLMs so I'd expect models to eventually start getting worse even if they currently enjoy apparent improvements in output.
RL is not dependent on training data. The mathocalypse didn't happen because they found better training data somewhere.
Replies
rsfern • today at 1:23 AM
I’m not sure that’s a good argument that models will get good at novel brainstorming and research ideation. Where do you get scalable and high signal verifiable rewards for creativity and insight?
> The mathocalypse didn't happen because they found better training data somewhere.
There are reasons to suspect that OpenAI may have intentionally or unintentionally trained on chat logs from mathematicians--mathematicians who were actively using OpenAI to try to to solve the same problems themselves.[1] If those mathematicians were on the right track, and getting close to a solution, that could be classified as finding "better training data somewhere."
[1] https://cybernews.com/ai-news/openai-accused-stealing-anothe...