alt Hacker NewsI guess more important than LLMs training LLMs (which is mostly the same code over and over) is LLMs cleaning and curating training data.
I guess more important than LLMs training LLMs (which is mostly the same code over and over) is LLMs cleaning and curating training data.
Very good point. Sifting through noisy data and creating curated datasets could be of great value. Perhaps worth a project by itself!