I interpret "scratch" to mean brand new weights. Not that they aren't training on a corpus of human text
Right but how did they get a corpus, how do they compete legally without distillation?
alt Hacker News
Right but how did they get a corpus, how do they compete legally without distillation?