"- Personally I think today's frontier models can be beat by training from scratch. Haven't proved this yet tho"

Also, in curating the training data in a deliberate manner, with attention to detail. Most people just use existing datasets and call it a day. It's a lot of work, which is why there are gains on the table.