On your second part:

Many of the most valuable companies in the world (who, incidentally, are spending the most money on frontier model inference), already have "the expensive part", the labeled dataset.

The cost of maintaining the datasets and the models is getting commoditized by startups like braintrust and huggingface.