Instead of pre-training, I'd say it's more like a better architecture, training regime, higher fidelity data, and perhaps better initial "weights".
All of that stuff was still trained by evolution, though.
All of that stuff was still trained by evolution, though.