Most training is now post-training using RL not human knowledge: https://pbs.twimg.com/media/HUSAcpFbsAAevEh?format=png&name=...
Having some built in knowledge of the world through pre-training is only part of the bootstrapping process.