Most of the training set is half of the Internet. LLMs are pre-trained on general set of human biases and patterns of thinking.