alt Hacker News> We are not pre-trained using the summary of all human knowledge over all of history.
But we are? That's our education system.
The only reason school doesn't try to shove more information in our brains is because we hit bandwidth limits.
> We are not pre-trained using the summary of all human knowledge over all of history.
But we are? That's our education system.
The only reason school doesn't try to shove more information in our brains is because we hit bandwidth limits.
> But we are? That's our education system.
That is not what the education system does. That's an obvious distortion of reality. People train over billions of documents to statistically predict the next word to gain and understanding of language. LLMs do this statistical processing in order to mimic humans natural language learning ability. And there has been continued evidence of the limitations of this approach to accurately mimic the totality of human cognition.