I recommend watching "The AI Paradox" which speaks to this notion that knowledge comes from figuring things out.
https://youtu.be/dcolM6W5Odc?si=W-OL-ek5scYSvz2C
Doesn't this video make a strong case that LLMs can think?
alt Hacker News
Doesn't this video make a strong case that LLMs can think?