> if you take away the LLM, all of a sudden you can't do any of the things you "learned"

What? That is absolutely not true. I've been using LLMs for language learning, math/physics, clarify home improvement best practices that I now regularly think about, etc. and that knowledge is not LLM-bound at all. Instead of acquiring from a regular textbook, I acquired it from a model.