A different way to look at it is language models do know things, but the contents of their own knowledge is not one of those things.