> > The experience is strange; you aren't able to grasp any common human aspects because there are none. You can't reason with the human, because the human isn't doing the reasoning. You can't appeal to it, because the LLM behind it is in direct support of its own and the proxy's opinions and whims.
I've sometimes wondered if the chat context is why some people think LLMs are intelligent, it being divorced from their usual experiences, and they need something like this to feel the cognitive dissonance before they can notice LLM shortcomings.
> > The experience is strange; you aren't able to grasp any common human aspects because there are none. You can't reason with the human, because the human isn't doing the reasoning. You can't appeal to it, because the LLM behind it is in direct support of its own and the proxy's opinions and whims.
I've sometimes wondered if the chat context is why some people think LLMs are intelligent, it being divorced from their usual experiences, and they need something like this to feel the cognitive dissonance before they can notice LLM shortcomings.