I think the problem is that we’ve anthropomorphised the LLMs in their training and through system prompts to the point that that seems reasonable.

We don’t thank our other tools like grep, or the compiler.

If you train your LLM to produce words that seem like human responses or conversations, they will. If you train them to seem like god-like superintelligences to people who think that’s what they’re creating, they will.