> Throwing away context at the end of each conversation means that you can't form a meaningful social connection with an LLM, because you're starting from zero each time.

That's a feature, not a bug. But infinite context is probably something we will see at some point and then you'll have your wish granted.