> This is the "Claude Code" part, or even the ChatGPT (web interface/app) part. Large context window full of relevant context. Auto-summarization of memories and inclusion in context. Tool calling. Web searching.

From what I've been learning in my uni, this is said pre-programmed. Cognition is really the ability from, out of no context, no knowledge of what you are capable of, to learn something. These tool calling and web searching are, in the end, MCP functions provided by the LLM provider themselves.

It's an entire academic discussion, about how things start. For example babies: they someone have a knowledge base on how to breath, how to cry, but they have absolute no knowledge on how to speak and it learns by the interactions with the parents.

LLMs try as much as they can create this by inference and pre-programmed functions, but they don't have a graph of memories with utility to weight their relevance in the context. As others said, the context window dies as soon as you close the session.

They also don't have the epistemic approach that is to know that another agent knows about something just by observing the environment they were all put in.