LLMs is a little like the guy in Memento right. Every single conversation is it looking at the compressed scribbles of the context.