> Bringing up the KV cache is a sign you don't understand what you are talking about here. The KV cache is a computational efficiency thing and has no impact on how these models actually work (and isn't needed at all). The vague analogy to human working memory also just takes the cake here.

You seem to really like to tell people that they don't know what they're talking about more than you seem to be parsing what they're actually saying.

I remember when I used to look for reasons to pounce on people for not knowing what they were talking about based on a superficial thing or two rather than try to understand what they were saying. I mostly got past it as a teenager, though.