logoalt Hacker News

vanviegenyesterday at 8:57 AM0 repliesview on HN

You're quite confidently wrong! :-)

The kv-cache is the internal LLM state after having processed the tokens. It's big, and you do not have it locally.