logoalt Hacker News

Archit3chyesterday at 10:54 PM0 repliesview on HN

You can keep the KV cache in (possibly Unified) RAM to avoid SSD writes entirely. Not sure if it would fit on a 32GB laptop, though.