logoalt Hacker News

sudhirbtoday at 1:07 AM0 repliesview on HN

a 90% saving is huge isn't it?

for long agent sessions, I would expect a very high cache hit rate unless you're editing the system prompt, tools, or history between turns, or some turns take longer than the cache timeout