logoalt Hacker News

sva_today at 7:15 PM0 repliesview on HN

I mostly just use frontier models as well. Except for one case: when I let the cache expire (I think 5+ mins of inactivity) I'll switch to one of the cheaper models to summarize and write a handoff note, then pick that up with the better model. Picking up a session whose cache expired with something like 200k tokens with the frontier model reflects really poorly on your usage.