logoalt Hacker News

Show HN: Claude-thermos – keeps your Claude session warm for you

41 pointsby s0ck_r4wtoday at 5:06 PM27 commentsview on HN

Comments

SwellJoetoday at 8:58 PM

This is just making it more expensive for everyone else, right?

How Claude handles its sessions is none of my business. I'm going to let them do the best they can to provide good service for everyone, and if they can't/won't, I'll switch to a provider that can.

Using these massive models is already pretty danged extravagant, I'm not going to demand to be at the front of the queue at all times, too.

unholinesstoday at 6:27 PM

I've directly inspected calls for pro/Max plans and as of today they have 1hr cache expiries. This has definitely degraded to 5 min in the past but that's the behavior today.

If you're paying API rates, you can choose 5m or 1hr yourself (and pay different rates).

Keeping a 1hr cache warm could still be useful, sure, but outside that, I don't see much use of this today.

show 1 reply
alukintoday at 6:03 PM

Feels like will be shut down real quick

show 2 replies
jonas21today at 6:23 PM

Is the 5-minute expiration correct? I thought it was more like ~1 hour.

show 1 reply
cosmotictoday at 7:10 PM

How will this not lead to tragedy of the commons?

show 1 reply
ATMLOTTOBEERtoday at 6:29 PM

Glad this exists. It will force anthropic to fix their flawed cache mechanism.

show 1 reply
razodactyltoday at 6:27 PM

Don't we pay for cache input though?

show 2 replies
j45today at 6:23 PM

This is a good idea if it could manage it in an acceptable way.

For example, there might be something I intended to complete in one sitting, but took two sittings in the same day unexpectedly. Maybe it could just be a few cache delays per day or something, tagged in advance somehow.

szintoday at 6:25 PM

[dead]