I’m not sure what people are doing with these subscriptions to feel the need to monitor what’s going on this closely. A $100 OpenAI subscription feels effectively infinite for my usage at home
"hacker" news… Even in the AI era, some people still enjoy understanding the technicalities of things
I think it was a great blog post.
I think people who monitor their usage like this are probably running $20-30 subscriptions or PAYG API pricing.
$100 a month on an LLM subscription for hobby usage is an absurd amount of money IMO.
Quality and troubleshooting. This is a complex setup and there are plenty of places where things can go wrong.
Cache TTL will get you anyway. For Claude subscriptions, subagents still have a 5m TTL and before I discovered that, their constant waits for ~10 min tests or similar tasks would destroy my 5h usage. And for my API subscription at work, Claude has a 5m TTL for all stuff, and that's nowhere near long enough. You have to be monitoring this unless you want to absolutely torch your company's budget.
Some people are fine with an ISP-provided router that just works, and some would rather run pfSense, if even just to look at the internals.