logoalt Hacker News

mzltoday at 6:04 AM0 repliesview on HN

The cost of running things like prompt caching is defined by the implementation as that gives the infrastructure costs.