logoalt Hacker News

stev1983 • today at 2:59 AM • 0 replies • view on HN

The problem with looking at different prices from different model providers is a lot of the cost is generally driven by cache hit rates. That’s where you can accumulate expense and the cache hit rate can very wildly from one provider to the next.