Have you used 10b/5b tokens over the course of a week or over the course of a month?
It was 9.4B to be exact and it was over the course of two days lol. It was between two projects so 99% of them were cached reads.
The GPT was about 1B on two projects on 300$ worth of plans all on Astra and I capped out on usage.
Anthropic caching must be better because the cache rates are better on Claude models.
alt Hacker News
It was 9.4B to be exact and it was over the course of two days lol. It was between two projects so 99% of them were cached reads.
The GPT was about 1B on two projects on 300$ worth of plans all on Astra and I capped out on usage.
Anthropic caching must be better because the cache rates are better on Claude models.