alt Hacker NewsThat's because Deepseek invented the paradigm of prompt caching, they are the SOTA when it comes these techniques. Despite them open sourcing all their research, nobody beats them.
edit: I do wish openrouter would let you sort providers by Cache Hit % and Cache cost. These are the only things that matter to me at this point when choosing a provider.
Replies
minimaxir • yesterday at 10:10 PM
You can click the table headers to sort Ascending/Descending.
➕ show 1 reply
orbital-decay • yesterday at 11:04 PM
>Deepseek invented the paradigm of prompt caching
Caching was always here, you don't need to do anything special to get it on a single user local backend running a base model or a chatbot in the first place. Among commercial providers, OpenAI adopted it in 4o first.
Cache hit % on openrouter is not a good metric, it's mainly driven by openrouter's own provider juggling than the providers themselves