I wonder why there aren't more open weights model with support for prompt caching on OpenRouter.
It is tricky to build good infrastructure for prompt caching.
alt Hacker News
It is tricky to build good infrastructure for prompt caching.