alt Hacker NewsI agree its so important to proxy and capture all the data. I've been very happy with bifrost as a proxy. It's a quality piece of software, unlike LiteLLM. You also get this one interface to access all your models, across all services, including self-hosted, STT models, everything. There are ways to use subscriptions with proxies too, but they are discouraged because of grey-hat uses..
Replies
hdra • today at 7:14 AM
prob a noob question; but what kind of data are people looking to get to help with what kind of decisions with these tools?
i can see some IT/infra team using these tools to manage their LLM costs, but this blog post seems to hint at some kind of product decision making? what am i missing here?
Currently using litellm and its been pretty solid for me (have my claude sub on there as well) - curious why bifrost over litellm? Also iiuc subs on proxies is ok if you're not farming them.