alt Hacker News> To be honest, I don't know any companies using OW models at a large scale for their operations (agents or chat assistants).
Perhaps they simply don’t advertise it and investors (currently) love companies that spend heavily on frontier models. That said, OW models, especially when combined with RAG, work quite well, and given the current state of the industry, they may be the only sensible way to keep inference costs under control.
They’re using it behind the scenes - routing.
Why do you think OAI etc are all up in arms? They hate what’s going on. Most here are delusional.
I work in a very large market cap firm and i’m telling you - more and more managers are pushed to get their teams to use open source and squeeze employees to get the max out of them.