alt Hacker NewsMy team at my company alone burned through $100k worth of tokens in September.
When it hit $20k it triggered a talk with management, but ultimately they decided it was worth because of the value the LLM was providing.
My team at my company alone burned through $100k worth of tokens in September.
When it hit $20k it triggered a talk with management, but ultimately they decided it was worth because of the value the LLM was providing.
Do you have any insight into how your management tracks the value it is providing?
This is something we've been trying to do for a while now and have not found a convincing metric.