prob a noob question; but what kind of data are people looking to get to help with what kind of decisions with these tools?

i can see some IT/infra team using these tools to manage their LLM costs, but this blog post seems to hint at some kind of product decision making? what am i missing here?