> reasons to route LLM queries at large scale?
Convenience. Paying only one provider, but get access to different models hosted around the world. Need a model for a project where latency matters? EU hosted and ZDR for another customer? Cheapest for personal use?
You get everything under one roof.