logoalt Hacker News

Mashimotoday at 7:59 AM0 repliesview on HN

> reasons to route LLM queries at large scale?

Convenience. Paying only one provider, but get access to different models hosted around the world. Need a model for a project where latency matters? EU hosted and ZDR for another customer? Cheapest for personal use?

You get everything under one roof.