logoalt Hacker News

dstu • today at 9:52 AM • 0 replies • view on HN

If I were a cynic I’d also say that it wouldn’t be particularly difficult for them to detect when a benchmark/eval context is active and to route those requests to larger models or higher quants.