logoalt Hacker News

adrianNtoday at 3:49 AM0 repliesview on HN

Batch inference is much more efficient. Using the hardware round the clock is much more efficient. Cloud can absolutely pay more for hardware and still make money off you.