logoalt Hacker News

ctkhn • yesterday at 9:39 PM • 0 replies • view on HN

It doesn't just matter that inference is profitable - cash from profitable inference needs to outweigh cash burned by training. If training costs even $1 more than your profits from inference on a model, you lost money on the whole thing.