logoalt Hacker News

ttoinoutoday at 1:08 AM1 replyview on HN

   Inference techniques either move a deployment along the latency–throughput frontier or push the entire frontier out, creating more efficiency to allocate.
This is a tautology. You can say that with anything. Gastronomy techniques will make a previous recipe better, or create a new recipe better than others, or a mix of both.

Replies

Ifkaluvatoday at 2:54 AM

The point is to classify them into two kinds. The kind that shifts the frontier is more powerful, since improves capabilities without incurring tradeoffs.

show 1 reply