Definitely, of course. But I think the logic of the author’s article is based on there being a huge difference between the two, or rather a high cost of inference in absolute terms. And that can change and we have seen it change. Which breaks the entire premise of the article going forward, no?
Inference will be always more expensive than db operations or copying, sure. But how much more expensive is the question.
alt Hacker News
Definitely, of course. But I think the logic of the author’s article is based on there being a huge difference between the two, or rather a high cost of inference in absolute terms. And that can change and we have seen it change. Which breaks the entire premise of the article going forward, no?
Inference will be always more expensive than db operations or copying, sure. But how much more expensive is the question.