alt Hacker NewsSome of the math I see in this thread justifying local LLM hardware reminds me of “hobby math” where someone wants to justify a hobby expenditure and tortures the comparisons until they think they’re winning.
You do local LLM stuff either because you’re strict about privacy or because you want to play with it.
Any argument that you’re going to replace a Claude subscription with a highly quantized model at 20 tokens/sec is delusional thinking.
I think can both agree that if you use your claude subscription to transform an occasional document, muse out a random idea into a single page app, answer questions with research, etc - as I suspect most subscribers do - yes that could absolutely be replaced with a self hosted model.
If you use claude for coding large complex apps, I will concede that’s more debatable - it depends on how you work with the tools, i think. For me, they work.