alt Hacker NewsIt was for my team. Running useful LLMs on battery power is neat for example. Some simply care a bit about sustainability.
It’s also good value if you want a lot of memory.
What would you advice for people with a similar budget? It’s a real question.
But you arent really running LLMs. You just say you are.
There is novelty, but not practical use case.
My $700, 2023, 3060 laptop runs 8B models. At the enterprise level we got 2, A6000s.
Both are useful and were used for economic gain. I don't think you have gotten any gain.