logoalt Hacker News

jm4today at 6:56 PM1 replyview on HN

I probably have the same strix halo box as you. It's slow, although mostly tolerable, but even 128 GB isn't enough to run good models. Where that leaves us is giving money to somebody to get access to frontier models. I don't like any of those guys either, but some appear worse than others. FWIW, I mostly use Anthropic models. And CCP and their distilled models notwithstanding, at least they release open weight models at a lower cost. It's not like any American company can claim the higher ground these days anyway, especially when they trained their models on pirated content and trash our neighborhoods with their datacenters.


Replies

bakiestoday at 9:42 PM

Couple of years with some bandwidth improvements and higher RAM capacity might do some wonders