alt Hacker NewsI’m still not convinced by the value of local models. It feels like ray-tracing where we are driving up the compute cost for a high cost and fringe benefit.
I’m still not convinced by the value of local models. It feels like ray-tracing where we are driving up the compute cost for a high cost and fringe benefit.
It's not worth it yet when datacenter compute is being subsidized and consumer hardware is massively overpriced, but the tipping point will come where it makes far more sense.
Particularly with Chinese companies pushing to get more out of smaller models. You can run really capable models on the top end macs right now, it just costs way more than buying credits.