I didn't mention DeepSeek, though with the caching effectiveness in Reasonix, you can get DeepSeek for pretty danged cheap directly from deepseek.com, even at the higher prices. I was referring to the many subscriptions available that will sell you quite a lot of usage for $20/month. Given how slow local inference is, you're probably not going to ever get your money back out of it if you just use it for inference (or training/fine-tuning, since you can rent GPUs for a buck or two an hour and ten grand is a lot of hours).
When memory prices come back down, I'll be down to the Apple Store. But, it doesn't make sense to buy hardware right now.
alt Hacker News
I didn't mention DeepSeek, though with the caching effectiveness in Reasonix, you can get DeepSeek for pretty danged cheap directly from deepseek.com, even at the higher prices. I was referring to the many subscriptions available that will sell you quite a lot of usage for $20/month. Given how slow local inference is, you're probably not going to ever get your money back out of it if you just use it for inference (or training/fine-tuning, since you can rent GPUs for a buck or two an hour and ten grand is a lot of hours).
When memory prices come back down, I'll be down to the Apple Store. But, it doesn't make sense to buy hardware right now.