alt Hacker NewsThe $1500 Intel B70 with 32GB of VRAM can run this model at max context with good performance, btw. If you don't want to drop $5-10k for running DeepSeek this is your best budget option for local refactor/small scale dev help
Replies
aappleby • today at 5:40 PM
I have a B70, what llama options are you using and what performance are you seeing?
segmondy • today at 5:23 PM
You don't need $10k to run DeepSeek, I run it on a $1000 system.
➕ show 2 replies
bogzz • today at 4:53 PM
Oh, can it work with the /v1/completions/ auto-complete endpoint?
➕ show 1 reply
I understand the B70 is a bargain vs AMD and especially nVidia offerings, but to me it feels like I would be buying something that would feel too limited in less than a year. 48G would be much more confortable.
And I know the 96G nVidia cards are selling for over 10k$.
The future can’t arrive fast enough!