logoalt Hacker News

ar-nelson • yesterday at 7:47 PM • 1 reply • view on HN

Yeah, I was wondering the same thing. I thought about trying to run DeepSeek v4 on my old-but-still-pretty-fast Intel Xeon server with 24 cores and 96GB of DDR4. The "check CPU readiness" script called it "Tier A", so I was optimistic. The default `modchip` app just installs Nemotron and says nothing about DeepSeek. Following the instructions to install their quant of DeepSeek, running it with `modchip start` fails with:

> llama_model_load: error loading model: check_tensor_dims: tensor 'blk.0.ffn_gate_tid2eid.weight' has wrong shape; expected 4, 129280, got 6, 129280, 1, 1

And running the bundled llama-cpp instance from the download, as shown in the readme, fails with "Illegal instruction (core dumped)". So I have no idea how to run this.


Replies

sheepscreek • yesterday at 11:07 PM

This is the point where you could ask an agent to unblock you. Don’t even need a subscription. Download opencode and pick the GLM-5.3-Flash (Free) model. Just be mindful to not use it on anything you don’t want to end up in training.

➕ show 1 reply