logoalt Hacker News

swingboy • today at 1:35 PM • 1 reply • view on HN

Does DeepSeek provide the inference code along with the weights? I read here recently that for models where only the weights are released, providers have to implement which could be different than what the labs themselves use.


Replies

petu • today at 4:04 PM

There's basic reference inference code released with the weights, yes.

https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017/...

> providers have to implement which could be different than what the labs themselves use.

I'd imagine (most) providers just take implementation by vLLM/SGLang.