logoalt Hacker News

phoghed • yesterday at 4:28 PM • 0 replies • view on HN

How does this change that? You could already run open models with vLLM (note models, not just a single model like this release), which many companies do. DeepSeek’s fork of that will surely improve the self hosting landscape, but I don’t see how it it’s some “nuke” or “kamikaze” as the top comments are implying.

Also note that this is not a complete solution for self hosting. I assume that parts of this will be upstreamed to vLLM which this forked a while ago.