logoalt Hacker News

thomasm6m6today at 5:11 AM1 replyview on HN

FYI, llama.cpp (which antirez/ds4 is inspired by) supports system ram. E.g. [1] is a good guide for running a similar-sized model with 128gb ram and a 3090-sized GPU.

[1] https://unsloth.ai/docs/models/tutorials/minimax-m27

(Unsloth's deepseek-v4 support is still WIP)


Replies

DeathArrowtoday at 6:09 AM

Thanks, I can run Qwen 3.6 27B with vllm, but I was curious about antirez tool.

show 1 reply