logoalt Hacker News

slimtoday at 12:58 AM0 repliesview on HN

llama.cpp can run MoE with some layers in vram and some layers in ram