logoalt Hacker News

tarrudatoday at 9:24 AM1 replyview on HN

> It also includes additional 196B Engram memory which you can put on an SSD. I think

You can put Qwen 3.8 Flash Next engram on SSD, but prompt processing takes a good hit. On my mac studio, I get 300 pp and 33 tg with SSD offload, versus 550/40 with everything in RAM.

I will be very happy if 300 pp is achievable with this model though.


Replies

hadlocktoday at 10:22 AM

You can warm cache regularly used engram/n-gram if you're willing to merge PRs into a personal branch and build it yourself. I was trying this with qwen 3.8 flash next and the n-gram to get it to fit on my very average gaming desktop (it worked)