logoalt Hacker News

buckle8017today at 5:07 PM0 repliesview on HN

It's slower than the 4:1 ratio would imply, but it does indeed work.

Things get really slow if the model doesn't for in vram + ram and you have to go from disk to ram to vram.