logoalt Hacker News

barbacoalast Monday at 9:57 PM0 repliesview on HN

I'm running qwen 3.6 27b at 8bit quantization and 262k context. It takes 53gb of vram on my system.