logoalt Hacker News

ycui7today at 5:26 PM0 repliesview on HN

if you have the VRAM, use offical release. quantized model lose focus after long context and can do damages or thinking loop