logoalt Hacker News

RandyOrion • today at 3:23 AM • 0 replies • view on HN

Nice to see another open weight model.

I cannot evaluate how valuable this model is based on the performance table alone because the comparison is kind of narrow. Waiting for third-party benchmarks to provide more information.

I do not have the hardware to run it properly without super-heavy quantization (about q2). Besides, the architecture is not optimized for local usage (sliding window attention also requires KV cache). I think I will just move on.