What’s your local setup? I’d love to give it a spin; lack of 5 hours limits is much needed.
Qwen 3.8 (and maybe soon 4) series models are probably the best right now for local AI. Specifically, for lower end hardware like 8gb GPUs you might find a lot of use in a Qwen 3.8 variant like Underdog Saluki 27B.
alt Hacker News
Qwen 3.8 (and maybe soon 4) series models are probably the best right now for local AI. Specifically, for lower end hardware like 8gb GPUs you might find a lot of use in a Qwen 3.8 variant like Underdog Saluki 27B.