logoalt Hacker News

nout • today at 3:18 AM • 1 reply • view on HN

Multiple teams and efforts are now making Qwen 3.8 27b work much faster on Mac and CUDA and the inference speed is doubling almost every week. There's now ongoing competition about who will make it work faster with exactly the same byte output at https://mlx.fast . TensorFold is the project to follow.


Replies

raffraffraff • today at 8:02 AM

So it's not about the model (eg TensorFold/Qwen3.8-27B-MLX-4bit) it's about the inference engine?