What hardware are you running inference on?
I have an Intel Arc Pro B70. Serves me well! I use Qwen 3.8 27B
Running it with Vulkan or SYCL?
Running it with Vulkan or SYCL?