>Oddly, the direction of the problem flips depending on power source. Unplugged, Linux hit around 61 to 67 tokens per second on LM Studio, comparable to Windows. Plugged in, that same test dropped to about 15 tokens per second.
Absolutely hilarious.
This is just incompetence. No reason Nvidia with its TRILLIONS of market cap couldn't of tested and fixed this on Linux before shipping.
Or a day one patch.
I have no doubt that'll it'll work right eventually. Long after RTX Spark laptops flop and can be purchased for half off.
Last night I pulled out my 5070TI laptop and installed CachyOS. I was running various models within about 20 minutes.
That 12GB of VRAM is a hard limitation, Unsloth can't split jobs between vram and system memory.
> couldn't of tested
Could have tested.