logoalt Hacker News

999900000999 • today at 1:30 PM • 2 replies • view on HN

>Oddly, the direction of the problem flips depending on power source. Unplugged, Linux hit around 61 to 67 tokens per second on LM Studio, comparable to Windows. Plugged in, that same test dropped to about 15 tokens per second.

Absolutely hilarious.

This is just incompetence. No reason Nvidia with its TRILLIONS of market cap couldn't of tested and fixed this on Linux before shipping.

Or a day one patch.

I have no doubt that'll it'll work right eventually. Long after RTX Spark laptops flop and can be purchased for half off.

Last night I pulled out my 5070TI laptop and installed CachyOS. I was running various models within about 20 minutes.

That 12GB of VRAM is a hard limitation, Unsloth can't split jobs between vram and system memory.


Replies

throw1234567891 • today at 1:36 PM

> couldn't of tested

Could have tested.

➕ show 1 reply
crest • today at 1:40 PM

What makes you think this was an oversight?

➕ show 1 reply