alt Hacker NewsWho's the intended user for this?
Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?
Is it a competitor to LMStudio?
Replies
lastdong • yesterday at 9:42 PM
From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.”
huydotnet • yesterday at 10:20 PM
you just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start.
➕ show 1 reply
mlnj • yesterday at 9:40 PM
I am unaware lm studio is being used for fine tuning. I believe it only does inference.
Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy.
Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.
➕ show 1 reply
You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference!
We're complimentary to LM Studio - they have a great tool as well!