logoalt Hacker News

twampsstoday at 4:24 PM2 repliesview on HN

Is this just llmfit but a web version of it?

https://github.com/AlexsJones/llmfit


Replies

deanctoday at 4:31 PM

Yes. But llmfit is far more useful as it detects your system resources.

show 2 replies
rootusrootustoday at 6:00 PM

That's super handy, thanks for sharing the link. Way more useful than the web site this post is about, to be honest.

It looks like I can run more local LLMs than I thought, I'll have to give some of those a try. I have decent memory (96GB) but my M2 Max MBP is a few years old now and I figured it would be getting inadequate for the latest models. But llmfit thinks it's a really good fit for the vast majority of them. Interesting!

show 1 reply