logoalt Hacker News

redmoonxtoday at 9:59 AM2 repliesview on HN

Llama.cpp team has failed to make their tech easy to install and use for years.

Why can’t they figure it out???


Replies

walrus01today at 10:49 AM

This is like complaining that the mariadb team has failed to make their tech easy to use. It's a server side piece of software. There are plenty of user friendly GUIs or wrappers for it. lm-studio or unsloth are to llama.cpp as something like phpmyadmin is to mysql/mariadb.

72deluxetoday at 10:46 AM

But it is easy ... clone the git repo, make a build dir, cd into it, run cmake .., run build/bin/llama-server -m /path/to/model.gguf

Browse to served web page with chat UI....

By "easy" do you mean "very lazy"?

show 1 reply