llama-server from the llama.cpp package has a local web interface.
yes. I've used it a lot. its very simple and good
alt Hacker News
yes. I've used it a lot. its very simple and good