logoalt Hacker News

Eisensteinyesterday at 3:38 PM0 repliesview on HN

Koboldcpp has built in support for image models. Model search and download, one executable to run, UI, OpenAI API endpoint, llama.cpp endpoint, highly configurable. If you want to get up and running instantly, just pick a kcppt file and open that and it will download everything you need and load it for you.

Engine:

* https://github.com/LostRuins/koboldcpp/releases/latest/

Kcppt files:

* https://huggingface.co/koboldcpp/kcppt/tree/main