logoalt Hacker News

flux3125today at 8:05 AM0 repliesview on HN

> so llama-swap can load

Just in case you haven't seen it yet, llama.cpp now has a router mode that lets you hot-swap models. I've switched over from llama-swap and have been happy with it.