logoalt Hacker News

rancor • yesterday at 9:27 PM • 0 replies • view on HN

Since this is basically a wrapper around libllama.so, I would assume that the performance is roughly the same as llama.cpp upstream.