logoalt Hacker News

slim • yesterday at 11:44 PM • 1 reply • view on HN

Awesome. How would you setup that ?

Replies

skirmish • today at 1:02 AM

  --no-mmproj-offload
See the documentation: https://github.com/ggml-org/llama.cpp/blob/master/docs/multi...