alt Hacker NewsI tried to run in on my Arc A770, but all of the binary releases I could find were compiled without OpenVINO support enabled. I tried compiling it myself, but after two days of the compiler running it failed.
Replies
numpad0 • today at 7:07 AM
I don't know how it works, but does Vulkan not work on Arc?
cptskippy • today at 7:41 AM
Does the A770 use the Xe driver? If so then it might work with the scripts that I've been using to build llama.cpp with SYCL support for the Arc Pro B70.
https://github.com/cptskippy/battlemage-llm-gateway
It's designed so that you can re-run the scripts to pull the latest updates. When Muse Glimmer was released the other day I just ran the 02 script to build the latest version of llama.cpp with support for it.
OpenArcBob • today at 7:51 AM
[dead]
Two days sounds like a lot, both llama.cpp and openvino only takes a few minutes to compile on any decent modern cpu.