logoalt Hacker News

christkv • yesterday at 7:12 PM • 1 reply • view on HN

What inference engine do you use ?


Replies

UncleOxidant • yesterday at 7:46 PM

Gufo. It's the best open source inference engine that's optimized for Strix Halo right now. Halogen may unlock a bit more performance, but it's not open source and gufo seems to be making steady progress.

➕ show 1 reply