Shoutout to project nomad.
https://www.projectnomad.us/
its got a ton of useful options, preconfigured, integrates pretty easily, and can use any local LLM or data.
Interesting. I have a mac mini I run headless dedicated for LLM inference. Do you know if I could run project nomad on a linux box but use qwen on the mac for the AI stuff? I can't find any info on if this configuration is possible.
Interesting. I have a mac mini I run headless dedicated for LLM inference. Do you know if I could run project nomad on a linux box but use qwen on the mac for the AI stuff? I can't find any info on if this configuration is possible.