I'd love a way to do this locally -- pool all the PCs in our own office for in-office pools of ...

TuringNYC • today at 4:53 AM • 3 replies • view on HN

I'd love a way to do this locally -- pool all the PCs in our own office for in-office pools of compute. Any suggestions from anyone? We currently run ollama but manually manage the pools

Replies

damezumari • today at 5:00 AM

https://github.com/exo-explore/exo

utopiah • today at 7:56 AM

Seems like so much more work than "just" paying for https://huggingface.co or whichever other neocloud who already did all the setup for you and just waits for your credit card per minute/seconds/token.

zozbot234 • today at 8:09 AM

If you set CPUSchedulingPolicy=idle Nice=19 IOSchedulingClass=idle in the ollama server configuration it should run in the background with lowest priority.

alt Hacker News

Replies