logoalt Hacker News

luizfelberti • today at 8:25 PM • 0 replies • view on HN

This reminds me of this blog post[0] where they intercept calls to the CUDA API from one host to execute them in a separate host, essentially giving GPUs to VMs that have none, and allowing one GPU to serve multiple instances.

[0]: https://loopholelabs.io/blog/ollama-remote-gpu