alt Hacker NewsRunning local LLMs split across machines. Pretty sure the author has some other posts about doing that.
Edit: https://www.jeffgeerling.com/blog/2025/15-tb-vram-on-mac-stu...
Running local LLMs split across machines. Pretty sure the author has some other posts about doing that.
Edit: https://www.jeffgeerling.com/blog/2025/15-tb-vram-on-mac-stu...
correct me if I'm wrong but wouldn't a Thunderbolt 5 cable $79 from Apple[1] work better for that? It gets 80 Gbps and doesn't need any extra equipment.
[1] https://www.apple.com/shop/product/mdw94am/a/thunderbolt-5-u...