alt Hacker NewsSo the idea of networking multiple Mac Minis via RDMA over Thunderbolt 5 to run local LLMs is intriguing, but doesn't really seem reasonable at this price point? What are the more cost-effective alternatives?
So the idea of networking multiple Mac Minis via RDMA over Thunderbolt 5 to run local LLMs is intriguing, but doesn't really seem reasonable at this price point? What are the more cost-effective alternatives?
Honestly, waiting 5 years until the supply constraints are lesser