logoalt Hacker News

loclol101 • today at 4:55 AM • 1 reply • view on HN

Will it support multi-agent setup across heterogeneous devices (macbook pro, RTX5090, mac mini, etc)?


Replies

anerli • today at 5:33 AM

In the short term we will enable using multiple devices within one machine efficiently and distributing the workload of a model between them. If you mean running the same model distributed across different devices, yes we do have plans to enable that. You should eventually be able to run larger models across machines with capable hardware as long as you can provide a fast enough connection between them.