Can you give me a name please? Is that distributed llama or something else?
I have not used it but this is probably it: https://github.com/lyogavin/airllm
alt Hacker News
I have not used it but this is probably it: https://github.com/lyogavin/airllm