I was just thinking about this project the other day. Seems we have a whole lot of unused compute (and now GPU). I wish someone would create a meaningful project like this to distribute AI training or something. Imagine underfunded AI researchers being able to distribute work to idle machines like SETI@home did.
Asked Gemini about that: "are there efforts to train big LLM in a distributed fashion à la seti@home ? "
answer was really interesing: - https://github.com/PrimeIntellect-ai/prime - https://www.together.ai/