We could create an open-source SETI@HOME but for training open source models?
Someone’s surely doing it atm we just don’t know yet. And then we scan all books but the stuff stays local. Perhaps possible, perhaps not. But I don’t see why everyone could not run given the epoch on his content only, reporting back findings (loss).
is it mathematically viable ? (aka no regression)
Training neural networks is requires extremely high speed interconnect between the humongous GPUs
Covenant-72B
https://arxiv.org/abs/2603.08163
https://huggingface.co/1Covenant/Covenant-72B