alt Hacker NewsWhy isnt LLM training itself open sourced? With all the compute in the world, something like Folding@home here would be killer
Replies
DesaiAshu • last Sunday at 11:51 PM
data bandwidth limits distributed training under current architectures. really interesting implications if we can make progress on that
➕ show 1 reply
throwaway27448 • yesterday at 2:53 PM
It's either illegal or extremely expensive to source quality training material.
➕ show 1 reply
doctorwho42 • yesterday at 4:30 PM
Well it is, it's in the name "OpenAI". /S
It is in some cases. NVIDIA's models are open source, in the truest sense that you can download the training set and training scripts and make your own.