alt Hacker News> Open Source AI is challenging. Even tiny models require tremendous resources to produce, so all the things we know about "open source" for software, like a random person in Nebraska can produce a critical piece of the world's infrastructure in their spare time, don't apply.
No, but a small university team with dark time on the state school system's cluster can build a basic, functional LLM.
It will be a few years (or more) until true "open source" LLMs are available and high quality, for sure. But it's not as impenetrable as it seems, IMO.
"No, but a small university team with dark time on the state school system's cluster can build a basic, functional LLM."
Hey, remember when we were just talking about how it "needs public funding and reputable institutions as stewards of that funding"? (Hint: A state school system is a reputable institution running on public funding.)