logoalt Hacker News

karahimetoday at 12:50 PM0 repliesview on HN

Sure there are. Ai2's OLMo, EleutherAI's Pythia, and LLM360's Amber are actually open source, top to bottom, training data to checkpoints to code, to name three of them. You also don't have to look far on Huggingface to find smaller models developed with open source processes all the time.