https://xcancel.com/finkd/status/2086755195535413696
"... Soon we'll also release the weights for Muse Spark 1.2, our latest foundation model..."
This is bigger news - good for self hosting enthusiasts and a strategically sound move for Meta. Any push towards 'anti Chinese' models will directly benefit Meta as the competition on the frontier open-weights American models is almost non-existent. Meta will have no problem being #1.
Poolside Laguna was quite good too (if you look beyond some of the teething issues).
Had Deepseek V4 Flash 0731 not launched, their latest Laguna release was really intelligent at non-coding tasks and it would have been my go-to model for my local workloads.
Yeah, but if it's huge, how many can run it? Many folks struggle to run 200B+ models
What about Inkling? It's a quite large model that for some reason isn't discussed much.
It wouldn’t surprise me if Meta does become the #1 American open weights provider, but I doubt it’ll be easy. Thinking Machines has a good amount of talent behind them as I understand it and their Inkling model was decent (admittedly not great though). I think Meta’s biggest problem is going to be internal as there’s be a bunch of headlines posted here on their talent retention issues.