alt Hacker Newshttps://hugovergnes.github.io/little-lm-3-8b/ << less than $1k for a 4B model
Remember how DeepSeek v.whatever cost ~$5m
Stable Diffusion 1.5 was reportedly $70k in compute.
https://hugovergnes.github.io/little-lm-3-8b/ << less than $1k for a 4B model
Remember how DeepSeek v.whatever cost ~$5m
Stable Diffusion 1.5 was reportedly $70k in compute.
None of those are frontier models, nor could they have been. E.g. DeepSeek's "$5 million" included piggybacking off OpenAI/Anthropic's hundreds of millions/billions by using distillation.