alt Hacker NewsYeah, why didn't I think of just spending $30k/month on an inference server and figuring out how to train a 2T parameter model. I clearly don't care about this at all or I would just do that.
Replies
nozzlegear • today at 5:42 PM
> and figuring out how to train a 2T parameter model
Why train your own model? You could use one of the many models already available on HF.
Deep seek have released their inference engine.
https://github.com/deepseek-ai/DeepInfer