alt Hacker NewsYou will need 100s of billions to make a viable POC.
Replies
AlexCoventry • yesterday at 10:48 PM
You only need to train a range of small models in order to establish a plausible scaling law, IMO.
You will need 100s of billions to make a viable POC.
You only need to train a range of small models in order to establish a plausible scaling law, IMO.
For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude