Just because you CAN load it, doesn't mean you SHOULD load it. Sparse models n such ... but I digress.
Aren't pretty much all models sparse at this point?
Like, I can't imagine opus is cranking through 5T parameters for every token... right?
alt Hacker News
Aren't pretty much all models sparse at this point?
Like, I can't imagine opus is cranking through 5T parameters for every token... right?