logoalt Hacker News

kennywinker • today at 5:38 AM • 0 replies • view on HN

Aren't pretty much all models sparse at this point?

Like, I can't imagine opus is cranking through 5T parameters for every token... right?