Aren't pretty much all models sparse at this point?
Like, I can't imagine opus is cranking through 5T parameters for every token... right?