Anybody have an idea of what the flops per token generated is on a SOTA model like current GPT/OPUS? Is it basically the parameter count? So something like GLM-5.2 is, at a minimum, ~744 GFLOPs per token generated?
Am I way off base? Seems astronomical.