logoalt Hacker News

y1n0today at 1:47 AM0 repliesview on HN

Anybody have an idea of what the flops per token generated is on a SOTA model like current GPT/OPUS? Is it basically the parameter count? So something like GLM-5.2 is, at a minimum, ~744 GFLOPs per token generated?

Am I way off base? Seems astronomical.