And it's even cheaper on third party providers. For example the cheapest fp8 on openrouter is $0.5586 input, $0.1037 cached input, $1.756 output. And obviously less on fp4.
third party providers can have really bad latency and other issues though, so probably can't trust the lowest prices you find
third party providers can have really bad latency and other issues though, so probably can't trust the lowest prices you find