what costs do you think are attributable to subscriptions that api customers are already paying for?
For one, GPUs use lower power when not at max utilisation; so electricity (and the cooling of that heat) is a factor.
alt Hacker News
For one, GPUs use lower power when not at max utilisation; so electricity (and the cooling of that heat) is a factor.