Can you give a few penciled numbers?
You can rent a H100 GPU for $4/hour. [1]
300k tokens for that hour.
OpenAI charges $6.
Those are pessimistic assumptions.
[1] https://lambda.ai/instances
alt Hacker News
You can rent a H100 GPU for $4/hour. [1]
300k tokens for that hour.
OpenAI charges $6.
Those are pessimistic assumptions.
[1] https://lambda.ai/instances