alt Hacker NewsInteresting. So if the LLM is having a discussion with itself, am I paying for the tokens it uses for that?
Replies
nhecker • today at 7:41 PM
Yes, those tokens cost money|credits|whatever too.
Interesting. So if the LLM is having a discussion with itself, am I paying for the tokens it uses for that?
Yes, those tokens cost money|credits|whatever too.
I think so, yes.
When I make API calls, the discussion with itself is part of my token cost, so I assume that is the same in the subscription plans.
Which is why people are surprised when they use their whole allocation in half an hour asking questions Fable about 200 page document.