logoalt Hacker News

TZubiriyesterday at 9:09 PM1 replyview on HN

I have seen exactly one model that charges more for longer contexts:

https://ai.google.dev/gemini-api/docs/pricing

Gemini 1M context window

That said the cost increase isn't very significant, approximately 2x at the longer end of the context window.

This is in stark contrast with the quadratic phenomenon claimed by the article.


Replies

lostmsuyesterday at 10:41 PM

They just do averaging. Imagine a quadratic pricing structure. Who'd want to deal with it?