logoalt Hacker News

senordevnyc • yesterday at 1:07 AM • 0 replies • view on HN

Hmm, but I thought that each token generated effectively becomes a part of the context window for the next token. So 1mm context + 1mm output means that the 1 millionth output token will effectively have been generated with ~2mm tokens of context. But maybe that’s wrong.