logoalt Hacker News

thellimistyesterday at 9:34 PM1 replyview on HN

What do you mean?


Replies

hiccuphippoyesterday at 10:16 PM

The article says the LLM has to load 15540 tokens every time, I wonder if that can be reduced while retaining the context maybe with deduplications, removing superfluous words, using shorter expressions with the same meaning or things like that.