logoalt Hacker News

dist-epoch • yesterday at 9:47 PM • 0 replies • view on HN

AI language will converge towards maximum entropy, like compression, due to cost pressure to conserve tokens. LLMs are not limited by the human 5+-2 working memory