logoalt Hacker News

AureliusMA • today at 10:26 AM • 1 reply • view on HN

How large would a 1 billion token kv even be ?!

Replies

AntiUSAbah • today at 11:02 AM

30TB for 4 bit, 60tb for 8bit res