logoalt Hacker News

fookeryesterday at 2:23 PM1 replyview on HN

I'm claiming that the max amount of intelligence you get out of a 100GB model is unlikely to be that much lower than what you can get out of a 1TB model.


Replies

xyzsparetimexyzyesterday at 4:49 PM

That depends on whether you can separate intelligence from memorization. I think we can agree that theres more than 1 TB of memorizable information in the world, even when highly compressed.

show 1 reply