logoalt Hacker News

pocketarcyesterday at 7:23 PM1 replyview on HN

You’re running 48GB now but imagine a future where everyone has 512GB RAM or 1TB RAM in their computers (it might sound like a lot but also 20 years ago we had 512MB PCs).

It’s not hard to imagine what 5-10 years of pressure to increase RAM will do to specs, on top of the normal tech improvements.

That’s worth bearing in mind when thinking about local models.

Plus, local models keep getting better and better; 2 years ago what you could get out of those 48GB of RAM was embarrassing compared to what’s doable today.

We’re getting there. Just takes time.


Replies

xyzsparetimexyzyesterday at 11:35 PM

I seriously doubt that we'll be running 1TB ram setups any time soon. I was hearing about people running 64GB back in 2014 or so