logoalt Hacker News

adjejmxbdjdnyesterday at 1:42 PM1 replyview on HN

I don’t understand how that’s possible. They should have had a better idea of what was happening in the memory markets than pretty much any other entity.


Replies

Nevermarkyesterday at 2:15 PM

Their universal RAM strategy is so obviously helpful for AI. (1) GPU/NPU <--> CPU RAM copies eliminated. (2) All (most) RAM available for GPU/Neural, when local models are typically kneecapped by limited GPU RAM sizes vs. the much larger RAM options for M/Max/Pro/Ultras.

They have been taking NPU's seriously on their phones, tablets and laptops since the M1.

Then they enabled fully-connected RDMA for 4 x 512GB MacStudio's = 2TB RAM. Perfect for a large Mixture-of-Experts model.

It would be very strange if they didn't notice their product line had landed in a new sweet spot.

show 2 replies