alt Hacker NewsBig ole pool of very fast ram that can be accessed by the CPU and GPU. Lets you run larger models. AMD does the same thing with Strix Halo. I have a 128gb machine at home, and have had difficulties running 120b models, but 70b and below run pretty well.
Replies
dannyw • yesterday at 3:28 PM
AMD Strix Halo unified memory still requires allocating X to GPU, x to CPU at UEFI.
So not as flexible as apple's unified memory.
➕ show 1 reply
> Big ole pool of very fast ram
It’s more that it’s a very parallel architecture than fast.
The LPDDR5X under the hood is slower than what you’d find in a graphics card vram of years ago
That’s why you get consumer macs with 512gb while GPU makers are reluctant to give you more than 16gb unless you pay dearly. It’s not the same kind of mem