512GB unified memory is targeting local inference of large models, or local training of non-frontier...

bitmasher9 • today at 6:09 PM • 1 reply • view on HN

512GB unified memory is targeting local inference of large models, or local training of non-frontier models.

drnick1 • today at 6:17 PM

I doubt you can run a model that requires hundreds of GB of RAM at an acceptable speed (tok/s) on a MacBook.

➕ show 1 reply

alt Hacker News