alt Hacker NewsI wrote up a theoretical post here about LMM performance of a MacBook Pro with PIM memory:
https://ben3d.ca/blog/m5-max-samsung-lpddr5-pim-650-tokens-p...
I wrote up a theoretical post here about LMM performance of a MacBook Pro with PIM memory:
https://ben3d.ca/blog/m5-max-samsung-lpddr5-pim-650-tokens-p...
Interesting read. Definitely hoping this works out so we can have cheap LLM machines at home