MoE models can use system memory along with a GPU. | alt Hacker News

alt Hacker News

colordrops • yesterday at 6:37 AM • 1 reply • view on HN

MoE models can use system memory along with a GPU.

Replies

formvoltron • yesterday at 3:18 PM

and get high token bandwidth?

➕ show 2 replies