logoalt Hacker News

wernam • yesterday at 8:56 PM • 1 reply • view on HN

AMD Ryzen AI/Strix Halo is for running locally on your hardware. Openrouter is for evaluating the models you'll be running locally, before buying the hardware.

In any case, 128-256GB unified memory systems running MOE models is the "cheap" option, RTX6000 is the step above it.


Replies

the__alchemist • yesterday at 9:04 PM

> 128-256GB unified memory systems running MOE models is the "cheap"

I'm not familiar with these. How much does one cost, and from what store / what product name?