logoalt Hacker News

s2ltoday at 10:48 AM1 replyview on HN

What if one wishes to use various busybox nodes within the house?

All the iot devices contributing to matmul but within a LAN?


Replies

vfornotoday at 11:02 AM

Because everything stays local and latency is tiny, even modest always-on devices can contribute. A few Raspberry Pi 5s, old mini-PCs, or stronger IoT-style boards can each hold and run a handful of experts. The protocol doesn’t care if the peer is a big GPU or a small ARM box, as long as it can load the expert weights and do the matmul. Pure busybox-class sensors are usually too limited in RAM and compute for current MoE experts, but the broader “every half-decent always-on box in the house joins the swarm” vision works well and keeps everything private inside your LAN.