Darn, I was hoping to see bc-250's (aka PS5 chips) in there. They've recently become popular for inference and they are only about $200 on ebay. They hold a special place in my heart because I deployed 20k of them and I'm glad to see they are finding a purpose now and not just e-waste.
Wow holy crap this is news to me! I will have to consider picking some of these up for testing, what is it like working with them?
Interesting! I had only heard of them as cheap gaming boxes. Didn't know they were being used for cheap inference, too, but it makes sense.
> They hold a special place in my heart because I deployed 20k
Sounds like something I'd love to hear more about if you can share