Ah no I hadn't seen that, very interesting.
I'm finding a gap just before running those experiments.
The process of updating firmware, doing basic smoke tests on each device and validating it is live, and can function correctly.
Basically the pre-deployment green light that you get on github, but for hardware.
Have you seen or thought about that at all?
This seems indeed useful. I haven't seen this for robotics but I'm sure people need this for larger deployments (either for a distributed fleet or for an "arm farm"-like setup where there's many robots in one location for data collection / eval). Interesting idea!