How did you guys set up the RL topology? Were you guys doing individual RL nodes (4xh200 rollout/4xh200 train) or did you have dedicated trainer and rollout nodes?
Dedicated rollout and trainer nodes, with RDMA transfers between them.
Dedicated rollout and trainer nodes, with RDMA transfers between them.