logoalt Hacker News

mips_avatar • yesterday at 11:06 PM • 1 reply • view on HN

How did you guys set up the RL topology? Were you guys doing individual RL nodes (4xh200 rollout/4xh200 train) or did you have dedicated trainer and rollout nodes?


Replies

nblintao • today at 1:29 AM

Dedicated rollout and trainer nodes, with RDMA transfers between them.