alt Hacker NewsI would like to see in such simulators:
- multi GPU configuration (hetero and homo)
- PCIe gen chooser (3.0/4.0/5.0)
- is nvlink enabled (2 cards, 2 x 2 cards, 3 x 2 cards)
- is PCIe bifurcated or CPU native (threadripper pro for example)
Replies
mkesper • today at 12:57 PM
Nvlink just is not available above 3090 and below B200 (datacenter stuff). E.g. https://www.gpuyard.com/tutorials/howto/setup-nvlink-blackwe...
My take as well. The dual-3090 and dual-spark configs have an outsized voice in this conversation. I'd add pipeline parallelism vs tensor parallelism and in the case of TP setting your lanes and speeds per card.