GPU Cluster Network Topology Design: Fat-Tree, Dragonfly, and Rail-Optimized Architectures
NVIDIA's DGX SuperPOD reference architecture specifies a three-tier fat-tree network topology connecting up to 32 DGX systems using Quantum-2 InfiniBand switches at 400 Gb/s per port. The