Ammar Ahmad Awan, Karthik Vadambacheri Manian, Ching-Hsiang Chu, Hari Subramoni, Dhabaleswar K. Panda. Optimized large-message broadcast for deep learning workloads: MPI, MPI+NCCL, or NCCL2?. Parallel Computing, 85:141-152, 2019. [doi]
Abstract is missing.