Optimized large-message broadcast for deep learning workloads: MPI, MPI+NCCL, or NCCL2?

Ammar Ahmad Awan, Karthik Vadambacheri Manian, Ching-Hsiang Chu, Hari Subramoni, Dhabaleswar K. Panda. Optimized large-message broadcast for deep learning workloads: MPI, MPI+NCCL, or NCCL2?. Parallel Computing, 85:141-152, 2019. [doi]

References

No references recorded for this publication.

Cited by

No citations of this publication recorded.