Understanding Scalability and Fine-Grain Parallelism of Synchronous Data Parallel Training

Jiali Li, Bogdan Nicolae, Justin Wozniak, George Bosilca. Understanding Scalability and Fine-Grain Parallelism of Synchronous Data Parallel Training. In 2019 IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments, MLHPC@SC, Denver, CO, USA, November 18, 2019. pages 1-8, IEEE, 2019. [doi]

Abstract

Abstract is missing.