FFT-based Gradient Sparsification for the Distributed Training of Deep Neural Networks

Linnan Wang, Wei Wu 0016, Junyu Zhang, Hang Liu, George Bosilca, Maurice Herlihy, Rodrigo Fonseca. FFT-based Gradient Sparsification for the Distributed Training of Deep Neural Networks. In Manish Parashar, Vladimir Vlassov, David Irwin, Kathryn Mohror, editors, HPDC '20: The 29th International Symposium on High-Performance Parallel and Distributed Computing, Stockholm, Sweden, June 23-26, 2020. pages 113-124, ACM, 2020. [doi]

Abstract

Abstract is missing.