An Efficient Technique for Large Mini-batch Challenge of DNNs Training on Large Scale Cluster

Akihiko Kasagi, Akihiro Tabuchi, Masafumi Yamazaki, Takumi Honda, Masahiro Miwa, Naoto Fukumoto, Tsuguchika Tabaru, Atsushi Ike, Kohta Nakashima. An Efficient Technique for Large Mini-batch Challenge of DNNs Training on Large Scale Cluster. In Manish Parashar, Vladimir Vlassov, David Irwin, Kathryn Mohror, editors, HPDC '20: The 29th International Symposium on High-Performance Parallel and Distributed Computing, Stockholm, Sweden, June 23-26, 2020. pages 203-207, ACM, 2020. [doi]

Abstract

Abstract is missing.