A layer-block-wise pipeline for memory and bandwidth reduction in distributed deep learning

Haruki Mori, Tetsuya Youkawa, Shintaro Izumi, Masahiko Yoshimoto, Hiroshi Kawaguchi, Atsuki Inoue. A layer-block-wise pipeline for memory and bandwidth reduction in distributed deep learning. In Naonori Ueda, Shinji Watanabe, Tomoko Matsui, Jen-Tzung Chien, Jan Larsen, editors, 27th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2017, Tokyo, Japan, September 25-28, 2017. pages 1-6, IEEE, 2017. [doi]

Abstract

Abstract is missing.