Shogo Murai, Hiroaki Mikami, Masanori Koyama, Shuji Suzuki, Takuya Akiba. Online-Codistillation Meets LARS, Going beyond the Limit of Data Parallelism in Deep Learning. In Fourth IEEE/ACM Workshop on Deep Learning on Supercomputers, DLS@SC 2020, Atlanta, GA, USA, November 11, 2020. pages 1-9, IEEE, 2020. [doi]
Abstract is missing.