Sign bit is enough: a learning synchronization framework for multi-hop all-reduce with ultimate compression

Feijie Wu, Shiqi He, Song Guo 0001, Zhihao Qu, Haozhao Wang, Weihua Zhuang, Jie Zhang 0076. Sign bit is enough: a learning synchronization framework for multi-hop all-reduce with ultimate compression. In Rob Oshana, editor, DAC '22: 59th ACM/IEEE Design Automation Conference, San Francisco, California, USA, July 10 - 14, 2022. pages 193-198, ACM, 2022. [doi]

Abstract

Abstract is missing.