TensorOpt: Exploring the Tradeoffs in Distributed DNN Training With Auto-Parallelism

Zhenkun Cai, Xiao Yan 0002, Kaihao Ma, Yidi Wu, Yuzhen Huang, James Cheng, Teng Su, Fan Yu. TensorOpt: Exploring the Tradeoffs in Distributed DNN Training With Auto-Parallelism. IEEE Trans. Parallel Distrib. Syst., 33(8):1967-1981, 2022. [doi]

Abstract

Abstract is missing.