MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud

Zhen Zhang, Shuai Zheng 0004, Yida Wang, Justin Chiu, George Karypis, Trishul Chilimbi, Mu Li 0003, Xin Jin 0008. MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud. PVLDB, 16(1):37-50, 2022. [doi]

Abstract

Abstract is missing.