TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica. TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models. In Marina Meila, Tong Zhang 0001, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event. Volume 139 of Proceedings of Machine Learning Research, pages 6543-6552, PMLR, 2021. [doi]

This author has not been identified. Look up 'Zhuohan Li' in GoogleThis author has not been identified. Look up 'Siyuan Zhuang' in GoogleThis author has not been identified. Look up 'Shiyuan Guo' in GoogleThis author has not been identified. Look up 'Danyang Zhuo' in GoogleThis author has not been identified. Look up 'Hao Zhang' in GoogleThis author has not been identified. Look up 'Dawn Song' in GoogleThis author has not been identified. Look up 'Ion Stoica' in Google

runs on WebDSL