SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Mingshu Zhai, Jiaao He, Zixuan Ma, Zan Zong, Runqing Zhang, Jidong Zhai. SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization. In Julia Lawall, Dan Williams, editors, 2023 USENIX Annual Technical Conference, USENIX ATC 2023, Boston, MA, USA, July 10-12, 2023. pages 961-975, USENIX Association, 2023. [doi]

This author has not been identified. Look up 'Mingshu Zhai' in GoogleThis author has not been identified. Look up 'Jiaao He' in GoogleThis author has not been identified. Look up 'Zixuan Ma' in GoogleThis author has not been identified. Look up 'Zan Zong' in GoogleThis author has not been identified. Look up 'Runqing Zhang' in GoogleThis author has not been identified. Look up 'Jidong Zhai' in Google

runs on WebDSL