CPM-2: Large-scale cost-effective pre-trained language models

Zhengyan Zhang, Yuxian Gu, Xu Han 0007, Shengqi Chen 0001, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke, Yanzheng Cai, Guoyang Zeng, Zhixing Tan, Zhiyuan Liu 0001, Minlie Huang, Wentao Han, Yang Liu, Xiaoyan Zhu 0001, Maosong Sun. CPM-2: Large-scale cost-effective pre-trained language models. AI Open, 2:216-224, 2021. [doi]

Authors

Zhengyan Zhang

This author has not been identified. Look up 'Zhengyan Zhang' in Google

Yuxian Gu

This author has not been identified. Look up 'Yuxian Gu' in Google

Xu Han 0007

This author has not been identified. Look up 'Xu Han 0007' in Google

Shengqi Chen 0001

This author has not been identified. Look up 'Shengqi Chen 0001' in Google

Chaojun Xiao

This author has not been identified. Look up 'Chaojun Xiao' in Google

Zhenbo Sun

This author has not been identified. Look up 'Zhenbo Sun' in Google

Yuan Yao

This author has not been identified. Look up 'Yuan Yao' in Google

Fanchao Qi

This author has not been identified. Look up 'Fanchao Qi' in Google

Jian Guan

This author has not been identified. Look up 'Jian Guan' in Google

Pei Ke

This author has not been identified. Look up 'Pei Ke' in Google

Yanzheng Cai

This author has not been identified. Look up 'Yanzheng Cai' in Google

Guoyang Zeng

This author has not been identified. Look up 'Guoyang Zeng' in Google

Zhixing Tan

This author has not been identified. Look up 'Zhixing Tan' in Google

Zhiyuan Liu 0001

This author has not been identified. Look up 'Zhiyuan Liu 0001' in Google

Minlie Huang

This author has not been identified. Look up 'Minlie Huang' in Google

Wentao Han

This author has not been identified. Look up 'Wentao Han' in Google

Yang Liu

This author has not been identified. Look up 'Yang Liu' in Google

Xiaoyan Zhu 0001

This author has not been identified. Look up 'Xiaoyan Zhu 0001' in Google

Maosong Sun

This author has not been identified. Look up 'Maosong Sun' in Google