CPM-2: Large-scale cost-effective pre-trained language models

Zhengyan Zhang, Yuxian Gu, Xu Han 0007, Shengqi Chen 0001, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke, Yanzheng Cai, Guoyang Zeng, Zhixing Tan, Zhiyuan Liu 0001, Minlie Huang, Wentao Han, Yang Liu, Xiaoyan Zhu 0001, Maosong Sun. CPM-2: Large-scale cost-effective pre-trained language models. AI Open, 2:216-224, 2021. [doi]

Abstract

Abstract is missing.