Pre-trained models: Past, present and future

Xu Han, Zhengyan Zhang, Ning Ding, Yuxian Gu, Xiao Liu, Yuqi Huo, Jiezhong Qiu, Yuan Yao, Ao Zhang, Liang Zhang, Wentao Han, Minlie Huang, Qin Jin, Yanyan Lan, Yang Liu, Zhiyuan Liu 0001, Zhiwu Lu 0001, Xipeng Qiu, Ruihua Song, Jie Tang 0001, Ji-Rong Wen, Jinhui Yuan, Wayne Xin Zhao, Jun Zhu 0001. Pre-trained models: Past, present and future. AI Open, 2:225-250, 2021. [doi]

Abstract

Abstract is missing.