AdaDS: Adaptive data selection for accelerating pre-trained language model knowledge distillation

Qinhong Zhou, Peng Li 0030, Yang Liu, Yuyang Guan, Qizhou Xing, Ming Chen, Maosong Sun 0001, Yang Liu 0005. AdaDS: Adaptive data selection for accelerating pre-trained language model knowledge distillation. AI Open, 4:56-63, January 2023. [doi]

Authors

Qinhong Zhou

This author has not been identified. Look up 'Qinhong Zhou' in Google

Peng Li 0030

This author has not been identified. Look up 'Peng Li 0030' in Google

Yang Liu

This author has not been identified. Look up 'Yang Liu' in Google

Yuyang Guan

This author has not been identified. Look up 'Yuyang Guan' in Google

Qizhou Xing

This author has not been identified. Look up 'Qizhou Xing' in Google

Ming Chen

This author has not been identified. Look up 'Ming Chen' in Google

Maosong Sun 0001

This author has not been identified. Look up 'Maosong Sun 0001' in Google

Yang Liu 0005

This author has not been identified. Look up 'Yang Liu 0005' in Google