AdaDS: Adaptive data selection for accelerating pre-trained language model knowledge distillation

Qinhong Zhou, Peng Li 0030, Yang Liu, Yuyang Guan, Qizhou Xing, Ming Chen, Maosong Sun 0001, Yang Liu 0005. AdaDS: Adaptive data selection for accelerating pre-trained language model knowledge distillation. AI Open, 4:56-63, January 2023. [doi]

@article{ZhouLLGXCSL23,
  title = {AdaDS: Adaptive data selection for accelerating pre-trained language model knowledge distillation},
  author = {Qinhong Zhou and Peng Li 0030 and Yang Liu and Yuyang Guan and Qizhou Xing and Ming Chen and Maosong Sun 0001 and Yang Liu 0005},
  year = {2023},
  month = {January},
  doi = {10.1016/j.aiopen.2023.08.005},
  url = {https://doi.org/10.1016/j.aiopen.2023.08.005},
  researchr = {https://researchr.org/publication/ZhouLLGXCSL23},
  cites = {0},
  citedby = {0},
  journal = {AI Open},
  volume = {4},
  pages = {56-63},
}