Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network

Junho Kim, Jun-Hyung Park, Mingyu Lee, Wing-Lam Mok, Joon-Young Choi, SangKeun Lee 0001. Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11. pages 7371-7382, Association for Computational Linguistics, 2022. [doi]

@inproceedings{KimPLMC022,
  title = {Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network},
  author = {Junho Kim and Jun-Hyung Park and Mingyu Lee and Wing-Lam Mok and Joon-Young Choi and SangKeun Lee 0001},
  year = {2022},
  url = {https://aclanthology.org/2022.emnlp-main.498},
  researchr = {https://researchr.org/publication/KimPLMC022},
  cites = {0},
  citedby = {0},
  pages = {7371-7382},
  booktitle = {Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11},
  editor = {Yoav Goldberg and Zornitsa Kozareva and Yue Zhang},
  publisher = {Association for Computational Linguistics},
}