Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching

Mingi Ji, Byeongho Heo, Sungrae Park. Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021. pages 7945-7952, AAAI Press, 2021. [doi]

@inproceedings{JiHP21,
  title = {Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching},
  author = {Mingi Ji and Byeongho Heo and Sungrae Park},
  year = {2021},
  url = {https://ojs.aaai.org/index.php/AAAI/article/view/16969},
  researchr = {https://researchr.org/publication/JiHP21},
  cites = {0},
  citedby = {0},
  pages = {7945-7952},
  booktitle = {Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021},
  publisher = {AAAI Press},
  isbn = {978-1-57735-866-4},
}