Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions

Kaiqi Zhao 0002, Animesh Jain, Ming Zhao. Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions. In Francisco J. R. Ruiz, Jennifer G. Dy, Jan-Willem van de Meent, editors, International Conference on Artificial Intelligence and Statistics, 25-27 April 2023, Palau de Congressos, Valencia, Spain. Volume 206 of Proceedings of Machine Learning Research, pages 10470-10486, PMLR, 2023. [doi]

@inproceedings{0002JZ23,
  title = {Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions},
  author = {Kaiqi Zhao 0002 and Animesh Jain and Ming Zhao},
  year = {2023},
  url = {https://proceedings.mlr.press/v206/zhao23b.html},
  researchr = {https://researchr.org/publication/0002JZ23},
  cites = {0},
  citedby = {0},
  pages = {10470-10486},
  booktitle = {International Conference on Artificial Intelligence and Statistics, 25-27 April 2023, Palau de Congressos, Valencia, Spain},
  editor = {Francisco J. R. Ruiz and Jennifer G. Dy and Jan-Willem van de Meent},
  volume = {206},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
}