PoWER-BERT: Accelerating BERT Inference via Progressive Word-vector Elimination

Saurabh Goyal, Anamitra Roy Choudhury, Saurabh Raje, Venkatesan T. Chakaravarthy, Yogish Sabharwal, Ashish Verma. PoWER-BERT: Accelerating BERT Inference via Progressive Word-vector Elimination. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event. Volume 119 of Proceedings of Machine Learning Research, pages 3690-3699, PMLR, 2020. [doi]

@inproceedings{GoyalCRCSV20,
  title = {PoWER-BERT: Accelerating BERT Inference via Progressive Word-vector Elimination},
  author = {Saurabh Goyal and Anamitra Roy Choudhury and Saurabh Raje and Venkatesan T. Chakaravarthy and Yogish Sabharwal and Ashish Verma},
  year = {2020},
  url = {http://proceedings.mlr.press/v119/goyal20a.html},
  researchr = {https://researchr.org/publication/GoyalCRCSV20},
  cites = {0},
  citedby = {0},
  pages = {3690-3699},
  booktitle = {Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event},
  volume = {119},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
}