Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning

Mitchell A. Gordon, Kevin Duh, Nicholas Andrews. Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning. In Spandana Gella, Johannes Welbl, Marek Rei, Fabio Petroni, Patrick S. H. Lewis, Emma Strubell, Min Joon Seo, Hannaneh Hajishirzi, editors, Proceedings of the 5th Workshop on Representation Learning for NLP, RepL4NLP@ACL 2020, Online, July 9, 2020. pages 143-155, Association for Computational Linguistics, 2020. [doi]

@inproceedings{GordonDA20,
  title = {Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning},
  author = {Mitchell A. Gordon and Kevin Duh and Nicholas Andrews},
  year = {2020},
  url = {https://www.aclweb.org/anthology/2020.repl4nlp-1.18/},
  researchr = {https://researchr.org/publication/GordonDA20},
  cites = {0},
  citedby = {0},
  pages = {143-155},
  booktitle = {Proceedings of the 5th Workshop on Representation Learning for NLP, RepL4NLP@ACL 2020, Online, July 9, 2020},
  editor = {Spandana Gella and Johannes Welbl and Marek Rei and Fabio Petroni and Patrick S. H. Lewis and Emma Strubell and Min Joon Seo and Hannaneh Hajishirzi},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-952148-15-6},
}