Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning

Mitchell A. Gordon, Kevin Duh, Nicholas Andrews. Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning. In Spandana Gella, Johannes Welbl, Marek Rei, Fabio Petroni, Patrick S. H. Lewis, Emma Strubell, Min Joon Seo, Hannaneh Hajishirzi, editors, Proceedings of the 5th Workshop on Representation Learning for NLP, RepL4NLP@ACL 2020, Online, July 9, 2020. pages 143-155, Association for Computational Linguistics, 2020. [doi]

Abstract

Abstract is missing.