Ashutosh Adhikari, Achyudh Ram, Raphael Tang, William L. Hamilton, Jimmy Lin. Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT. In Spandana Gella, Johannes Welbl, Marek Rei, Fabio Petroni, Patrick S. H. Lewis, Emma Strubell, Min Joon Seo, Hannaneh Hajishirzi, editors, Proceedings of the 5th Workshop on Representation Learning for NLP, RepL4NLP@ACL 2020, Online, July 9, 2020. pages 72-77, Association for Computational Linguistics, 2020. [doi]
Abstract is missing.