GhostBERT: Generate More Features with Cheap Operations for BERT

Zhiqi Huang, Lu Hou, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu. GhostBERT: Generate More Features with Cheap Operations for BERT. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. pages 6512-6523, Association for Computational Linguistics, 2021. [doi]

Abstract

Abstract is missing.