AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models

Yichun Yin, Cheng Chen, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu. AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. pages 5146-5157, Association for Computational Linguistics, 2021. [doi]

Authors

Yichun Yin

This author has not been identified. Look up 'Yichun Yin' in Google

Cheng Chen

This author has not been identified. Look up 'Cheng Chen' in Google

Lifeng Shang

This author has not been identified. Look up 'Lifeng Shang' in Google

Xin Jiang

This author has not been identified. Look up 'Xin Jiang' in Google

Xiao Chen

This author has not been identified. Look up 'Xiao Chen' in Google

Qun Liu

This author has not been identified. Look up 'Qun Liu' in Google