Understand and Modularize Generator Optimization in ELECTRA-style Pretraining

Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu. Understand and Modularize Generator Optimization in ELECTRA-style Pretraining. In Andreas Krause 0001, Emma Brunskill, KyungHyun Cho, Barbara Engelhardt, Sivan Sabato, Jonathan Scarlett, editors, International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA. Volume 202 of Proceedings of Machine Learning Research, pages 8244-8259, PMLR, 2023. [doi]

Authors

Chengyu Dong

This author has not been identified. Look up 'Chengyu Dong' in Google

Liyuan Liu

This author has not been identified. Look up 'Liyuan Liu' in Google

Hao Cheng

This author has not been identified. Look up 'Hao Cheng' in Google

Jingbo Shang

This author has not been identified. Look up 'Jingbo Shang' in Google

Jianfeng Gao

This author has not been identified. Look up 'Jianfeng Gao' in Google

Xiaodong Liu

This author has not been identified. It may be one of the following persons: Look up 'Xiaodong Liu' in Google