Pre-Training Transformers as Energy-Based Cloze Models

Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning. Pre-Training Transformers as Energy-Based Cloze Models. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 285-294, Association for Computational Linguistics, 2020. [doi]

@inproceedings{ClarkLLM20-0,
  title = {Pre-Training Transformers as Energy-Based Cloze Models},
  author = {Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning},
  year = {2020},
  url = {https://www.aclweb.org/anthology/2020.emnlp-main.20/},
  researchr = {https://researchr.org/publication/ClarkLLM20-0},
  cites = {0},
  citedby = {0},
  pages = {285-294},
  booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020},
  editor = {Bonnie Webber and Trevor Cohn and Yulan He and Yang Liu},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-952148-60-6},
}