Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative

Lucio M. Dery, Paul Michel, Ameet Talwalkar, Graham Neubig. Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. [doi]

@inproceedings{DeryMTN22,
  title = {Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative},
  author = {Lucio M. Dery and Paul Michel and Ameet Talwalkar and Graham Neubig},
  year = {2022},
  url = {https://openreview.net/forum?id=2bO2x8NAIMB},
  researchr = {https://researchr.org/publication/DeryMTN22},
  cites = {0},
  citedby = {0},
  booktitle = {The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022},
  publisher = {OpenReview.net},
}