Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative

Lucio M. Dery, Paul Michel, Ameet Talwalkar, Graham Neubig. Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. [doi]

Authors

Lucio M. Dery

This author has not been identified. Look up 'Lucio M. Dery' in Google

Paul Michel

This author has not been identified. Look up 'Paul Michel' in Google

Ameet Talwalkar

This author has not been identified. Look up 'Ameet Talwalkar' in Google

Graham Neubig

This author has not been identified. Look up 'Graham Neubig' in Google