Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution

Ananya Kumar, Aditi Raghunathan, Robbie Matthew Jones, Tengyu Ma 0001, Percy Liang. Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. [doi]

Authors

Ananya Kumar

This author has not been identified. Look up 'Ananya Kumar' in Google

Aditi Raghunathan

This author has not been identified. Look up 'Aditi Raghunathan' in Google

Robbie Matthew Jones

This author has not been identified. Look up 'Robbie Matthew Jones' in Google

Tengyu Ma 0001

This author has not been identified. Look up 'Tengyu Ma 0001' in Google

Percy Liang

This author has not been identified. Look up 'Percy Liang' in Google