Fine-Tuning Language Models with Just Forward Passes

Sadhika Malladi, Tianyu Gao, Eshaan Nichani, Alex Damian, Jason D. Lee, Danqi Chen 0001, Sanjeev Arora. Fine-Tuning Language Models with Just Forward Passes. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

Authors

Sadhika Malladi

This author has not been identified. Look up 'Sadhika Malladi' in Google

Tianyu Gao

This author has not been identified. Look up 'Tianyu Gao' in Google

Eshaan Nichani

This author has not been identified. Look up 'Eshaan Nichani' in Google

Alex Damian

This author has not been identified. Look up 'Alex Damian' in Google

Jason D. Lee

This author has not been identified. Look up 'Jason D. Lee' in Google

Danqi Chen 0001

This author has not been identified. Look up 'Danqi Chen 0001' in Google

Sanjeev Arora

This author has not been identified. Look up 'Sanjeev Arora' in Google