Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning

Arijit Sehanobish, Kumar Avinava Dubey, Krzysztof Marcin Choromanski, Somnath Basu Roy Chowdhury, Deepali Jain, Vikas Sindhwani, Snigdha Chaturvedi. Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning. In Amir Globersons, Lester Mackey, Danielle Belgrave, Angela Fan, Ulrich Paquet, Jakub M. Tomczak, Cheng Zhang 0005, editors, Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024. 2024. [doi]

Authors

Arijit Sehanobish

This author has not been identified. Look up 'Arijit Sehanobish' in Google

Kumar Avinava Dubey

This author has not been identified. Look up 'Kumar Avinava Dubey' in Google

Krzysztof Marcin Choromanski

This author has not been identified. Look up 'Krzysztof Marcin Choromanski' in Google

Somnath Basu Roy Chowdhury

This author has not been identified. Look up 'Somnath Basu Roy Chowdhury' in Google

Deepali Jain

This author has not been identified. Look up 'Deepali Jain' in Google

Vikas Sindhwani

This author has not been identified. Look up 'Vikas Sindhwani' in Google

Snigdha Chaturvedi

This author has not been identified. Look up 'Snigdha Chaturvedi' in Google