Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization

Jeonghoon Kim, Jung-Hyun Lee, Sungdong Kim, Joonsuk Park, Kang Min Yoo, Se Jung Kwon, Dongsoo Lee. Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

Authors

Jeonghoon Kim

This author has not been identified. Look up 'Jeonghoon Kim' in Google

Jung-Hyun Lee

This author has not been identified. Look up 'Jung-Hyun Lee' in Google

Sungdong Kim

This author has not been identified. Look up 'Sungdong Kim' in Google

Joonsuk Park

This author has not been identified. Look up 'Joonsuk Park' in Google

Kang Min Yoo

This author has not been identified. Look up 'Kang Min Yoo' in Google

Se Jung Kwon

This author has not been identified. Look up 'Se Jung Kwon' in Google

Dongsoo Lee

This author has not been identified. Look up 'Dongsoo Lee' in Google