LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning

Zihang Liu, Tianyu Pang, Oleg Balabanov, Chaoqun Yang, Tianjin Huang, Lu Yin 0006, Yaoqing Yang, Shiwei Liu 0003. LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning. In Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025. OpenReview.net, 2025. [doi]

Authors

Zihang Liu

This author has not been identified. Look up 'Zihang Liu' in Google

Tianyu Pang

This author has not been identified. Look up 'Tianyu Pang' in Google

Oleg Balabanov

This author has not been identified. Look up 'Oleg Balabanov' in Google

Chaoqun Yang

This author has not been identified. Look up 'Chaoqun Yang' in Google

Tianjin Huang

This author has not been identified. Look up 'Tianjin Huang' in Google

Lu Yin 0006

This author has not been identified. Look up 'Lu Yin 0006' in Google

Yaoqing Yang

This author has not been identified. Look up 'Yaoqing Yang' in Google

Shiwei Liu 0003

This author has not been identified. Look up 'Shiwei Liu 0003' in Google