LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning

Zihang Liu, Tianyu Pang, Oleg Balabanov, Chaoqun Yang, Tianjin Huang, Lu Yin 0006, Yaoqing Yang, Shiwei Liu 0003. LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning. In Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025. OpenReview.net, 2025. [doi]

@inproceedings{LiuPBYH0Y025,
  title = {LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning},
  author = {Zihang Liu and Tianyu Pang and Oleg Balabanov and Chaoqun Yang and Tianjin Huang and Lu Yin 0006 and Yaoqing Yang and Shiwei Liu 0003},
  year = {2025},
  url = {https://openreview.net/forum?id=XHHIZNgrho},
  researchr = {https://researchr.org/publication/LiuPBYH0Y025},
  cites = {0},
  citedby = {0},
  booktitle = {Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025},
  publisher = {OpenReview.net},
}