Pattern Shifting or Knowledge Losing? A Forgetting Perspective for Understanding the Effect of Instruction Fine-Tuning

Chunkang Zhang, Boxi Cao, Yaojie Lu 0001, Hongyu Lin, Liu Cao, Ke Zeng, Guanglu Wan, Xunliang Cai, Xianpei Han, Le Sun 0001. Pattern Shifting or Knowledge Losing? A Forgetting Perspective for Understanding the Effect of Instruction Fine-Tuning. In Maosong Sun 0001, Jiye Liang, Xianpei Han, Zhiyuan Liu 0001, Yulan He, Gaoqi Rao, Yubo Chen 0001, Zhiliang Tian, editors, Chinese Computational Linguistics - 23rd China National Conference, CCL 2024, Taiyuan, China, July 25-28, 2024, Proceedings. Volume 14761 of Lecture Notes in Computer Science, pages 540-554, Springer, 2024. [doi]