CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models

Zi Gong, Hang Yu 0002, Cong Liao, Bingchang Liu, Chaoyu Chen, Jianguo Li. CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models. In Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen, editors, Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024. pages 8063-8077, Association for Computational Linguistics, 2024. [doi]

Abstract

Abstract is missing.