Fine-tuning LLMs with Cross-Attention-based Weight Decay for Bias Mitigation

Farsheed Haque, Zhe Fu, Depeng Xu 0001, Shuhan Yuan, Xi Niu. Fine-tuning LLMs with Cross-Attention-based Weight Decay for Bias Mitigation. In Christos Christodoulopoulos 0001, Tanmoy Chakraborty 0002, Carolyn Rose, Violet Peng, editors, Findings of the Association for Computational Linguistics: EMNLP 2025, Suzhou, China, November 4-9, 2025. pages 15785-15798, Association for Computational Linguistics, 2025. [doi]

Abstract

Abstract is missing.