AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata Mukherjee, Xiaodong Liu 0003, Jing Gao 0004, Ahmed Hassan Awadallah, Jianfeng Gao. AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11. pages 5744-5760, Association for Computational Linguistics, 2022. [doi]

Authors

Yaqing Wang

This author has not been identified. Look up 'Yaqing Wang' in Google

Sahaj Agarwal

This author has not been identified. Look up 'Sahaj Agarwal' in Google

Subhabrata Mukherjee

This author has not been identified. Look up 'Subhabrata Mukherjee' in Google

Xiaodong Liu 0003

This author has not been identified. Look up 'Xiaodong Liu 0003' in Google

Jing Gao 0004

This author has not been identified. Look up 'Jing Gao 0004' in Google

Ahmed Hassan Awadallah

This author has not been identified. Look up 'Ahmed Hassan Awadallah' in Google

Jianfeng Gao

This author has not been identified. Look up 'Jianfeng Gao' in Google