PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning

Zhisheng Lin, Han Fu, Chenghao Liu, Zhuo Li, Jianling Sun. PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning. In Lun-Wei Ku, Andre Martins, Vivek Srikumar, editors, Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024. pages 6869-6883, Association for Computational Linguistics, 2024. [doi]

@inproceedings{LinFLLS24,
  title = {PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning},
  author = {Zhisheng Lin and Han Fu and Chenghao Liu and Zhuo Li and Jianling Sun},
  year = {2024},
  url = {https://aclanthology.org/2024.findings-acl.410},
  researchr = {https://researchr.org/publication/LinFLLS24},
  cites = {0},
  citedby = {0},
  pages = {6869-6883},
  booktitle = {Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024},
  editor = {Lun-Wei Ku and Andre Martins and Vivek Srikumar},
  publisher = {Association for Computational Linguistics},
  isbn = {979-8-89176-099-8},
}