Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization

Shoujie Tong, Heming Xia, Damai Dai, Runxin Xu, Tianyu Liu, Binghuai Lin, Yunbo Cao, Zhifang Sui. Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023. pages 5214-5227, Association for Computational Linguistics, 2023. [doi]

@inproceedings{TongXDXLLCS23,
  title = {Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization},
  author = {Shoujie Tong and Heming Xia and Damai Dai and Runxin Xu and Tianyu Liu and Binghuai Lin and Yunbo Cao and Zhifang Sui},
  year = {2023},
  url = {https://aclanthology.org/2023.findings-emnlp.346},
  researchr = {https://researchr.org/publication/TongXDXLLCS23},
  cites = {0},
  citedby = {0},
  pages = {5214-5227},
  booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023},
  editor = {Houda Bouamor and Juan Pino 0001 and Kalika Bali},
  publisher = {Association for Computational Linguistics},
  isbn = {979-8-89176-061-5},
}