MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings

Haonan Chen 0005, Hong Liu, Yuping Luo, Liang Wang 0046, Nan Yang 0002, Furu Wei, Zhicheng Dou. MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings. In Maria Liakata, Viviane P. Moreira, Jiajun Zhang 0001, David Jurgens, editors, Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2026, San Diego, California, United States, July 2-7, 2026. pages 810-823, Association for Computational Linguistics, 2026. [doi]

Abstract

Abstract is missing.