Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling

Hongyu Gong, Yun Tang, Juan Pino, Xian Li. Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 2668-2681, 2021. [doi]

Authors

Hongyu Gong

This author has not been identified. Look up 'Hongyu Gong' in Google

Yun Tang

This author has not been identified. Look up 'Yun Tang' in Google

Juan Pino

This author has not been identified. Look up 'Juan Pino' in Google

Xian Li

This author has not been identified. Look up 'Xian Li' in Google