Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization

Haode Zhang, Haowen Liang, Yuwei Zhang, Li-Ming Zhan, Xiao-Ming Wu 0003, Xiaolei Lu, Albert Y. S. Lam. Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization. In Marine Carpuat, Marie-Catherine de Marneffe, Iván Vladimir Meza Ruíz, editors, Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10-15, 2022. pages 532-542, Association for Computational Linguistics, 2022. [doi]

Authors

Haode Zhang

This author has not been identified. Look up 'Haode Zhang' in Google

Haowen Liang

This author has not been identified. Look up 'Haowen Liang' in Google

Yuwei Zhang

This author has not been identified. Look up 'Yuwei Zhang' in Google

Li-Ming Zhan

This author has not been identified. Look up 'Li-Ming Zhan' in Google

Xiao-Ming Wu 0003

This author has not been identified. Look up 'Xiao-Ming Wu 0003' in Google

Xiaolei Lu

This author has not been identified. Look up 'Xiaolei Lu' in Google

Albert Y. S. Lam

This author has not been identified. Look up 'Albert Y. S. Lam' in Google