Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?

Wangyue Li, Liangzhi Li 0001, Tong Xiang, Xiao Liu, Wei Deng, Noa Garcia. Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?. In Nicoletta Calzolari, Min-Yen Kan, VĂ©ronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue, editors, Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC/COLING 2024, 20-25 May, 2024, Torino, Italy. pages 2819-2834, ELRA and ICCL, 2024. [doi]

Abstract

Abstract is missing.