Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation

Dongryeol Lee, Yerin Hwang, Yongil Kim, Joonsuk Park, Kyomin Jung. Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation. In Luis Chiruzzo, Alan Ritter, Lu Wang, editors, Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2025 - Volume 1: Long Papers, Albuquerque, New Mexico, USA, April 29 - May 4, 2025. pages 8962-8984, Association for Computational Linguistics, 2025. [doi]

Authors

Dongryeol Lee

This author has not been identified. Look up 'Dongryeol Lee' in Google

Yerin Hwang

This author has not been identified. Look up 'Yerin Hwang' in Google

Yongil Kim

This author has not been identified. Look up 'Yongil Kim' in Google

Joonsuk Park

This author has not been identified. Look up 'Joonsuk Park' in Google

Kyomin Jung

This author has not been identified. Look up 'Kyomin Jung' in Google