Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs

Ziyu Li, Donghwan Shin. Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs. In Jane Cleland-Huang, Jan Bosch, Henry Muccini, Grace A. Lewis, editors, Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering - Software Engineering for AI, CAIN 2024, Lisbon, Portugal, April 14-15, 2024. pages 150-159, ACM, 2024. [doi]

Abstract

Abstract is missing.