Can We Hide Machines in the Crowd? Quantifying Equivalence in LLM-in-the-loop Annotation Tasks

Jiaman He, Zikang Leng, Dana McKay, Damiano Spina, Johanne R. Trippas. Can We Hide Machines in the Crowd? Quantifying Equivalence in LLM-in-the-loop Annotation Tasks. In Proceedings of the 2025 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, SIGIR-AP 2025, Xi'an, China, December 7-10, 2025. pages 426-436, ACM, 2025. [doi]

Authors

Jiaman He

This author has not been identified. Look up 'Jiaman He' in Google

Zikang Leng

This author has not been identified. Look up 'Zikang Leng' in Google

Dana McKay

This author has not been identified. Look up 'Dana McKay' in Google

Damiano Spina

This author has not been identified. Look up 'Damiano Spina' in Google

Johanne R. Trippas

This author has not been identified. Look up 'Johanne R. Trippas' in Google