Human Experts vs. Large Language Models: Evaluating Annotation Scheme and Guidelines Development for Clinical Narratives

Ana Luísa Fernandes, Purificação Silvano, Nuno Guimarães, Rita Rb-Silva, Tahsir Ahmed Munna, Luís Filipe Cunha, Antonio Leal, Ricardo Campos 0001, Alípio Jorge. Human Experts vs. Large Language Models: Evaluating Annotation Scheme and Guidelines Development for Clinical Narratives. In Ricardo Campos 0001, Alípio Mário Jorge, Adam Jatowt, Sumit Bhatia, Marina Litvak, editors, Proceedings of Text2Story - Eighth Workshop on Narrative Extraction From Texts held in conjunction with the 47th European Conference on Information Retrieval (ECIR 2025), Lucca, Italy, April 10, 2025. Volume 3964 of CEUR Workshop Proceedings, pages 149-160, CEUR-WS.org, 2025. [doi]

Abstract

Abstract is missing.