Human Experts vs. Large Language Models: Evaluating Annotation Scheme and Guidelines Development for Clinical Narratives

Ana Luísa Fernandes, Purificação Silvano, Nuno Guimarães, Rita Rb-Silva, Tahsir Ahmed Munna, Luís Filipe Cunha, Antonio Leal, Ricardo Campos 0001, Alípio Jorge. Human Experts vs. Large Language Models: Evaluating Annotation Scheme and Guidelines Development for Clinical Narratives. In Ricardo Campos 0001, Alípio Mário Jorge, Adam Jatowt, Sumit Bhatia, Marina Litvak, editors, Proceedings of Text2Story - Eighth Workshop on Narrative Extraction From Texts held in conjunction with the 47th European Conference on Information Retrieval (ECIR 2025), Lucca, Italy, April 10, 2025. Volume 3964 of CEUR Workshop Proceedings, pages 149-160, CEUR-WS.org, 2025. [doi]

Authors

Ana Luísa Fernandes

This author has not been identified. Look up 'Ana Luísa Fernandes' in Google

Purificação Silvano

This author has not been identified. Look up 'Purificação Silvano' in Google

Nuno Guimarães

This author has not been identified. Look up 'Nuno Guimarães' in Google

Rita Rb-Silva

This author has not been identified. Look up 'Rita Rb-Silva' in Google

Tahsir Ahmed Munna

This author has not been identified. Look up 'Tahsir Ahmed Munna' in Google

Luís Filipe Cunha

This author has not been identified. Look up 'Luís Filipe Cunha' in Google

Antonio Leal

This author has not been identified. Look up 'Antonio Leal' in Google

Ricardo Campos 0001

This author has not been identified. Look up 'Ricardo Campos 0001' in Google

Alípio Jorge

This author has not been identified. Look up 'Alípio Jorge' in Google