Evaluating the Evaluator: LLM Evaluators for Patient-Facing AI Agents

Angela Mastrianni, Katerina Andreadis, Ji Chen, Danissa V. Rodriguez, Devin M. Mann. Evaluating the Evaluator: LLM Evaluators for Patient-Facing AI Agents. In Francisco Nunes, Christina Chung, Helena M. Mentis, Ignacio Avellino, editors, Proceedings of the 2026 ACM Interactive Health Conference, IH 2026, Porto, Portugal, July 5-8, 2026. ACM, 2026. [doi]

@inproceedings{MastrianniACRM26,
  title = {Evaluating the Evaluator: LLM Evaluators for Patient-Facing AI Agents},
  author = {Angela Mastrianni and Katerina Andreadis and Ji Chen and Danissa V. Rodriguez and Devin M. Mann},
  year = {2026},
  doi = {10.1145/3786579.3804927},
  url = {https://doi.org/10.1145/3786579.3804927},
  researchr = {https://researchr.org/publication/MastrianniACRM26},
  cites = {0},
  citedby = {0},
  booktitle = {Proceedings of the 2026 ACM Interactive Health Conference, IH 2026, Porto, Portugal, July 5-8, 2026},
  editor = {Francisco Nunes and Christina Chung and Helena M. Mentis and Ignacio Avellino},
  publisher = {ACM},
  isbn = {979-8-4007-2422-0},
}