Overview of the ArchEHR-QA 2025 Shared Task on Grounded Question Answering from Electronic Health Records

This paper presents an overview of the ArchEHR-QA 2025 shared task, which was organized with the 24th BioNLP Workshop at ACL 2025.The goal of this shared task is to develop automated responses to patients' questions by generating answers that are grounded in key clinical evidence from patients' electronic health records (EHRs).A total of 29 teams participated in the task, collectively submitting 75 systems, with 24 teams providing their system descriptions.The submitted systems encompassed diverse architectures (including approaches that select the most relevant evidence prior to answer generation), leveraging both proprietary and open-weight large language models, as well as employing various tuning strategies such as fine-tuning and fewshot learning.In this paper, we describe the task setup, the dataset used, the evaluation criteria, and the baseline systems.Furthermore, we summarize the methodologies adopted by participating teams and present a comprehensive evaluation and analysis of the submitted systems.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bionlp-1.34
Citations
3
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
7.44

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Overview of the ArchEHR-QA 2025 Shared Task on Grounded Question Answering from Electronic Health Records

Dina Demner‐Fushman, Sarvesh Soni, Soumya Gayen
3 citations
Topic Modeling
7.44
article

Overview of the ArchEHR-QA 2025 Shared Task on Grounded Question Answering from Electronic Health Records

Dina Demner‐Fushman, Sarvesh Soni, Soumya Gayen
article en
3 citations

Abstract

This paper presents an overview of the ArchEHR-QA 2025 shared task, which was organized with the 24th BioNLP Workshop at ACL 2025.The goal of this shared task is to develop automated responses to patients' questions by generating answers that are grounded in key clinical evidence from patients' electronic health records (EHRs).A total of 29 teams participated in the task, collectively submitting 75 systems, with 24 teams providing their system descriptions.The submitted systems encompassed diverse architectures (including approaches that select the most relevant evidence prior to answer generation), leveraging both proprietary and open-weight large language models, as well as employing various tuning strategies such as fine-tuning and fewshot learning.In this paper, we describe the task setup, the dataset used, the evaluation criteria, and the baseline systems.Furthermore, we summarize the methodologies adopted by participating teams and present a comprehensive evaluation and analysis of the submitted systems.

United States National Library of Medicine (US)
National Institutes of Health, U.S. National Library of Medicine, NHLBI Division of Intramural Research
Openalex Percentile: Top 3%
Topic Modeling
7.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Overview of the ArchEHR-QA 2025 Shared Task on Grounded Question Answering from Electronic Health Records — Dina Demner‐Fushman, Sarvesh Soni, et al. · (2025) | TGRS Research Map | TGRS