KR Labs at ArchEHR-QA 2025: A Verbatim Approach for Evidence-Based Question Answering

We present a lightweight, domain-agnostic verbatim pipeline for evidence-grounded question answering.Our pipeline operates in two steps: first, a sentence-level extractor flags relevant note sentences using either zero-shot LLM prompts or supervised ModernBERT classifiers.Next, an LLM drafts a questionspecific template, which is filled verbatim with sentences from the extraction step.This prevents hallucinations and ensures traceability.In the ArchEHR-QA 2025 shared task, our system scored 42.01%, ranking top-10 in core metrics and outperforming the organiser's 70B-parameter Llama-3.3 baseline.We publicly release our code and inference scripts under an MIT license.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bionlp-share.8
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

KR Labs at ArchEHR-QA 2025: A Verbatim Approach for Evidence-Based Question Answering

Ádám Kovács, Gábor Recski, Paul Schmitt
Topic Modeling
article

KR Labs at ArchEHR-QA 2025: A Verbatim Approach for Evidence-Based Question Answering

Ádám Kovács, Gábor Recski, Paul Schmitt
article en

Abstract

We present a lightweight, domain-agnostic verbatim pipeline for evidence-grounded question answering.Our pipeline operates in two steps: first, a sentence-level extractor flags relevant note sentences using either zero-shot LLM prompts or supervised ModernBERT classifiers.Next, an LLM drafts a questionspecific template, which is filled verbatim with sentences from the extraction step.This prevents hallucinations and ensures traceability.In the ArchEHR-QA 2025 shared task, our system scored 42.01%, ranking top-10 in core metrics and outperforming the organiser's 70B-parameter Llama-3.3 baseline.We publicly release our code and inference scripts under an MIT license.

Openalex Percentile: Top 90%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.