KR Labs at ArchEHR-QA 2025: A Verbatim Approach for Evidence-Based Question Answering
We present a lightweight, domain-agnostic verbatim pipeline for evidence-grounded question answering.Our pipeline operates in two steps: first, a sentence-level extractor flags relevant note sentences using either zero-shot LLM prompts or supervised ModernBERT classifiers.Next, an LLM drafts a questionspecific template, which is filled verbatim with sentences from the extraction step.This prevents hallucinations and ensures traceability.In the ArchEHR-QA 2025 shared task, our system scored 42.01%, ranking top-10 in core metrics and outperforming the organiser's 70B-parameter Llama-3.3 baseline.We publicly release our code and inference scripts under an MIT license.
Authors
- Ádám Kovács (ORCID: https://orcid.org/0000-0001-6132-7144)
- Gábor Recski (ORCID: https://orcid.org/0000-0001-5551-3100)
- Paul Schmitt (ORCID: https://orcid.org/0000-0002-2156-5305)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.bionlp-share.8
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00