FIRE-EVIDENCE: enabling LLM-driven, machine-readable evidence synthesis for women’s health

Clinical evidence is abundant in the published literature yet remains fragmented and underutilized, particularly in women’s health and menopause, where timely, personalized decision-making is critical. Conventional evidence synthesis relies on resource-intensive manual review, limiting scalability and delaying translation into practice, while automated approaches often produce outputs that are not directly computable or integrable into decision-support workflows. We present FIRE-EVIDENCE, a large language model framework that transforms full-text clinical studies into structured, Fast Healthcare Interoperability Resources (FHIR)-aligned computable evidence. The pipeline was optimized on seven development documents and evaluated on two datasets: a primary dataset of 26 expert-annotated randomized controlled trials and a secondary dataset of 18 studies derived from five systematic reviews. Across expert-annotated trials, FIRE-EVIDENCE achieved 94.35% completeness, 94.61% correctness, 97.36% source faithfulness, and an F 1 score of 94.43%. FHIR-compliance testing in a 10-output native FHIR-R5 subset showed that all validated outputs passed base HL7 FHIR validation without errors. FIRE-EVIDENCE demonstrates a feasible pathway for standard-based, machine-readable evidence synthesis.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2026-11-17
DOI
https://doi.org/10.1038/s41746-026-03411-w
Primary Topic
Biomedical Text Mining and Ontologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

FIRE-EVIDENCE: enabling LLM-driven, machine-readable evidence synthesis for women’s health

Cynthia Lokker, Muhammad Afzal, Hüseyin Şeker, Muhammad Ammar Shahid et al.
4 links
npj Digital Medicine
Biomedical Text Mining and Ontologies
article

FIRE-EVIDENCE: enabling LLM-driven, machine-readable evidence synthesis for women’s health

Cynthia Lokker, Muhammad Afzal, Hüseyin Şeker, Muhammad Ammar Shahid, Wenyan Wu
article en

Abstract

Clinical evidence is abundant in the published literature yet remains fragmented and underutilized, particularly in women’s health and menopause, where timely, personalized decision-making is critical. Conventional evidence synthesis relies on resource-intensive manual review, limiting scalability and delaying translation into practice, while automated approaches often produce outputs that are not directly computable or integrable into decision-support workflows. We present FIRE-EVIDENCE, a large language model framework that transforms full-text clinical studies into structured, Fast Healthcare Interoperability Resources (FHIR)-aligned computable evidence. The pipeline was optimized on seven development documents and evaluated on two datasets: a primary dataset of 26 expert-annotated randomized controlled trials and a secondary dataset of 18 studies derived from five systematic reviews. Across expert-annotated trials, FIRE-EVIDENCE achieved 94.35% completeness, 94.61% correctness, 97.36% source faithfulness, and an F 1 score of 94.43%. FHIR-compliance testing in a 10-output native FHIR-R5 subset showed that all validated outputs passed base HL7 FHIR validation without errors. FIRE-EVIDENCE demonstrates a feasible pathway for standard-based, machine-readable evidence synthesis.

npj Digital Medicine
Birmingham City University (GB), University of Sharjah (AE), Hamilton Health Sciences (CA), McMaster University (CA)
Good health and well-being
Biomedical Text Mining and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon