FIRE-EVIDENCE: enabling LLM-driven, machine-readable evidence synthesis for women’s health
Clinical evidence is abundant in the published literature yet remains fragmented and underutilized, particularly in women’s health and menopause, where timely, personalized decision-making is critical. Conventional evidence synthesis relies on resource-intensive manual review, limiting scalability and delaying translation into practice, while automated approaches often produce outputs that are not directly computable or integrable into decision-support workflows. We present FIRE-EVIDENCE, a large language model framework that transforms full-text clinical studies into structured, Fast Healthcare Interoperability Resources (FHIR)-aligned computable evidence. The pipeline was optimized on seven development documents and evaluated on two datasets: a primary dataset of 26 expert-annotated randomized controlled trials and a secondary dataset of 18 studies derived from five systematic reviews. Across expert-annotated trials, FIRE-EVIDENCE achieved 94.35% completeness, 94.61% correctness, 97.36% source faithfulness, and an F 1 score of 94.43%. FHIR-compliance testing in a 10-output native FHIR-R5 subset showed that all validated outputs passed base HL7 FHIR validation without errors. FIRE-EVIDENCE demonstrates a feasible pathway for standard-based, machine-readable evidence synthesis.
Authors
- Cynthia Lokker (ORCID: https://orcid.org/0000-0003-2436-4290)
- Muhammad Afzal (ORCID: https://orcid.org/0000-0002-7851-2327)
- Hüseyin Şeker (ORCID: https://orcid.org/0000-0002-1255-9552)
- Muhammad Ammar Shahid (ORCID: https://orcid.org/0009-0006-3844-3087)
- Wenyan Wu
Institutions
- Birmingham City University (GB)
- University of Sharjah (AE)
- Hamilton Health Sciences (CA)
- McMaster University (CA)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1038/s41746-026-03411-w
- Primary Topic
- Biomedical Text Mining and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00