A context-augmented large language model for accurate precision oncology medicine recommendations
The rapid expansion of molecularly informed therapies in oncology, coupled with evolving regulatory food and drug administration (FDA) approvals, poses a challenge for oncologists seeking to integrate precision oncology medicine into patient care. Large language models (LLMs) have clinical potential, but their reliance on general knowledge limits their ability to provide up-to-date and niche treatment recommendations. Here, we developed a retrieval-augmented generation (RAG)-LLM workflow using the molecular oncology almanac (MOAlmanac) and benchmarked it against an LLM-only approach for biomarker-driven treatment recommendations. Our RAG-LLM achieved up to 95% accuracy on synthetic queries and 93% on real-world queries collected from practicing oncologists. Finally, our study explored several prompting and retrieval strategies to enhance performance. Taken together, this approach may serve as valuable guidance for deploying LLMs to support cancer patients' treatment decisions in precision oncology clinical settings.
Authors
- David D. Yang (ORCID: https://orcid.org/0000-0002-5146-218X)
- Erica Pimenta (ORCID: https://orcid.org/0000-0002-9684-6486)
- Dan Y. Gui (ORCID: https://orcid.org/0009-0003-9976-6435)
- Tess A. O’Meara (ORCID: https://orcid.org/0000-0002-4778-2842)
- Shreya Johri (ORCID: https://orcid.org/0000-0002-2388-3913)
- Hyeji Jun (ORCID: https://orcid.org/0000-0002-5796-7103)
- Alok Tewari (ORCID: https://orcid.org/0000-0002-9447-4690)
- Alexander C. Jordan (ORCID: https://orcid.org/0000-0002-3006-7033)
- Θεοδώρα Παππά (ORCID: https://orcid.org/0000-0001-5336-9117)
- Brendan Reardon (ORCID: https://orcid.org/0000-0002-1716-5720)
- Samantha Martin (ORCID: https://orcid.org/0009-0009-8673-7583)
- Matthew Nagy (ORCID: https://orcid.org/0000-0001-5087-6674)
- Sabrina Y. Camp (ORCID: https://orcid.org/0000-0002-9695-5527)
- Yutaro Tanaka (ORCID: https://orcid.org/0009-0004-1060-7065)
- Eddy Saad
- Filipe L.F. Carvalho
- Eliezer Van Allen
- Chris Labaki
- Erik L. Bao
- Riaz Gillani
Institutions
- Broad Institute (US)
- Brigham and Women's Hospital (US)
- Beth Israel Deaconess Medical Center (US)
- Dana-Farber Cancer Institute (US)
- Dana-Farber Brigham Cancer Center (US)
Publication Details
- Journal
- Cancer Cell
- Published
- 2026-01-15
- DOI
- https://doi.org/10.1016/j.ccell.2025.12.017
- Primary Topic
- Computational Drug Discovery Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00