Methods for developing and implementing large language models in healthcare: challenges and prospects in Russia

Large language models (LLMs) are transforming healthcare by enabling the analysis of clinical texts, supporting diagnostics, and facilitating decision-making. This systematic review examines the evolution of LLMs from recurrent neural networks (RNNs) to transformer-based and multimodal architectures (e.g., BioBERT, MedPaLM), with a focus on their application in medical practice and challenges in Russia. Based on 40 peer-reviewed articles from Scopus, PubMed, and other reliable sources (2019-2025), LLMs demonstrate high performance (e.g., Med-PaLM: F1-score 0.88 for binary pneumonia classification on MIMIC-CXR; Flamingo-CXR: 77.7% preference for in/outpatient X-ray re-ports). However, limitations include data scarcity, interpretability challenges, and privacy concerns. An adaptation of the Mixture of Experts (MoE) architecture for rare disease diagnostics and automated radiology report generation achieved promising results on synthetic datasets. Challenges in Russia include limited annotated data and compliance with Federal Law No. 152-FZ. LLMs enhance clinical workflows by automating routine tasks, such as report generation and patient triage, with advanced models like KARGEN improving radiology report quality. Russia’s focus on AI-driven healthcare aligns with global trends, yet linguistic and infrastructural barriers necessitate tailored solutions. Developing robust validation frameworks for LLMs will ensure their reliability in diverse clinical scenarios. Collaborative efforts with international AI research communities could accelerate Russia’s adoption of advanced medical AI technologies, particularly in radiology automation. Prospects involve integrating LLMs with healthcare systems and developing specialized models for Russian medical contexts. This study provides a foundation for advancing AI-driven healthcare in Russia.

Authors

Institutions

Publication Details

Journal
Discrete and Continuous Models and Applied Computational Science
Published
2025-10-15
DOI
https://doi.org/10.22363/2658-4670-2025-33-3-327-344
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Methods for developing and implementing large language models in healthcare: challenges and prospects in Russia

Tatyana R. Velieva, Eugene Yu. Shchetinin, Leonid A. Sevastianov, Anastasia V. Demidova et al.
Discrete and Continuous Models and Applied Computational Science
Artificial Intelligence in Healthcare and Education
article

Methods for developing and implementing large language models in healthcare: challenges and prospects in Russia

Tatyana R. Velieva, Eugene Yu. Shchetinin, Leonid A. Sevastianov, Anastasia V. Demidova, Lyubov A. Yurgina
article en

Abstract

Large language models (LLMs) are transforming healthcare by enabling the analysis of clinical texts, supporting diagnostics, and facilitating decision-making. This systematic review examines the evolution of LLMs from recurrent neural networks (RNNs) to transformer-based and multimodal architectures (e.g., BioBERT, MedPaLM), with a focus on their application in medical practice and challenges in Russia. Based on 40 peer-reviewed articles from Scopus, PubMed, and other reliable sources (2019-2025), LLMs demonstrate high performance (e.g., Med-PaLM: F1-score 0.88 for binary pneumonia classification on MIMIC-CXR; Flamingo-CXR: 77.7% preference for in/outpatient X-ray re-ports). However, limitations include data scarcity, interpretability challenges, and privacy concerns. An adaptation of the Mixture of Experts (MoE) architecture for rare disease diagnostics and automated radiology report generation achieved promising results on synthetic datasets. Challenges in Russia include limited annotated data and compliance with Federal Law No. 152-FZ. LLMs enhance clinical workflows by automating routine tasks, such as report generation and patient triage, with advanced models like KARGEN improving radiology report quality. Russia’s focus on AI-driven healthcare aligns with global trends, yet linguistic and infrastructural barriers necessitate tailored solutions. Developing robust validation frameworks for LLMs will ensure their reliability in diverse clinical scenarios. Collaborative efforts with international AI research communities could accelerate Russia’s adoption of advanced medical AI technologies, particularly in radiology automation. Prospects involve integrating LLMs with healthcare systems and developing specialized models for Russian medical contexts. This study provides a foundation for advancing AI-driven healthcare in Russia.

Discrete and Continuous Models and Applied Computational ScienceVol. 33(3)
Peoples' Friendship University of Russia (RU), Joint Institute for Nuclear Research (RU), Sevastopol National Technical University (UA)
Openalex Percentile: Top 76%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.