Generative deep learning in bioinformatics: a microservices-driven paradigm for big data environment

Abstract The exponential growth of bioinformatics and drug discovery data necessitates computational frameworks capable of efficiently managing large-scale, heterogeneous, and continuously evolving datasets. This study presents a hybrid deep learning framework built upon a microservices-based architecture to enhance scalability, modularity, and efficiency in bioinformatics workflows. The proposed system integrates generative deep learning—specifically, a variational autoencoder (VAE)—to tackle challenges in bioinformatics. Through a microservices-driven design, the framework enables modular deployment, semantic interoperability, and scalable integration of generative models into bioinformatics pipelines. The architecture is model-agnostic and supports flexible validation by encapsulating cheminformatics evaluations, as independent microservices. This allows automated updates and seamless incorporation of new evaluation metrics without disrupting the overall pipeline. Rather than replicating existing cheminformatics validation efforts, the framework provides an extensible foundation for integrating, reusing, and scaling such studies across large datasets in bioinformatics and drug discovery. In contrast to traditional monolithic architectures, the microservices paradigm supports independent deployment, optimization, and scaling of deep learning components—such as molecule generation, toxicity prediction, and pharmacokinetics analysis—while maintaining uninterrupted workflow execution. This design ensures real-time data processing, interoperability across distributed systems, and reduced computational overhead. Experiments conducted on benchmark datasets from DrugBank, ChEMBL, and TCGA demonstrate superior performance compared to monolithic baselines in predictive accuracy, biomarker identification, and computational efficiency. These results underscore the potential of microservices as a software engineering paradigm for advancing bioinformatics and accelerating the drug discovery process.

Authors

Institutions

Publication Details

Journal
Journal Of Big Data
Published
2025-12-14
DOI
https://doi.org/10.1186/s40537-025-01320-5
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generative deep learning in bioinformatics: a microservices-driven paradigm for big data environment

Saad M. Darwish, Nevine Makram Labib, Mohamed El-Hadidi, Ahmed Fikry El-Sayed
Journal Of Big Data
Scientific Computing and Data Management
article

Generative deep learning in bioinformatics: a microservices-driven paradigm for big data environment

Saad M. Darwish, Nevine Makram Labib, Mohamed El-Hadidi, Ahmed Fikry El-Sayed
article en

Abstract

Abstract The exponential growth of bioinformatics and drug discovery data necessitates computational frameworks capable of efficiently managing large-scale, heterogeneous, and continuously evolving datasets. This study presents a hybrid deep learning framework built upon a microservices-based architecture to enhance scalability, modularity, and efficiency in bioinformatics workflows. The proposed system integrates generative deep learning—specifically, a variational autoencoder (VAE)—to tackle challenges in bioinformatics. Through a microservices-driven design, the framework enables modular deployment, semantic interoperability, and scalable integration of generative models into bioinformatics pipelines. The architecture is model-agnostic and supports flexible validation by encapsulating cheminformatics evaluations, as independent microservices. This allows automated updates and seamless incorporation of new evaluation metrics without disrupting the overall pipeline. Rather than replicating existing cheminformatics validation efforts, the framework provides an extensible foundation for integrating, reusing, and scaling such studies across large datasets in bioinformatics and drug discovery. In contrast to traditional monolithic architectures, the microservices paradigm supports independent deployment, optimization, and scaling of deep learning components—such as molecule generation, toxicity prediction, and pharmacokinetics analysis—while maintaining uninterrupted workflow execution. This design ensures real-time data processing, interoperability across distributed systems, and reduced computational overhead. Experiments conducted on benchmark datasets from DrugBank, ChEMBL, and TCGA demonstrate superior performance compared to monolithic baselines in predictive accuracy, biomarker identification, and computational efficiency. These results underscore the potential of microservices as a software engineering paradigm for advancing bioinformatics and accelerating the drug discovery process.

Journal Of Big DataVol. 13(1)
Information Technology Institute (EG), Sadat Academy for Management Sciences (EG), Nile University (EG), Alexandria University (EG)
Openalex Percentile: Top 64%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.