Topic Modelling for Biomedical Literature Retrieval via a Dual-Stream Embedding Framework

The rapid expansion of biomedical literature has created substantial challenges in retrieving and synthesizing relevant knowledge, particularly for novice and interdisciplinary users. Conventional keyword-based methods often lack semantic depth, whereas traditional topic modelling techniques struggle to capture domain-specific contexts and rarely integrate structured metadata, such as medical subject headings (MeSH). To address these limitations, this study introduces a dual-stream embedding framework that integrates unstructured textual content with curated biomedical metadata using transformer-based encoders and a parameterized fusion mechanism. The architecture combines contextual semantics from article titles and abstracts with expert-annotated MeSH descriptors and incorporates a large language model to generate concise and human-readable topic labels. Experimental results show that three of the four evaluated embedding configurations outperformed the single-stream baseline and that the dual-stream fusion surpassed all ablation models built from the same inputs. The best configuration, Dual PubMedBERT, achieved the highest overall topic modelling quality, improving the combined measure of topic coherence and topic diversity by 7.3% relative to the baseline. These results demonstrate the effectiveness of integrating contextual textual embeddings with structured biomedical metadata using the proposed fusion mechanism. This approach is scalable, reproducible, and domain-adaptable, providing both a methodological advancement in semantic topic modelling and a practical foundation for the development of biomedical information retrieval systems, semantic search engines, and thematic exploration tools across knowledge-intensive domains.

Authors

Institutions

Publication Details

Journal
Journal of Advanced Computational Intelligence and Intelligent Informatics
Published
2026-11-20
DOI
https://doi.org/10.20965/jaciii.2026.p1782
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Topic Modelling for Biomedical Literature Retrieval via a Dual-Stream Embedding Framework

Amena Mahmoud, Eiko Takaoka, Tao Tao
Journal of Advanced Computational Intelligence and Intelligent Informatics
Topic Modeling
article

Topic Modelling for Biomedical Literature Retrieval via a Dual-Stream Embedding Framework

Amena Mahmoud, Eiko Takaoka, Tao Tao
article en

Abstract

The rapid expansion of biomedical literature has created substantial challenges in retrieving and synthesizing relevant knowledge, particularly for novice and interdisciplinary users. Conventional keyword-based methods often lack semantic depth, whereas traditional topic modelling techniques struggle to capture domain-specific contexts and rarely integrate structured metadata, such as medical subject headings (MeSH). To address these limitations, this study introduces a dual-stream embedding framework that integrates unstructured textual content with curated biomedical metadata using transformer-based encoders and a parameterized fusion mechanism. The architecture combines contextual semantics from article titles and abstracts with expert-annotated MeSH descriptors and incorporates a large language model to generate concise and human-readable topic labels. Experimental results show that three of the four evaluated embedding configurations outperformed the single-stream baseline and that the dual-stream fusion surpassed all ablation models built from the same inputs. The best configuration, Dual PubMedBERT, achieved the highest overall topic modelling quality, improving the combined measure of topic coherence and topic diversity by 7.3% relative to the baseline. These results demonstrate the effectiveness of integrating contextual textual embeddings with structured biomedical metadata using the proposed fusion mechanism. This approach is scalable, reproducible, and domain-adaptable, providing both a methodological advancement in semantic topic modelling and a practical foundation for the development of biomedical information retrieval systems, semantic search engines, and thematic exploration tools across knowledge-intensive domains.

Journal of Advanced Computational Intelligence and Intelligent InformaticsVol. 30(6)
Kafrelsheikh University (EG), Sophia University (JP)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon