OntoMed-KGTransformer: A Neuro-Symbolic Framework for Clinical Knowledge Fusion

This paper introduces OntoMed-KGTransformer, a novel framework for integrating unstructured clinical text with structured medical knowledge graphs (KGs) and ontologies (specifically, UMLS). Our approach addresses key limitations in clinical decision support by combining: (1) an ontology-guided hierarchical attention mechanism that enforces domain-specific semantic constraints within a Transformer architecture; (2) a dynamic graph-centric tokenization strategy that bridges textual and KG representations; and (3) a dual-encoder architecture with ontology-driven contrastive learning. Evaluations on the MIMIC-III dataset and a custom Hetionet-derived KG demonstrate significant improvements over state-of-the-art baselines (e.g., KG-BERT, BioBERT) in diagnostic prediction, with a 15% relative increase in F1-score. Furthermore, the framework enhances interpretability through the extraction of clinically relevant knowledge paths, promoting trust and transparency in clinical decision-making.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.09.161
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

OntoMed-KGTransformer: A Neuro-Symbolic Framework for Clinical Knowledge Fusion

Mohamed Ali Mahjoub, Abdelweheb Gueddes, Wyssem Fathallah
Procedia Computer Science
Machine Learning in Healthcare
article

OntoMed-KGTransformer: A Neuro-Symbolic Framework for Clinical Knowledge Fusion

Mohamed Ali Mahjoub, Abdelweheb Gueddes, Wyssem Fathallah
article en

Abstract

This paper introduces OntoMed-KGTransformer, a novel framework for integrating unstructured clinical text with structured medical knowledge graphs (KGs) and ontologies (specifically, UMLS). Our approach addresses key limitations in clinical decision support by combining: (1) an ontology-guided hierarchical attention mechanism that enforces domain-specific semantic constraints within a Transformer architecture; (2) a dynamic graph-centric tokenization strategy that bridges textual and KG representations; and (3) a dual-encoder architecture with ontology-driven contrastive learning. Evaluations on the MIMIC-III dataset and a custom Hetionet-derived KG demonstrate significant improvements over state-of-the-art baselines (e.g., KG-BERT, BioBERT) in diagnostic prediction, with a 15% relative increase in F1-score. Furthermore, the framework enhances interpretability through the extraction of clinically relevant knowledge paths, promoting trust and transparency in clinical decision-making.

Procedia Computer ScienceVol. 270
Tunis University (TN), National Engineering School of Tunis (TN), Tunis El Manar University (TN), University of Sousse (TN)
Openalex Percentile: Top 83%
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.