Benchmarking Artificial Intelligence Algorithms for Drug Repurposing on Open Targets Platform

<p xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" class="first" dir="auto" id="d6297330e179">Computational methods have become essential for prioritizing drug repurposing candidates by integrating diverse biological and chemical data sources, enabling efficient and systematic identification of potential therapeutic applications. However, the lack of standardized benchmarks hinders the reliable evaluation of Deep Learning algorithms for drug repurposing. In this study, we designed and evaluated a benchmark framework for drug-disease association prediction using an integrative and publicly available platform, the Open Targets dataset.First, we developed an Open Targets Knowledge Graph (KG) based on entities like drug, disease, gene, and their annotations like disease therapeutic area, drug type, and gene pathway. Since the dataset is updated multiple times per year, it offers a natural separation between versions, enabling retrospective validation over time. We ensured models were tested on real-world scenarios where predictions were validated against newly available information. Additionally, we refined the disease and drug dataset by incorporating key ontological relationships to prevent data leakage.We applied various graph neural networks (GNNs), including Graph Convolutional Networks (GCN), GraphSAGE, and a Transformer-based GNN model. Our results demonstrated that the models successfully predicted novel drug-disease associations. The models showed strong and consistent performance in drug-disease prediction, achieving AUC values around 0.85 in retrospective validation. Our model also identified potentially novel drug-disease associations yet to be validated, providing valuable insights for drug repurposing.This retrospective benchmark ensures reproducibility, enables fair model comparison, and serves as a foundation for developing more interpretable and clinically relevant AI-driven approaches. Future research will explore integrating multi-omics data to improve effectiveness for specific rare diseases.

Authors

Institutions

Publication Details

Published
2025-04-12
DOI
https://doi.org/10.14293/idr.25.005pb
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Benchmarking Artificial Intelligence Algorithms for Drug Repurposing on Open Targets Platform

Jelle Piepenbrock, Peter A.C. ’t Hoen, Eftychia Lekka, Vassilis Virvilis et al.
Scientific Computing and Data Management
article

Benchmarking Artificial Intelligence Algorithms for Drug Repurposing on Open Targets Platform

Jelle Piepenbrock, Peter A.C. ’t Hoen, Eftychia Lekka, Vassilis Virvilis, Anastasia Krithara, Martijn A. Huynen, Fotis Aisopos, Christo Sasi, Stavroula Svolou
article en

Abstract

<p xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" class="first" dir="auto" id="d6297330e179">Computational methods have become essential for prioritizing drug repurposing candidates by integrating diverse biological and chemical data sources, enabling efficient and systematic identification of potential therapeutic applications. However, the lack of standardized benchmarks hinders the reliable evaluation of Deep Learning algorithms for drug repurposing. In this study, we designed and evaluated a benchmark framework for drug-disease association prediction using an integrative and publicly available platform, the Open Targets dataset.First, we developed an Open Targets Knowledge Graph (KG) based on entities like drug, disease, gene, and their annotations like disease therapeutic area, drug type, and gene pathway. Since the dataset is updated multiple times per year, it offers a natural separation between versions, enabling retrospective validation over time. We ensured models were tested on real-world scenarios where predictions were validated against newly available information. Additionally, we refined the disease and drug dataset by incorporating key ontological relationships to prevent data leakage.We applied various graph neural networks (GNNs), including Graph Convolutional Networks (GCN), GraphSAGE, and a Transformer-based GNN model. Our results demonstrated that the models successfully predicted novel drug-disease associations. The models showed strong and consistent performance in drug-disease prediction, achieving AUC values around 0.85 in retrospective validation. Our model also identified potentially novel drug-disease associations yet to be validated, providing valuable insights for drug repurposing.This retrospective benchmark ensures reproducibility, enables fair model comparison, and serves as a foundation for developing more interpretable and clinically relevant AI-driven approaches. Future research will explore integrating multi-omics data to improve effectiveness for specific rare diseases.

Radboud University Nijmegen (NL), National Centre of Scientific Research "Demokritos" (GR), University Medical Center (US), Radboud University Medical Center (NL)
Openalex Percentile: Top 92%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.