A novel fuzzy reinforcement learning approach for personalization deep brain stimulation with communication delay

• A novel adaptive closed-loop model is proposed for the regulation of hand tremors. • The proposed model incorporates a nonlinear differential backward controller (NLDBC). • A fuzzy reinforcement learning algorithm is developed to fine-tune the parameters of NLDBC. • Simulation findings illustrate the capability of the proposed model to mitigate hand tremors. • The technique may help patients with Parkinson’s disease effectively manage their hand tremors. This study presents a groundbreaking adaptive closed-loop methodology for the regulation of hand tremors associated with Parkinson’s disease (PD) via a deep brain stimulation (DBS) framework. The proposed methodology incorporates a nonlinear differential backward controller (NLDBC) meticulously engineered to stimulate the subthalamic nucleus (STN) and globus pallidus internus (GPi). Given the incessant character of tremors, a fuzzy reinforcement learning algorithm is developed to fine-tune the parameters of the NLDBC controller, thereby facilitating real-time adaptations. This investigation tackles two principal challenges: i) alleviating the detrimental impacts of wireless communication technologies; while contemporary stimulation systems employ wireless sensors and programming devices for the remote modulation of hand tremors, these advancements engender complications, such as latency and temporal delays that adversely affect neurostimulation procedures; ii) stimulating two targets (the STN and GPi) in contrast to either target alone. A comparative evaluation is performed in silico to measure the effectiveness of dual-target stimulation relative to single-target stimulation. A series of tests assess the system’s performance under diverse conditions, revealing that the dual-target stimulation approach demonstrates approximately 83 % improvement in tremor amplitude and 76 % in produced electrical field intensity (EFi) compared to a single target, and the improvement of the developed system is almost 80% compared to alternative systems.

Authors

Institutions

Publication Details

Journal
Biomedical Signal Processing and Control
Published
2025-02-20
DOI
https://doi.org/10.1016/j.bspc.2025.107736
Citations
9
Primary Topic
Neurological disorders and treatments
Type
article
Field-Weighted Citation Impact
12.50
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A novel fuzzy reinforcement learning approach for personalization deep brain stimulation with communication delay

Walid Ayadi, Ardashir Mohammadzadeh, Ebrahim Ghaderpour, Chunwei Zhang et al.
9 citations
Biomedical Signal Processing and Control
Neurological disorders and treatments
12.50
article

A novel fuzzy reinforcement learning approach for personalization deep brain stimulation with communication delay

Walid Ayadi, Ardashir Mohammadzadeh, Ebrahim Ghaderpour, Chunwei Zhang, Khalid A. Alattas, Long Su, Zorana Lynton
article en
9 citations

Abstract

• A novel adaptive closed-loop model is proposed for the regulation of hand tremors. • The proposed model incorporates a nonlinear differential backward controller (NLDBC). • A fuzzy reinforcement learning algorithm is developed to fine-tune the parameters of NLDBC. • Simulation findings illustrate the capability of the proposed model to mitigate hand tremors. • The technique may help patients with Parkinson’s disease effectively manage their hand tremors. This study presents a groundbreaking adaptive closed-loop methodology for the regulation of hand tremors associated with Parkinson’s disease (PD) via a deep brain stimulation (DBS) framework. The proposed methodology incorporates a nonlinear differential backward controller (NLDBC) meticulously engineered to stimulate the subthalamic nucleus (STN) and globus pallidus internus (GPi). Given the incessant character of tremors, a fuzzy reinforcement learning algorithm is developed to fine-tune the parameters of the NLDBC controller, thereby facilitating real-time adaptations. This investigation tackles two principal challenges: i) alleviating the detrimental impacts of wireless communication technologies; while contemporary stimulation systems employ wireless sensors and programming devices for the remote modulation of hand tremors, these advancements engender complications, such as latency and temporal delays that adversely affect neurostimulation procedures; ii) stimulating two targets (the STN and GPi) in contrast to either target alone. A comparative evaluation is performed in silico to measure the effectiveness of dual-target stimulation relative to single-target stimulation. A series of tests assess the system’s performance under diverse conditions, revealing that the dual-target stimulation approach demonstrates approximately 83 % improvement in tremor amplitude and 76 % in produced electrical field intensity (EFi) compared to a single target, and the improvement of the developed system is almost 80% compared to alternative systems.

Biomedical Signal Processing and ControlVol. 106
Sakarya University (TR), Abu Dhabi University (AE), Shenyang University of Technology (CN), The University of Queensland (AU), Changsha University (CN), University of Jeddah (SA), Sapienza University of Rome (IT)
Reduced inequalities
Openalex Percentile: Top 1%
Neurological disorders and treatments
12.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.