Synaptic Weight Optimization for Oscillatory Neural Networks: A Multi-Agent RL Approach

The Oscillatory Neural Network (ONN) presents itself as a promising architecture model for pattern recognition (PR), based on which advanced neuromorphic computing and integrated circuit designs are implemented. The core of the ONN’s PR capability lies in the synaptic weight design, i.e., how the neurons are connected to each other. Conventional design methods, like the Hebbian rule, are able to store only a limited number of patterns. In this paper, we propose a strategy to leverage the Multi-Agent Reinforcement Learning (MARL) for acquiring the optimal synaptic weights that can efficiently store more patterns into the ONN system as stable quilibria. To obtain the synaptic weights in a more efficient manner and further increase the number of patterns to be stored, we additionally propose a method to leverage Curriculum Learning (CL) to optimize the learning process of the policy. Experimental results demonstrate that the proposed MARL-based method outperforms baseline methods in terms of storing more patterns as stable equilibria in ONN.

Authors

Institutions

Publication Details

Published
2024-12-04
DOI
https://doi.org/10.1109/ica63002.2024.00040
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Synaptic Weight Optimization for Oscillatory Neural Networks: A Multi-Agent RL Approach

Rongye Shi, Xuehong Liu, Haopeng Wang, Junyu Zhang et al.
Neural Networks and Reservoir Computing
article

Synaptic Weight Optimization for Oscillatory Neural Networks: A Multi-Agent RL Approach

Rongye Shi, Xuehong Liu, Haopeng Wang, Junyu Zhang, Shuhao Liao, Wenjun Wu
article en

Abstract

The Oscillatory Neural Network (ONN) presents itself as a promising architecture model for pattern recognition (PR), based on which advanced neuromorphic computing and integrated circuit designs are implemented. The core of the ONN’s PR capability lies in the synaptic weight design, i.e., how the neurons are connected to each other. Conventional design methods, like the Hebbian rule, are able to store only a limited number of patterns. In this paper, we propose a strategy to leverage the Multi-Agent Reinforcement Learning (MARL) for acquiring the optimal synaptic weights that can efficiently store more patterns into the ONN system as stable quilibria. To obtain the synaptic weights in a more efficient manner and further increase the number of patterns to be stored, we additionally propose a method to leverage Curriculum Learning (CL) to optimize the learning process of the policy. Experimental results demonstrate that the proposed MARL-based method outperforms baseline methods in terms of storing more patterns as stable equilibria in ONN.

Beihang University (CN)
National Natural Science Foundation of China, Nova, National Science and Technology Major Project
Openalex Percentile: Top 78%
Neural Networks and Reservoir Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Synaptic Weight Optimization for Oscillatory Neural Networks: A Multi-Agent RL Approach — Rongye Shi, Xuehong Liu, et al. · (2024) | TGRS Research Map | TGRS