Dynamic Convolutional Neural Networks Based on Adaptive 2D Memristors

Abstract Convolutional Neural Networks (CNNs) are pivotal in modern digital computing, particularly for tasks like image classification, inspired by the receptive fields of the human brain. Nevertheless, CNNs implemented on conventional digital computers face significant limitations due to inflexible kernels that cannot adjust to dynamic inputs, and the von Neumann architecture, which leads to inefficient data transfer between memory and processing units. This research presents a hardware‐software co‐designed solution, a Dynamic Convolutional Neural Network (dCNN), empowered by three‐terminal adaptive two‐dimensional (2D) memristors. These memristors consist of a vertical heterostructure integrating silver, an atomically thin insulator (CrPS 4 ), and graphene as a semimetal. This configuration allows for the dynamic tuning of conductive filament properties, emulating the heterosynaptic plasticity observed in biological neural systems. The three‐terminal memristor design permits the dCNN to actively adjust kernel weights in its attention layer according to the input stimuli. The empirical tests demonstrate that image classification accuracy using our adaptive 2D memristor‐enhanced dVGG reaches up to 94% on the CIFAR‐10 dataset, which exceeds the performance of static VGG. Furthermore, the energy efficiency of our dVGG significantly outperforms that of GPUs, aligning more closely with the energy dynamics of the human brain in terms of both consumption and classification accuracy.

Authors

Institutions

Publication Details

Journal
Advanced Functional Materials
Published
2024-12-23
DOI
https://doi.org/10.1002/adfm.202422321
Citations
10
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
2.09

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dynamic Convolutional Neural Networks Based on Adaptive 2D Memristors

Heejun Yang, Ho Yeon Yoo, Jaewhan Oh, Yongsoo Yang et al.
10 citations
Advanced Functional Materials
Advanced Memory and Neural Computing
2.09
article

Dynamic Convolutional Neural Networks Based on Adaptive 2D Memristors

Heejun Yang, Ho Yeon Yoo, Jaewhan Oh, Yongsoo Yang, Linfeng Sun, Geunwoo Hwang, Zhongrui Wang, Xi Chen, Minseok Kim, Heemyoung Hong, Woohyun Cho
article en
10 citations

Abstract

Abstract Convolutional Neural Networks (CNNs) are pivotal in modern digital computing, particularly for tasks like image classification, inspired by the receptive fields of the human brain. Nevertheless, CNNs implemented on conventional digital computers face significant limitations due to inflexible kernels that cannot adjust to dynamic inputs, and the von Neumann architecture, which leads to inefficient data transfer between memory and processing units. This research presents a hardware‐software co‐designed solution, a Dynamic Convolutional Neural Network (dCNN), empowered by three‐terminal adaptive two‐dimensional (2D) memristors. These memristors consist of a vertical heterostructure integrating silver, an atomically thin insulator (CrPS 4 ), and graphene as a semimetal. This configuration allows for the dynamic tuning of conductive filament properties, emulating the heterosynaptic plasticity observed in biological neural systems. The three‐terminal memristor design permits the dCNN to actively adjust kernel weights in its attention layer according to the input stimuli. The empirical tests demonstrate that image classification accuracy using our adaptive 2D memristor‐enhanced dVGG reaches up to 94% on the CIFAR‐10 dataset, which exceeds the performance of static VGG. Furthermore, the energy efficiency of our dVGG significantly outperforms that of GPUs, aligning more closely with the energy dynamics of the human brain in terms of both consumption and classification accuracy.

Advanced Functional MaterialsVol. 35(17)
Beijing Institute of Technology (CN), Ewha Womans University (KR), Korea Advanced Institute of Science and Technology (KR), Southern University of Science and Technology (CN), University of Hong Kong (HK)
Samsung Science and Technology Foundation
Affordable and clean energy
Openalex Percentile: Top 12%
Advanced Memory and Neural Computing
2.09
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.