Integrated Artificial\nNeural Network with Trainable\nActivation Function Enabled by Topological Insulator-Based Spin–Orbit\nTorque Devices

Nonvolatile memristors offer a salient platform for artificial\nneural network (ANN), yet the integration of different function and\nalgorithm blocks into one hardware system remains challenging. Here\nwe demonstrate the brain-like synaptic (SOT-S) and neuronal (SOT-N)\nfunctions in the Bi<sub>2</sub>Te<sub>3</sub>/CrTe<sub>2</sub> heterostructure-based\nspin–orbit torque (SOT) device. The SOT-S unit exhibits highly\nlinear and symmetrical long-term potentiation/depression process,\nresulting in a fast-training of the MNIST data set with the classification\naccuracy above 90%. Meanwhile, the Sigmoid-shape transition curve\ninherited in the SOT-N cell replaces the software-based activation\nfunction block, hence reducing the system complexity. On this basis,\nwe employ a serial-connected, voltage-mode sensing ANN architecture\nto enhance the vector-matrix multiplication signal strength with low\nreading error of 0.61% while simplifying the peripheral circuitry.\nFurthermore, the trainable activation function of SOT-N enables the\nimplementation of the Batch Normalization algorithm and activation\noperation within one clock cycle, which bring about improved on/off-chip\ntraining performance close to the ideal baseline.

Publication Details

Journal
Figshare
Published
2024-10-15
DOI
https://doi.org/10.1021/acsnano.4c03278.s001
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrated Artificial\nNeural Network with Trainable\nActivation Function Enabled by Topological Insulator-Based Spin–Orbit\nTorque Devices

Figshare
Advanced Memory and Neural Computing
article

Integrated Artificial\nNeural Network with Trainable\nActivation Function Enabled by Topological Insulator-Based Spin–Orbit\nTorque Devices

article en

Abstract

Nonvolatile memristors offer a salient platform for artificial\nneural network (ANN), yet the integration of different function and\nalgorithm blocks into one hardware system remains challenging. Here\nwe demonstrate the brain-like synaptic (SOT-S) and neuronal (SOT-N)\nfunctions in the Bi<sub>2</sub>Te<sub>3</sub>/CrTe<sub>2</sub> heterostructure-based\nspin–orbit torque (SOT) device. The SOT-S unit exhibits highly\nlinear and symmetrical long-term potentiation/depression process,\nresulting in a fast-training of the MNIST data set with the classification\naccuracy above 90%. Meanwhile, the Sigmoid-shape transition curve\ninherited in the SOT-N cell replaces the software-based activation\nfunction block, hence reducing the system complexity. On this basis,\nwe employ a serial-connected, voltage-mode sensing ANN architecture\nto enhance the vector-matrix multiplication signal strength with low\nreading error of 0.61% while simplifying the peripheral circuitry.\nFurthermore, the trainable activation function of SOT-N enables the\nimplementation of the Batch Normalization algorithm and activation\noperation within one clock cycle, which bring about improved on/off-chip\ntraining performance close to the ideal baseline.

Figshare
Openalex Percentile: Top 66%
Advanced Memory and Neural Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.