Device Stochasticity Directly Implements Bayesian Sampling in Spiking Neurons

ABSTRACT Device stochasticity is considered a non‐ideality in neuromorphic hardware, although stochastic neural activity supports probabilistic computation in biological systems. We show that intrinsic stochastic switching of magnetic tunnel junctions (MTJs) can be mapped to stochastic‐threshold spiking neurons, providing a physical sampling primitive for Bayesian spiking inference. We develop a spiking Bayesian neural network (SBNN) with neuronal threshold distributions learned during training and sampled during inference. We also introduce a rate‐estimation method that propagates firing probabilities rather than explicit spike sequences, achieving up to a 22‐fold speedup over surrogate‐gradient training. Compared with representative Bayesian neural‐network baselines, SBNN achieves favorable accuracy‐calibration trade‐offs, reaching high accuracy across static and event datasets and low negative log likelihood in both MNIST and Fashion‐MNIST. On MNIST, SBNN retains accuracy under a normalized weight‐noise standard deviation of 0.20 and under an input‐noise standard deviation of 0.25, compared with and , respectively, for the spiking neural network (SNN). Hardware‐in‐the‐loop validation using physical MTJ switching for sampling and software for network arithmetic closely matches software inference in spiking behavior and classification performance. This suggests that intrinsic device stochasticity can be transformed from a hardware non‐ideality into a Bayesian computational resource for compact and noise‐tolerant neuromorphic systems.

Authors

Institutions

Publication Details

Journal
Advanced Science
Published
2026-11-03
DOI
https://doi.org/10.1002/advs.78508
Citations
1
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
1.47
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Device Stochasticity Directly Implements Bayesian Sampling in Spiking Neurons

Kezhou Yang, Huannan Zheng, Jingli Liu
1 citations
Advanced Science
Advanced Memory and Neural Computing
1.47
article

Device Stochasticity Directly Implements Bayesian Sampling in Spiking Neurons

Kezhou Yang, Huannan Zheng, Jingli Liu
article en
1 citations

Abstract

ABSTRACT Device stochasticity is considered a non‐ideality in neuromorphic hardware, although stochastic neural activity supports probabilistic computation in biological systems. We show that intrinsic stochastic switching of magnetic tunnel junctions (MTJs) can be mapped to stochastic‐threshold spiking neurons, providing a physical sampling primitive for Bayesian spiking inference. We develop a spiking Bayesian neural network (SBNN) with neuronal threshold distributions learned during training and sampled during inference. We also introduce a rate‐estimation method that propagates firing probabilities rather than explicit spike sequences, achieving up to a 22‐fold speedup over surrogate‐gradient training. Compared with representative Bayesian neural‐network baselines, SBNN achieves favorable accuracy‐calibration trade‐offs, reaching high accuracy across static and event datasets and low negative log likelihood in both MNIST and Fashion‐MNIST. On MNIST, SBNN retains accuracy under a normalized weight‐noise standard deviation of 0.20 and under an input‐noise standard deviation of 0.25, compared with and , respectively, for the spiking neural network (SNN). Hardware‐in‐the‐loop validation using physical MTJ switching for sampling and software for network arithmetic closely matches software inference in spiking behavior and classification performance. This suggests that intrinsic device stochasticity can be transformed from a hardware non‐ideality into a Bayesian computational resource for compact and noise‐tolerant neuromorphic systems.

Advanced Science
University of Hong Kong (HK)
Openalex Percentile: Top 23%
Advanced Memory and Neural Computing
1.47
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon