Equilibrium propagation: a road for physics-based learning

Neuromorphic computing seeks to emulate the brain's efficiency in hardware, enabling sophisticated information processing with minimal energy consumption. Despite these advances, dynamically training neuromorphic systems—whether electronic or photonic—to undertake new tasks directly within the hardware remains a formidable challenge. This is largely due to the nature of conventional training algorithms like backpropagation. They are not well-suited for hardware implementation because they rely on non-local computations. In this presentation, I will introduce a solution to this challenge through the application of Equilibrium Propagation, an algorithm rooted in physics, first proposed by Scellier and Bengio in 2017. This innovative approach leverages the inherent dynamics of physical systems for learning, capitalizing on how these systems can be gently guided ('nudged') towards a desired outcome through their natural behavior. I will elucidate the foundational principles of Equilibrium Propagation, discuss the obstacles encountered in its implementation, and demonstrate its versatility through applications across a variety of physical systems.

Authors

Institutions

Publication Details

Published
2024-10-02
DOI
https://doi.org/10.1117/12.3028629
Primary Topic
Advanced Thermodynamics and Statistical Mechanics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Equilibrium propagation: a road for physics-based learning

Damien Querlioz
Advanced Thermodynamics and Statistical Mechanics
article

Equilibrium propagation: a road for physics-based learning

Damien Querlioz
article en

Abstract

Neuromorphic computing seeks to emulate the brain's efficiency in hardware, enabling sophisticated information processing with minimal energy consumption. Despite these advances, dynamically training neuromorphic systems—whether electronic or photonic—to undertake new tasks directly within the hardware remains a formidable challenge. This is largely due to the nature of conventional training algorithms like backpropagation. They are not well-suited for hardware implementation because they rely on non-local computations. In this presentation, I will introduce a solution to this challenge through the application of Equilibrium Propagation, an algorithm rooted in physics, first proposed by Scellier and Bengio in 2017. This innovative approach leverages the inherent dynamics of physical systems for learning, capitalizing on how these systems can be gently guided ('nudged') towards a desired outcome through their natural behavior. I will elucidate the foundational principles of Equilibrium Propagation, discuss the obstacles encountered in its implementation, and demonstrate its versatility through applications across a variety of physical systems.

Université Paris-Saclay (FR)
Openalex Percentile: Top 84%
Advanced Thermodynamics and Statistical Mechanics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.