Rapid learning with phase-change memory-based in-memory computing through learning-to-learn

There is a growing demand for low-power, autonomously learning artificial intelligence (AI) systems that can be applied at the edge and rapidly adapt to the specific situation at deployment site. However, current AI models struggle in such scenarios, often requiring extensive fine-tuning, computational resources, and data. In contrast, humans can effortlessly adjust to new tasks by transferring knowledge from related ones. The concept of learning-to-learn (L2L) mimics this process and enables AI models to rapidly adapt with only little computational effort and data. In-memory computing neuromorphic hardware (NMHW) is inspired by the brain's operating principles and mimics its physical co-location of memory and compute. In this work, we pair L2L with in-memory computing NMHW based on phase-change memory devices to build efficient AI models that can rapidly adapt to new tasks. We demonstrate the versatility of our approach in two scenarios: a convolutional neural network performing image classification and a biologically-inspired spiking neural network generating motor commands for a real robotic arm. Both models rapidly learn with few parameter updates. Deployed on the NMHW, they perform on-par with their software equivalents. Moreover, meta-training of these models can be performed in software with high-precision, alleviating the need for accurate hardware models.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2025-02-01
DOI
https://doi.org/10.1038/s41467-025-56345-4
Citations
19
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
13.88

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Rapid learning with phase-change memory-based in-memory computing through learning-to-learn

Thomas Ortner, Špela Brglez, Angeliki Pantazi, Robert Legenstein et al.
19 citations
Nature Communications
Advanced Memory and Neural Computing
13.88
article

Rapid learning with phase-change memory-based in-memory computing through learning-to-learn

Thomas Ortner, Špela Brglez, Angeliki Pantazi, Robert Legenstein, Alejandro Linares-Barranco, Thomas Limbacher, Horst Petschenig, Athanasios Vasilopoulos, Enrique Piñero, Roland Renner
article en
19 citations

Abstract

There is a growing demand for low-power, autonomously learning artificial intelligence (AI) systems that can be applied at the edge and rapidly adapt to the specific situation at deployment site. However, current AI models struggle in such scenarios, often requiring extensive fine-tuning, computational resources, and data. In contrast, humans can effortlessly adjust to new tasks by transferring knowledge from related ones. The concept of learning-to-learn (L2L) mimics this process and enables AI models to rapidly adapt with only little computational effort and data. In-memory computing neuromorphic hardware (NMHW) is inspired by the brain's operating principles and mimics its physical co-location of memory and compute. In this work, we pair L2L with in-memory computing NMHW based on phase-change memory devices to build efficient AI models that can rapidly adapt to new tasks. We demonstrate the versatility of our approach in two scenarios: a convolutional neural network performing image classification and a biologically-inspired spiking neural network generating motor commands for a real robotic arm. Both models rapidly learn with few parameter updates. Deployed on the NMHW, they perform on-par with their software equivalents. Moreover, meta-training of these models can be performed in software with high-precision, alleviating the need for accurate hardware models.

Nature CommunicationsVol. 16(1)
Graz University of Technology (AT), IBM Research - Zurich (CH), Universidad de Sevilla (ES)
National Science Foundation, European Commission, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung, Austrian Science Fund, Agencia Estatal de Investigación, Division of Emerging Frontiers in Research and Innovation, CHIST-ERA
Openalex Percentile: Top 1%
Advanced Memory and Neural Computing
13.88
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.