Inverse problems are solvable on real number signal processing hardware

Despite the success of Deep Learning (DL) serious reliability issues such as non-robustness persist. An interesting aspect is, whether these problems arise due to insufficient tools or fundamental limitations of DL. We study this question from the computability perspective by characterizing the limits the applied hardware imposes. For this, we focus on the class of inverse problems, which, in particular, encompasses any task to reconstruct data from measurements. On digital hardware, a conceptual barrier on the capabilities of DL for solving finite-dimensional inverse problems has in fact already been derived. This paper investigates the general computation framework of Blum-Shub-Smale (BSS) machines, describing the processing and storage of arbitrary real values. Although a corresponding real-world computing device does not exist, research and development towards real number computing hardware, usually referred to by “neuromorphic computing”, has increased in recent years. In this work, we show that the framework of BSS machines does enable the algorithmic solvability of finite dimensional inverse problems. Our results emphasize the influence of the considered computing model in questions of accuracy and reliability.

Authors

Institutions

Publication Details

Journal
Applied and Computational Harmonic Analysis
Published
2024-10-24
DOI
https://doi.org/10.1016/j.acha.2024.101719
Citations
5
Primary Topic
Numerical Methods and Algorithms
Type
article
Field-Weighted Citation Impact
1.81

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Inverse problems are solvable on real number signal processing hardware

Holger Boche, Adalbert Fono, Gitta Kutyniok
5 citations
Applied and Computational Harmonic Analysis
Numerical Methods and Algorithms
1.81
article

Inverse problems are solvable on real number signal processing hardware

Holger Boche, Adalbert Fono, Gitta Kutyniok
article en
5 citations

Abstract

Despite the success of Deep Learning (DL) serious reliability issues such as non-robustness persist. An interesting aspect is, whether these problems arise due to insufficient tools or fundamental limitations of DL. We study this question from the computability perspective by characterizing the limits the applied hardware imposes. For this, we focus on the class of inverse problems, which, in particular, encompasses any task to reconstruct data from measurements. On digital hardware, a conceptual barrier on the capabilities of DL for solving finite-dimensional inverse problems has in fact already been derived. This paper investigates the general computation framework of Blum-Shub-Smale (BSS) machines, describing the processing and storage of arbitrary real values. Although a corresponding real-world computing device does not exist, research and development towards real number computing hardware, usually referred to by “neuromorphic computing”, has increased in recent years. In this work, we show that the framework of BSS machines does enable the algorithmic solvability of finite dimensional inverse problems. Our results emphasize the influence of the considered computing model in questions of accuracy and reliability.

Applied and Computational Harmonic AnalysisVol. 74
Bundesministerium für Forschung, Technologie und Raumfahrt (DE), Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE), Munich Center for Quantum Science and Technology (DE), Munich Center for Machine Learning, Technical University of Munich (DE), UiT The Arctic University of Norway (NO), Ludwig-Maximilians-Universität München (DE)
Australian Government, Deutscher Akademischer Austauschdienst, Deutsche Forschungsgemeinschaft, Bundesministerium für Bildung und Forschung
Affordable and clean energy
Openalex Percentile: Top 13%
Numerical Methods and Algorithms
1.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.