Implicit neural representation based on adaptive learnable filters

Implicit Neural Representation (INR) achieves the mapping between coordinates and signal values through multilayer perceptrons (MLPs). However, coordinate-based MLPs struggle with high-frequency information due to spectral bias. A common solution to the spectral bias problem is to use Fourier features with fixed encoding frequencies instead of spatial coordinates as inputs to the MLPs. Natural scenes exhibit distinct frequency spectra across local areas, with the main regions characterized by low frequencies and the edges by high frequencies. The fixed encoding frequency Fourier feature will lead to redundant input information and reduce the running speed of MLPs. Therefore, this paper proposes an Implicit Neural Representation with Adaptive Learnable Filters framework (NRALF), which is controlled by a learnable parameter to achieve low-pass, band-pass, high-pass, all-pass and all-no-pass functions. This filter filters the Fourier features of different frequencies, making the filtered coding space more sparse, thereby enhancing the expression ability of MLPs for natural scenes and significantly improving the convergence speed of MLPs. Experimental results show that the proposed method has higher accuracy and faster convergence speed in scene representation.

Authors

Institutions

Publication Details

Published
2024-11-23
DOI
https://doi.org/10.1117/12.3036225
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Implicit neural representation based on adaptive learnable filters

Jun Qiu, Ligen Shi, Chang Liu, Yuhang Zheng
Neural Networks and Applications
article

Implicit neural representation based on adaptive learnable filters

Jun Qiu, Ligen Shi, Chang Liu, Yuhang Zheng
article en

Abstract

Implicit Neural Representation (INR) achieves the mapping between coordinates and signal values through multilayer perceptrons (MLPs). However, coordinate-based MLPs struggle with high-frequency information due to spectral bias. A common solution to the spectral bias problem is to use Fourier features with fixed encoding frequencies instead of spatial coordinates as inputs to the MLPs. Natural scenes exhibit distinct frequency spectra across local areas, with the main regions characterized by low frequencies and the edges by high frequencies. The fixed encoding frequency Fourier feature will lead to redundant input information and reduce the running speed of MLPs. Therefore, this paper proposes an Implicit Neural Representation with Adaptive Learnable Filters framework (NRALF), which is controlled by a learnable parameter to achieve low-pass, band-pass, high-pass, all-pass and all-no-pass functions. This filter filters the Fourier features of different frequencies, making the filtered coding space more sparse, thereby enhancing the expression ability of MLPs for natural scenes and significantly improving the convergence speed of MLPs. Experimental results show that the proposed method has higher accuracy and faster convergence speed in scene representation.

Beijing Information Science & Technology University (CN), Capital Normal University (CN)
Quality Education
Openalex Percentile: Top 81%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.