Frequency domain complex-valued convolutional neural network

• Formulation of fully complex-valued building blocks for complex-valued CNNs, ensuring consistent operation in the frequency domain. • Lightweight, computationally efficient, fully complex-valued residual CNN operating on complex data in the frequency domain. • Novel log-magnitude activation function that maintains phase information while introducing effective non-linearity, along with a detailed comparative analysis with the complex ReLU variant and the Cardioid activation function. • We have shown that complex-valued CNNs can outperform real-valued CNNs, enhancing performance and generalization while reducing computational demands. Complex-valued convolutional neural networks have demonstrated promising results in reducing space, time, and computational complexity compared to real-valued models, particularly in signal and image processing. Despite their strong representational capacity and theoretical benefits, complex-valued CNNs remain limited due to theabsence of simplified theoretical and practical formulations for fully complex-valued building blocks. Existing studies often depend on fast Fourier transforms (FFT/IFFT) for domain transitions between layers due to the lack of well-established complex-valued activation functions or filter parameters initialization. Additionally, many earlier works adapt complex versions of the real-valued activation functions in a split-type manner, which might distort phase information and weaken generalization. To overcome these challenges, we propose a lightweight fully complex-valued residual CNN that operates entirely on complex data in the frequency domain. Our design simplifies fully complex building blocks and introduces a Log-Magnitude activation function that preserves phase information, outperforming traditional complex ReLU variants and the Cardioid activation function. Experimental validation across diverse multi-modal datasets, including MNIST, SVHN, MIT-BIH Arrhythmia, PTB Diagnostic ECG, DIAT- μ RadHAR , and DIAT- μ SAT , demonstrates the superior performance of our fully complex-valued CNNs over real-valued models.

Authors

Institutions

Publication Details

Journal
Expert Systems with Applications
Published
2025-07-05
DOI
https://doi.org/10.1016/j.eswa.2025.128893
Citations
1
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Frequency domain complex-valued convolutional neural network

Masood Aryapoor, Mainak Chakraborty, Masoud Daneshtalab
1 citations
Expert Systems with Applications
Neural Networks and Applications
2.48
article

Frequency domain complex-valued convolutional neural network

Masood Aryapoor, Mainak Chakraborty, Masoud Daneshtalab
article en
1 citations

Abstract

• Formulation of fully complex-valued building blocks for complex-valued CNNs, ensuring consistent operation in the frequency domain. • Lightweight, computationally efficient, fully complex-valued residual CNN operating on complex data in the frequency domain. • Novel log-magnitude activation function that maintains phase information while introducing effective non-linearity, along with a detailed comparative analysis with the complex ReLU variant and the Cardioid activation function. • We have shown that complex-valued CNNs can outperform real-valued CNNs, enhancing performance and generalization while reducing computational demands. Complex-valued convolutional neural networks have demonstrated promising results in reducing space, time, and computational complexity compared to real-valued models, particularly in signal and image processing. Despite their strong representational capacity and theoretical benefits, complex-valued CNNs remain limited due to theabsence of simplified theoretical and practical formulations for fully complex-valued building blocks. Existing studies often depend on fast Fourier transforms (FFT/IFFT) for domain transitions between layers due to the lack of well-established complex-valued activation functions or filter parameters initialization. Additionally, many earlier works adapt complex versions of the real-valued activation functions in a split-type manner, which might distort phase information and weaken generalization. To overcome these challenges, we propose a lightweight fully complex-valued residual CNN that operates entirely on complex data in the frequency domain. Our design simplifies fully complex building blocks and introduces a Log-Magnitude activation function that preserves phase information, outperforming traditional complex ReLU variants and the Cardioid activation function. Experimental validation across diverse multi-modal datasets, including MNIST, SVHN, MIT-BIH Arrhythmia, PTB Diagnostic ECG, DIAT- μ RadHAR , and DIAT- μ SAT , demonstrates the superior performance of our fully complex-valued CNNs over real-valued models.

Expert Systems with ApplicationsVol. 295
Tallinn University of Technology (EE), Tallinn University (EE), Eskilstuna Municipality (SE), Mälardalen University (SE)
Mälardalens högskola
Openalex Percentile: Top 10%
Neural Networks and Applications
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.