Fuzzy Attention Convolutional Neural Networks: A Novel Approach Combining Intuitionistic Fuzzy Sets and Deep Learning

Deep learning attention mechanisms have achieved remarkable progress in computer vision, but still face limitations when handling images with ambiguous boundaries and uncertain feature representations. Conventional attention modules such as SE-Net, CBAM, ECA-Net, and CA adopt a deterministic paradigm, assigning fixed scalar weights to features without modeling ambiguity or confidence. To overcome these limitations, this paper proposes the Fuzzy Attention Network Layer (FANL), which integrates intuitionistic fuzzy set theory with convolutional neural networks to explicitly represent feature uncertainty through membership (μ), non-membership (ν), and hesitation (π) degrees. FANL consists of four core modules: (1) feature dimensionality reduction via global pooling, (2) fuzzy modeling using learnable clustering centers, (3) adaptive attention generation through weighted fusion of fuzzy components, and (4) feature refinement through residual connections. A cross-layer guidance mechanism is further introduced to enhance hierarchical feature propagation, allowing high-level semantic features to incorporate fine-grained texture information from shallow layers. Comprehensive experiments on three benchmark datasets—PathMNIST-30000, full PathMNIST, and BloodMNIST—demonstrate the effectiveness and generalizability of FANL. The model achieves 84.41 ± 0.56% accuracy and a 1.69% improvement over the baseline CNN while maintaining lightweight computational complexity. Ablation studies show that removing any component causes a 1.7%–2.0% performance drop, validating the synergistic contribution of each module. Furthermore, FANL provides superior uncertainty calibration (ECE = 0.0452) and interpretable selective prediction under uncertainty. Overall, FANL presents an efficient and uncertainty-aware attention framework that improves both accuracy and reliability, offering a promising direction for robust visual recognition under ambiguous or noisy conditions.

Authors

Publication Details

Journal
Computers, materials & continua/Computers, materials & continua (Print)
Published
2026-01-01
DOI
https://doi.org/10.32604/cmc.2026.073969
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fuzzy Attention Convolutional Neural Networks: A Novel Approach Combining Intuitionistic Fuzzy Sets and Deep Learning

Doo Heon Song, Zheng Zhao, Kwang Baek Kim
Computers, materials & continua/Computers, materials & continua (Print)
Advanced Neural Network Applications
article

Fuzzy Attention Convolutional Neural Networks: A Novel Approach Combining Intuitionistic Fuzzy Sets and Deep Learning

Doo Heon Song, Zheng Zhao, Kwang Baek Kim
article en

Abstract

Deep learning attention mechanisms have achieved remarkable progress in computer vision, but still face limitations when handling images with ambiguous boundaries and uncertain feature representations. Conventional attention modules such as SE-Net, CBAM, ECA-Net, and CA adopt a deterministic paradigm, assigning fixed scalar weights to features without modeling ambiguity or confidence. To overcome these limitations, this paper proposes the Fuzzy Attention Network Layer (FANL), which integrates intuitionistic fuzzy set theory with convolutional neural networks to explicitly represent feature uncertainty through membership (μ), non-membership (ν), and hesitation (π) degrees. FANL consists of four core modules: (1) feature dimensionality reduction via global pooling, (2) fuzzy modeling using learnable clustering centers, (3) adaptive attention generation through weighted fusion of fuzzy components, and (4) feature refinement through residual connections. A cross-layer guidance mechanism is further introduced to enhance hierarchical feature propagation, allowing high-level semantic features to incorporate fine-grained texture information from shallow layers. Comprehensive experiments on three benchmark datasets—PathMNIST-30000, full PathMNIST, and BloodMNIST—demonstrate the effectiveness and generalizability of FANL. The model achieves 84.41 ± 0.56% accuracy and a 1.69% improvement over the baseline CNN while maintaining lightweight computational complexity. Ablation studies show that removing any component causes a 1.7%–2.0% performance drop, validating the synergistic contribution of each module. Furthermore, FANL provides superior uncertainty calibration (ECE = 0.0452) and interpretable selective prediction under uncertainty. Overall, FANL presents an efficient and uncertainty-aware attention framework that improves both accuracy and reliability, offering a promising direction for robust visual recognition under ambiguous or noisy conditions.

Computers, materials & continua/Computers, materials & continua (Print)Vol. 87(2)
Openalex Percentile: Top 94%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.