Enhanced Model Robustness by Integrated Local and Global Processing

Convolutional Neural Networks (CNNs) have achieved significant success in various image recognition and classification tasks. However, their reliance on local convolutions introduces a vulnerability to adversarial examples—inputs subtly perturbed to deceive the model into making incorrect predictions. This vulnerability arises because local convolutions focus on small patches of the input, missing the broader context and making the model sensitive to minor changes. To address this issue, we propose an architecture that combines Convolutional Block Attention Modules (CBAM) and Optimized Non-Local Blocks to enhance robustness. CBAMs improve feature extraction by applying sequential channel and spatial attention, while Optimized Non-Local Blocks capture long-range dependencies, providing a global context. Our experiments on CIFAR-10, CIFAR-10-C, and Imagewoof datasets demonstrate that our Combined Model outperforms standard CNNs across various types of noise and perturbations, with improvements ranging from 1.5% to 10.5%. These results highlight the effectiveness of integrating local and global processing mechanisms to enhance the robustness and generalization capabilities of deep learning model.

Authors

Institutions

Publication Details

Published
2024-10-28
DOI
https://doi.org/10.1109/cogmi62246.2024.00038
Citations
1
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhanced Model Robustness by Integrated Local and Global Processing

KC Santosh, Longwei Wang, Aashish Ghimire
1 citations
Anomaly Detection Techniques and Applications
0.35
article

Enhanced Model Robustness by Integrated Local and Global Processing

KC Santosh, Longwei Wang, Aashish Ghimire
article en
1 citations

Abstract

Convolutional Neural Networks (CNNs) have achieved significant success in various image recognition and classification tasks. However, their reliance on local convolutions introduces a vulnerability to adversarial examples—inputs subtly perturbed to deceive the model into making incorrect predictions. This vulnerability arises because local convolutions focus on small patches of the input, missing the broader context and making the model sensitive to minor changes. To address this issue, we propose an architecture that combines Convolutional Block Attention Modules (CBAM) and Optimized Non-Local Blocks to enhance robustness. CBAMs improve feature extraction by applying sequential channel and spatial attention, while Optimized Non-Local Blocks capture long-range dependencies, providing a global context. Our experiments on CIFAR-10, CIFAR-10-C, and Imagewoof datasets demonstrate that our Combined Model outperforms standard CNNs across various types of noise and perturbations, with improvements ranging from 1.5% to 10.5%. These results highlight the effectiveness of integrating local and global processing mechanisms to enhance the robustness and generalization capabilities of deep learning model.

University of South Dakota (US)
Openalex Percentile: Top 30%
Anomaly Detection Techniques and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhanced Model Robustness by Integrated Local and Global Processing — KC Santosh, Longwei Wang, et al. · (2024) | TGRS Research Map | TGRS