Efficient Channel and Bilinear Spatial Attention Module Based on CBAM

The introduction of attention modules can effectively enhance the performance of convolutional neural networks in machine vision tasks. Addressing the issues of partial channel information loss caused by channel dimension reduction and insufficient spatial representation due to overly large convolutional kernels in the Convolutional Block Attention Module (CBAM), this paper proposes a new Efficient Channel and Bilinear Spatial Attention Module (EC-BSAM). Firstly, efficient inter-channel interaction is achieved using convolutional operations without dimension reduction to extract crucial channel attention features. Secondly, based on a strategy of bilinear feature fusion, convolutional operations with two different kernel sizes are employed to extract spatial attention features twice. Feature fusion is achieved through weighted concatenation, enhancing the spatial representation capability of the attention module. Finally, extensive experiments are conducted on the CIFAR-10 image dataset. The experimental results demonstrate that EC-BSAM achieves an improvement of 0.53% and 0.28% in classification accuracy on the backbone networks FastNet_T0 and ResNet8 respectively compared to CBAM. Additionally, EC-BSAM also enhances the classification performance of ResNet18, ShuffleNetV2, and MobileNetV2. The experiments validate that EC-BSAM can effectively enhance the feature extraction capability of convolutional neural networks while maintaining strong compatibility.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1109/icacte62428.2024.10871433
Citations
2
Primary Topic
Blind Source Separation Techniques
Type
article
Field-Weighted Citation Impact
0.70
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient Channel and Bilinear Spatial Attention Module Based on CBAM

Zhen Chen, Changyong Zheng
2 citations
Blind Source Separation Techniques
0.70
article

Efficient Channel and Bilinear Spatial Attention Module Based on CBAM

Zhen Chen, Changyong Zheng
article en
2 citations

Abstract

The introduction of attention modules can effectively enhance the performance of convolutional neural networks in machine vision tasks. Addressing the issues of partial channel information loss caused by channel dimension reduction and insufficient spatial representation due to overly large convolutional kernels in the Convolutional Block Attention Module (CBAM), this paper proposes a new Efficient Channel and Bilinear Spatial Attention Module (EC-BSAM). Firstly, efficient inter-channel interaction is achieved using convolutional operations without dimension reduction to extract crucial channel attention features. Secondly, based on a strategy of bilinear feature fusion, convolutional operations with two different kernel sizes are employed to extract spatial attention features twice. Feature fusion is achieved through weighted concatenation, enhancing the spatial representation capability of the attention module. Finally, extensive experiments are conducted on the CIFAR-10 image dataset. The experimental results demonstrate that EC-BSAM achieves an improvement of 0.53% and 0.28% in classification accuracy on the backbone networks FastNet_T0 and ResNet8 respectively compared to CBAM. Additionally, EC-BSAM also enhances the classification performance of ResNet18, ShuffleNetV2, and MobileNetV2. The experiments validate that EC-BSAM can effectively enhance the feature extraction capability of convolutional neural networks while maintaining strong compatibility.

Anhui Jianzhu University (CN)
Openalex Percentile: Top 28%
Blind Source Separation Techniques
0.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Efficient Channel and Bilinear Spatial Attention Module Based on CBAM — Zhen Chen, Changyong Zheng · (2024) | TGRS Research Map | TGRS