CASML: Combining Cross-Scale Attention and Separate Mix-Layer for Lightweight Classification Network
We propose a Separate Cross-Layer Module to achieve a lightweight method by splitting the network and a Cross- Scale Attention Module to enhance feature representation by extracting cross-scale features. By combining these two modules, we introduce CASML backbone for classification tasks. Through experiments, we demonstrate that we can reduce the computational costs by 25% and improve classification accuracy by 1.8% on the CIFAR100 dataset. These modules can be incorporated into other classification networks to achieve similar performance, demonstrating high versatility.
Authors
- Jun-Wei Hsieh (ORCID: https://orcid.org/0000-0003-4729-0730)
- Po-Yu Liao
- Chun-Chieh Lee (ORCID: https://orcid.org/0000-0002-1285-6100)
- Yumin Zhang (ORCID: https://orcid.org/0000-0003-0767-1221)
- Kuo‐Chin Fan (ORCID: https://orcid.org/0009-0001-2519-3027)
Institutions
- National Yang Ming Chiao Tung University (TW)
- National Central University (TW)
Publication Details
- Published
- 2024-10-25
- DOI
- https://doi.org/10.1109/wocc61718.2024.10786083
- Primary Topic
- Face and Expression Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00