Dual Backbone Multi-Attention Hierarchical Fusion and Feature Enhancement Network for Crowd Counting

In recent years, significant progress has been made in crowd counting with the development of convolutional neural networks (CNNs). However, while CNNs excel at extracting local features, their limited receptive fields restrict their ability to model global context. In contrast, Transformers can effectively model long-distance dependencies, but are inferior to CNN in capturing local detail features. Local details and global context information are crucial to handle large-scale changes in crowds. To address this problem, we propose a novel dual backbone network (DBNet) that integrates CNN and Transformer architectures, aiming to capture and aggregate both global semantic information and local detail features at multiple levels. Specifically, the dual backbone structure is designed to extract fine-grained local features while modeling long-range contextual relationships. Additionally, we introduce a multi-attention hierarchical fusion module (MAHF) that integrates global and local features from the two backbones while suppressing background noise. To further enhance accuracy in the presence of multi-scale variations, we also employ a Feature Enhancement Module (FEM), which enables the network to more effectively identify edge features and facilitates more effective multi-scale feature modeling. Extensive experiments on ShanghaiTech, UCF-QNRF, and JHU-Crowd++ datasets demonstrate that DBNet achieves competitive performance, validating the effectiveness of our approach.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Consumer Electronics
Published
2025-04-03
DOI
https://doi.org/10.1109/tce.2025.3557449
Citations
4
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
5.10
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dual Backbone Multi-Attention Hierarchical Fusion and Feature Enhancement Network for Crowd Counting

Lei Lyu, Xingyu Gao, Chunling Zheng, Zhenyu Chen
4 citations
IEEE Transactions on Consumer Electronics
Video Surveillance and Tracking Methods
5.10
article

Dual Backbone Multi-Attention Hierarchical Fusion and Feature Enhancement Network for Crowd Counting

Lei Lyu, Xingyu Gao, Chunling Zheng, Zhenyu Chen
article en
4 citations

Abstract

In recent years, significant progress has been made in crowd counting with the development of convolutional neural networks (CNNs). However, while CNNs excel at extracting local features, their limited receptive fields restrict their ability to model global context. In contrast, Transformers can effectively model long-distance dependencies, but are inferior to CNN in capturing local detail features. Local details and global context information are crucial to handle large-scale changes in crowds. To address this problem, we propose a novel dual backbone network (DBNet) that integrates CNN and Transformer architectures, aiming to capture and aggregate both global semantic information and local detail features at multiple levels. Specifically, the dual backbone structure is designed to extract fine-grained local features while modeling long-range contextual relationships. Additionally, we introduce a multi-attention hierarchical fusion module (MAHF) that integrates global and local features from the two backbones while suppressing background noise. To further enhance accuracy in the presence of multi-scale variations, we also employ a Feature Enhancement Module (FEM), which enables the network to more effectively identify edge features and facilitates more effective multi-scale feature modeling. Extensive experiments on ShanghaiTech, UCF-QNRF, and JHU-Crowd++ datasets demonstrate that DBNet achieves competitive performance, validating the effectiveness of our approach.

IEEE Transactions on Consumer ElectronicsVol. 71(2)
State Grid Corporation of China (China) (CN), Chinese Academy of Sciences (CN), Shandong Normal University (CN), Institute of Microelectronics (CN)
Openalex Percentile: Top 5%
Video Surveillance and Tracking Methods
5.10
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.