Dual attention-guided cross-layer optimised semantic segmentation algorithm for street scenes

Aiming at the problems of slow speed of semantic segmentation of street scenes, unsmooth segmentation edges, and difficulty in accurate segmentation of small targets, this paper proposes a dual-attention-guided cross-layer optimised semantic segmentation algorithm for street scenes. Firstly, the backbone network is replaced and modified to improve the segmentation speed; secondly, a cross-layer feature fusion decoding network based on spatial alignment is constructed to achieve the fusion of semantic information and detail information, and to enhance the expressive ability of targets at different scales; lastly, achannel and spatial attention mechanism is proposed to model the global channel correlation and long-distance location correlation, and to enhance the network's ability of learning key features. The experimental results on the street scene dataset Cityscapes show that the proposed feature extraction coding network, cross-layer feature fusion decoding network, and attention mechanism module are effective; the experimental results show that the training speed of the model is improved by 2-3 times with the image of 2048×1024 size as the input, and at the same time, the test accuracy of the mIoU can reach 73. 8%, and the test speed is improved by 1.340s/sheet. 1.340s/picture to 0.689s/picture, and the problem of incomplete segmentation and mis-segmentation of ground traffic signs is effectively improved.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1145/3703935.3704005
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dual attention-guided cross-layer optimised semantic segmentation algorithm for street scenes

Rongzhen Dong, Caixia Meng, Yana Guo
1 links
Video Surveillance and Tracking Methods
article

Dual attention-guided cross-layer optimised semantic segmentation algorithm for street scenes

Rongzhen Dong, Caixia Meng, Yana Guo
article en

Abstract

Aiming at the problems of slow speed of semantic segmentation of street scenes, unsmooth segmentation edges, and difficulty in accurate segmentation of small targets, this paper proposes a dual-attention-guided cross-layer optimised semantic segmentation algorithm for street scenes. Firstly, the backbone network is replaced and modified to improve the segmentation speed; secondly, a cross-layer feature fusion decoding network based on spatial alignment is constructed to achieve the fusion of semantic information and detail information, and to enhance the expressive ability of targets at different scales; lastly, achannel and spatial attention mechanism is proposed to model the global channel correlation and long-distance location correlation, and to enhance the network's ability of learning key features. The experimental results on the street scene dataset Cityscapes show that the proposed feature extraction coding network, cross-layer feature fusion decoding network, and attention mechanism module are effective; the experimental results show that the training speed of the model is improved by 2-3 times with the image of 2048×1024 size as the input, and at the same time, the test accuracy of the mIoU can reach 73. 8%, and the test speed is improved by 1.340s/sheet. 1.340s/picture to 0.689s/picture, and the problem of incomplete segmentation and mis-segmentation of ground traffic signs is effectively improved.

Xi’an University of Posts and Telecommunications (CN)
Openalex Percentile: Top 70%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Dual attention-guided cross-layer optimised semantic segmentation algorithm for street scenes — Rongzhen Dong, Caixia Meng, et al. · (2024) | TGRS Research Map | TGRS