Video text detection with multiattention feature fusion network

Video text detection in dynamic scenes faces challenges such as motion blur, scale variation, and complex backgrounds. To address these issues, we propose a novel multi-attention feature fusion network (MAFFNet) based on Transformer architecture. This framework integrates Shuffle Attention (SA), Convolutional Block Attention Module (CBAM), and Feature Pyramid Enhancement Module (FPEM) to enhance feature representation and fusion. Specifically, SA dynamically adjusts channel and spatial weights to focus on critical text regions, while CBAM suppresses background noise through dual-path attention. FPEM recursively fuses multi-scale features to improve robustness against small and blurred text. Additionally, Reparameterized Batch Normalization (RepBN) optimizes feature distribution consistency for stable tracking. Experiments on ICDAR2015-Video and COCO-Text v2 datasets demonstrate that MAFFNet achieves state-of-the-art performance, with MOTA of 47.35%, MOTP of 75.59%, and IDF1 of 59.71%. Ablation studies validate the synergistic effects of SA, CBAM, FPEM, and RepBN, highlighting their contributions to improving detection accuracy and identity preservation in video sequences.

Authors

Institutions

Publication Details

Published
2025-07-16
DOI
https://doi.org/10.1117/12.3070826
Citations
1
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Video text detection with multiattention feature fusion network

Mayire Ibrayim, Yishu Xue
1 citations
Handwritten Text Recognition Techniques
1.28
article

Video text detection with multiattention feature fusion network

Mayire Ibrayim, Yishu Xue
article en
1 citations

Abstract

Video text detection in dynamic scenes faces challenges such as motion blur, scale variation, and complex backgrounds. To address these issues, we propose a novel multi-attention feature fusion network (MAFFNet) based on Transformer architecture. This framework integrates Shuffle Attention (SA), Convolutional Block Attention Module (CBAM), and Feature Pyramid Enhancement Module (FPEM) to enhance feature representation and fusion. Specifically, SA dynamically adjusts channel and spatial weights to focus on critical text regions, while CBAM suppresses background noise through dual-path attention. FPEM recursively fuses multi-scale features to improve robustness against small and blurred text. Additionally, Reparameterized Batch Normalization (RepBN) optimizes feature distribution consistency for stable tracking. Experiments on ICDAR2015-Video and COCO-Text v2 datasets demonstrate that MAFFNet achieves state-of-the-art performance, with MOTA of 47.35%, MOTP of 75.59%, and IDF1 of 59.71%. Ablation studies validate the synergistic effects of SA, CBAM, FPEM, and RepBN, highlighting their contributions to improving detection accuracy and identity preservation in video sequences.

Xinjiang University (CN)
Openalex Percentile: Top 18%
Handwritten Text Recognition Techniques
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.