Semantic-Enhanced Underwater Videos Multi-Label Classification Network Based on Structural Graph Convolution

Underwater visual degradation makes it difficult for the image modality to represent video semantics, while label sparsity in underwater scenes leads to weak inter-category correlations, thereby degrading the performance of multi-label classification. To address these issues, this paper proposes a Semantic-Enhanced Underwater Videos Multi-Label Classification Network Based on Structural Graph Convolution (SEMGCN). Specifically, the proposed method first disentangles the image and text modalities into shared and private representations, and enhances feature representation capability through orthogonal constraints and feature reconstruction. Moreover, a Cross-Modal Category-Aware Module (CCAM) is constructed to model interactions between image and text features and perform bidirectional cross-attention with category-label text embeddings, thereby generating category-aware initial node representations. Furthermore, to alleviate the limitation of semantic propagation caused by sparse label co-occurrence, a Structural Graph Convolutional Network (SGCN) is proposed. By integrating explicit co-occurrence relationships with implicit structural similarity relationships, the proposed model collaboratively captures both explicit and latent semantic associations, thereby improving multi-label classification performance under label-sparse conditions. Experiments were conducted on the self-constructed Underwater Video Multi-label Classification Dataset (UVMC) and the public MLSV2018 dataset. The experimental results show that SEMGCN achieves Average Precision scores of 0.8645 and 0.8388 on UVMC and MLSV2018, respectively, demonstrating the effectiveness of the proposed method.

Authors

Institutions

Publication Details

Journal
Multimodal Technologies and Interaction
Published
2026-08-27
DOI
https://doi.org/10.3390/mti10090088
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Semantic-Enhanced Underwater Videos Multi-Label Classification Network Based on Structural Graph Convolution

Peiguang Jing, Yun Li, Jun Yang, Junfeng Wei et al.
Multimodal Technologies and Interaction
Text and Document Classification Technologies
article

Semantic-Enhanced Underwater Videos Multi-Label Classification Network Based on Structural Graph Convolution

Peiguang Jing, Yun Li, Jun Yang, Junfeng Wei, Kunsheng Wu, Hui Guo
article en

Abstract

Underwater visual degradation makes it difficult for the image modality to represent video semantics, while label sparsity in underwater scenes leads to weak inter-category correlations, thereby degrading the performance of multi-label classification. To address these issues, this paper proposes a Semantic-Enhanced Underwater Videos Multi-Label Classification Network Based on Structural Graph Convolution (SEMGCN). Specifically, the proposed method first disentangles the image and text modalities into shared and private representations, and enhances feature representation capability through orthogonal constraints and feature reconstruction. Moreover, a Cross-Modal Category-Aware Module (CCAM) is constructed to model interactions between image and text features and perform bidirectional cross-attention with category-label text embeddings, thereby generating category-aware initial node representations. Furthermore, to alleviate the limitation of semantic propagation caused by sparse label co-occurrence, a Structural Graph Convolutional Network (SGCN) is proposed. By integrating explicit co-occurrence relationships with implicit structural similarity relationships, the proposed model collaboratively captures both explicit and latent semantic associations, thereby improving multi-label classification performance under label-sparse conditions. Experiments were conducted on the self-constructed Underwater Video Multi-label Classification Dataset (UVMC) and the public MLSV2018 dataset. The experimental results show that SEMGCN achieves Average Precision scores of 0.8645 and 0.8388 on UVMC and MLSV2018, respectively, demonstrating the effectiveness of the proposed method.

Multimodal Technologies and InteractionVol. 10(9)
Minzu University of China (CN), Tianjin University (CN), Wuzhou University (CN)
Natural Science Foundation of Guangxi Zhuang Autonomous Region, National Natural Science Foundation of China
Openalex Percentile: Top 8%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.