A Multimodal Power Sample Feature Migration Method Based on Dual Cross-Modal Information Decoupling

With the rapid development of energy transition and power system informatization, the efficient integration and feature migration of multimodal power data have become critical challenges for intelligent power systems. Existing methods often overlook fine-grained semantic relationships in cross-modal alignment, leading to low information utilization. This paper proposes a multimodal power sample feature migration method based on dual cross-modal information decoupling. By introducing a fine-grained image–text alignment strategy and a dual-stream attention mechanism, deep integration and efficient migration of multimodal features are achieved. Experiments demonstrate that the proposed method outperforms baseline models (e.g., LLaVA, Qwen) in power scenario description (CSD), event localization (CELC), and knowledge question answering (CKQ), with significant improvements of up to 12.8% in key metrics such as image captioning (IC) and grounded captioning (GC). The method provides a robust solution for multimodal feature migration in power inspection and real-time monitoring, showing high practical value in industrial applications.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2025-09-10
DOI
https://doi.org/10.3390/app15189913
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multimodal Power Sample Feature Migration Method Based on Dual Cross-Modal Information Decoupling

Shuai Zhao, Jianguang Du, Yunfeng Yan, Zhen-Yu Chen et al.
Applied Sciences
Multimodal Machine Learning Applications
article

A Multimodal Power Sample Feature Migration Method Based on Dual Cross-Modal Information Decoupling

Shuai Zhao, Jianguang Du, Yunfeng Yan, Zhen-Yu Chen, Yi Chen, Huaguang Yan, Yuhao Zhou
article en

Abstract

With the rapid development of energy transition and power system informatization, the efficient integration and feature migration of multimodal power data have become critical challenges for intelligent power systems. Existing methods often overlook fine-grained semantic relationships in cross-modal alignment, leading to low information utilization. This paper proposes a multimodal power sample feature migration method based on dual cross-modal information decoupling. By introducing a fine-grained image–text alignment strategy and a dual-stream attention mechanism, deep integration and efficient migration of multimodal features are achieved. Experiments demonstrate that the proposed method outperforms baseline models (e.g., LLaVA, Qwen) in power scenario description (CSD), event localization (CELC), and knowledge question answering (CKQ), with significant improvements of up to 12.8% in key metrics such as image captioning (IC) and grounded captioning (GC). The method provides a robust solution for multimodal feature migration in power inspection and real-time monitoring, showing high practical value in industrial applications.

Applied SciencesVol. 15(18)
State Grid Corporation of China (China) (CN), Zhejiang Ocean University (CN), Shanghai Electric (China) (CN), Zhejiang University (CN)
Openalex Percentile: Top 77%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Multimodal Power Sample Feature Migration Method Based on Dual Cross-Modal Information Decoupling — Shuai Zhao, Jianguang Du, et al. · Applied Sciences (2025) | TGRS Research Map | TGRS