Dynamic Multi-Modal Fusion in Photovoltaic Defect Detection: A Lightweight Edge-Cloud Architecture with Three-Stage Collaboration

This paper proposes a three-stage collaborative defect detection framework for PV power plant operation and maintenance, effectively addressing the contradiction between detection accuracy and computational resources in dynamic scenarios. By integrating template matching, color space analysis, and visual language models (VLM), an edge-cloud primary-backup collaborative detection architecture is constructed, enabling real-time detection of module missing, stains, and cracks. Experiments demonstrate that the system achieves millisecond-level processing speed on embedded platforms, with a comprehensive miss rate of 2.68%, representing a 3.2-fold improvement in energy efficiency over traditional methods. The dynamic template update mechanism reduces the false positive rate to 1.43%, and the fusion detection strategy of VLM and HSV maintains high accuracy even under poor network conditions.

Authors

Institutions

Publication Details

Published
2025-05-23
DOI
https://doi.org/10.1109/netps65392.2025.11102107
Primary Topic
Industrial Vision Systems and Defect Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dynamic Multi-Modal Fusion in Photovoltaic Defect Detection: A Lightweight Edge-Cloud Architecture with Three-Stage Collaboration

Bainan Zhou, Lingling Qi, Zhichun Lei, Keming Chen
Industrial Vision Systems and Defect Detection
article

Dynamic Multi-Modal Fusion in Photovoltaic Defect Detection: A Lightweight Edge-Cloud Architecture with Three-Stage Collaboration

Bainan Zhou, Lingling Qi, Zhichun Lei, Keming Chen
article en

Abstract

This paper proposes a three-stage collaborative defect detection framework for PV power plant operation and maintenance, effectively addressing the contradiction between detection accuracy and computational resources in dynamic scenarios. By integrating template matching, color space analysis, and visual language models (VLM), an edge-cloud primary-backup collaborative detection architecture is constructed, enabling real-time detection of module missing, stains, and cracks. Experiments demonstrate that the system achieves millisecond-level processing speed on embedded platforms, with a comprehensive miss rate of 2.68%, representing a 3.2-fold improvement in energy efficiency over traditional methods. The dynamic template update mechanism reduces the false positive rate to 1.43%, and the fusion detection strategy of VLM and HSV maintains high accuracy even under poor network conditions.

China Mobile (China) (CN), Hangzhou Dianzi University (CN)
Affordable and clean energy
Openalex Percentile: Top 71%
Industrial Vision Systems and Defect Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.