Overcoming Variable Illumination in Photovoltaic Snow Monitoring: A Real-Time Robust Drone-Based Deep Learning Approach

Snow accumulation on photovoltaic (PV) panels can cause significant energy losses in cold climates. While drone-based monitoring offers a scalable solution, real-world challenges like varying illumination can hinder accurate snow detection. We previously developed a YOLO-based drone system for snow coverage detection using a Fixed Thresholding segmentation method to discriminate snow from the solar panel; however, it struggled in challenging lighting conditions. This work addresses those limitations by presenting a reliable drone-based system to accurately estimate the Snow Coverage Percentage (SCP) over PV panels. The system combines a lightweight YOLOv11n-seg deep learning model for panel detection with an adaptive image processing algorithm for snow segmentation. We benchmarked several segmentation models, including MASK R-CNN and the state-of-the-art SAM2 segmentation model. YOLOv11n-seg was selected for its optimal balance of speed and accuracy, achieving 0.99 precision and 0.80 recall. To overcome the unreliability of static thresholding under changing lighting, various dynamic methods were evaluated. Otsu’s algorithm proved most effective, reducing the absolute error of the mean in SCP estimation to just 1.1%, a significant improvement over the 13.78% error from the previous fixed-thresholding approach. The integrated system was successfully validated for real-time performance on live drone video streams, demonstrating a highly accurate and scalable solution for autonomous snow monitoring on PV systems.