Geometry transfer of deep neural networks for heliostat detection

Reliable object and keypoint detection on heliostats is essential for advancing automation and practical deployment of airborne condition-monitoring methods in concentrated solar thermal (CST) tower plants. Yet the wide variety of heliostat collector geometries in real systems limits the applicability of deep-learning approaches, and their transferability between plants remains unexplored. To address this gap, we compiled a database of representative real-world heliostat geometries and generated a large synthetic dataset using our previously published rendering framework. With this data, we evaluated three training strategies: geometry-specific baseline models trained from scratch, a universal model intended to generalize across all geometries, and fine-tuning approaches initialized from either the baseline or the universal model. Baseline models perform well on their respective geometries, while the universal model shows inconsistent performance and may not be sufficient as a stand-alone solution. Fine-tuning, however, consistently adapts the model to new geometries and achieves performance comparable to geometry-specific baselines, as shown by suitable metrics on real-world test datasets of three distinct collector types. In practice, an effective model for a new geometry can be obtained by rendering as few as 100 synthetic images and fine-tuning an available baseline or universal model for 2000 iterations. This procedure requires 20 h on a single GPU and scales efficiently with additional computational resources. Overall, the results demonstrate that fine-tuning an existing heliostat detection model to the target domain provides a practical and reliable strategy for deploying deep models across the diverse heliostat collector geometries present in CST plants.

Authors

Institutions

Publication Details

Journal
Solar Energy
Published
2026-09-04
DOI
https://doi.org/10.1016/j.solener.2026.115058
Primary Topic
Solar Thermal and Photovoltaic Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Geometry transfer of deep neural networks for heliostat detection

Rafal Broda, Alexander Schnerring, Sonja Kallio, Marc Röger et al.
Solar Energy
Solar Thermal and Photovoltaic Systems
article

Geometry transfer of deep neural networks for heliostat detection

Rafal Broda, Alexander Schnerring, Sonja Kallio, Marc Röger, Rudolph Triebel, M. Nieslony, Dominik Schnaus, Niels Algner, Tobias Wagner, Robert Pitz-Paal
article en

Abstract

Reliable object and keypoint detection on heliostats is essential for advancing automation and practical deployment of airborne condition-monitoring methods in concentrated solar thermal (CST) tower plants. Yet the wide variety of heliostat collector geometries in real systems limits the applicability of deep-learning approaches, and their transferability between plants remains unexplored. To address this gap, we compiled a database of representative real-world heliostat geometries and generated a large synthetic dataset using our previously published rendering framework. With this data, we evaluated three training strategies: geometry-specific baseline models trained from scratch, a universal model intended to generalize across all geometries, and fine-tuning approaches initialized from either the baseline or the universal model. Baseline models perform well on their respective geometries, while the universal model shows inconsistent performance and may not be sufficient as a stand-alone solution. Fine-tuning, however, consistently adapts the model to new geometries and achieves performance comparable to geometry-specific baselines, as shown by suitable metrics on real-world test datasets of three distinct collector types. In practice, an effective model for a new geometry can be obtained by rendering as few as 100 synthetic images and fine-tuning an available baseline or universal model for 2000 iterations. This procedure requires 20 h on a single GPU and scales efficiently with additional computational resources. Overall, the results demonstrate that fine-tuning an existing heliostat detection model to the target domain provides a practical and reliable strategy for deploying deep models across the diverse heliostat collector geometries present in CST plants.

Solar EnergyVol. 318
Karlsruhe Institute of Technology (DE), Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE), Technical University of Munich (DE), RWTH Aachen University (DE)
European Commission, Deutsches Zentrum für Luft- und Raumfahrt, Leibniz-Gemeinschaft, Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas
Openalex Percentile: Top 28%
Solar Thermal and Photovoltaic Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.