Data imputation methods for intermittent renewable energy sources: Implications for energy system modeling

To incorporate a high share of intermittent renewable sources in energy systems, energy system optimization models rely on weather and climate time series data. However, data for renewable energy sources often contains missing values due to sensor or transmission faults. This study evaluates various data imputation methods for minutely-resolved global horizontal irradiance, direct normal irradiance, and wind speed time series, with missingness ranging from two to ninety percent. Alongside standard statistical tests, a novel validation criterion is introduced by directly evaluating the impact of imputation methods on energy system modeling. While certain imputation methods demonstrate strong point-wise statistical accuracy, they do not necessarily preserve the underlying data distribution. The performance of these methods is strongly influenced by the type of time series and the missingness mechanism, either continuous gaps or randomly missing data points. In energy system optimization, multiple imputation by chained equations, k -nearest neighbors, linear interpolation, and simple moving average yield the best results, outperforming more sophisticated deep learning-based methods. Overall, k -nearest neighbors consistently outperformed the other approaches across all validation criteria. By comprehensively evaluating the statistical performance of imputation methods and their impact on energy system modeling, this study offers valuable insights for researchers and practitioners addressing missing data in energy system applications. • Conventional versus machine learning-based imputation in high-resolution time series. • Statistical metrics as indicators of imputation methods’ effectiveness. • Energy system modeling to validate imputation methods in renewable energy time series. • Imputation performance across diverse missingness scenarios and data types.

Authors

Institutions

Publication Details

Journal
Energy Conversion and Management
Published
2025-05-22
DOI
https://doi.org/10.1016/j.enconman.2025.119857
Citations
7
Primary Topic
Energy Load and Power Forecasting
Type
article
Field-Weighted Citation Impact
5.11

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data imputation methods for intermittent renewable energy sources: Implications for energy system modeling

Detlef Stolten, Massimo Panella, Maximilian Hoffmann, Jann Michael Weinand et al.
7 citations
Energy Conversion and Management
Energy Load and Power Forecasting
5.11
article

Data imputation methods for intermittent renewable energy sources: Implications for energy system modeling

Detlef Stolten, Massimo Panella, Maximilian Hoffmann, Jann Michael Weinand, Olalekan Omoyele, Claudio Mantuano
article en
7 citations

Abstract

To incorporate a high share of intermittent renewable sources in energy systems, energy system optimization models rely on weather and climate time series data. However, data for renewable energy sources often contains missing values due to sensor or transmission faults. This study evaluates various data imputation methods for minutely-resolved global horizontal irradiance, direct normal irradiance, and wind speed time series, with missingness ranging from two to ninety percent. Alongside standard statistical tests, a novel validation criterion is introduced by directly evaluating the impact of imputation methods on energy system modeling. While certain imputation methods demonstrate strong point-wise statistical accuracy, they do not necessarily preserve the underlying data distribution. The performance of these methods is strongly influenced by the type of time series and the missingness mechanism, either continuous gaps or randomly missing data points. In energy system optimization, multiple imputation by chained equations, k -nearest neighbors, linear interpolation, and simple moving average yield the best results, outperforming more sophisticated deep learning-based methods. Overall, k -nearest neighbors consistently outperformed the other approaches across all validation criteria. By comprehensively evaluating the statistical performance of imputation methods and their impact on energy system modeling, this study offers valuable insights for researchers and practitioners addressing missing data in energy system applications. • Conventional versus machine learning-based imputation in high-resolution time series. • Statistical metrics as indicators of imputation methods’ effectiveness. • Energy system modeling to validate imputation methods in renewable energy time series. • Imputation performance across diverse missingness scenarios and data types.

Energy Conversion and ManagementVol. 339
Forschungszentrum Jülich (DE), Sapienza University of Rome (IT), RWTH Aachen University (DE)
Helmholtz Association
Affordable and clean energy
Openalex Percentile: Top 5%
Energy Load and Power Forecasting
5.11
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.