Temporally Chained Equations: An Interpretable Missing Data Imputation Approach for Smart Meters with Low Data Requirements

Smart grids enable real-time monitoring and optimization of energy generation, transmission, and consumption. Ensuring the integrity of data collected by smart meters is crucial for grid operation and data-driven decision-making, but missing data due to communication failures or device malfunctions can compromise data reliability. Recent studies have proposed deep learning techniques to impute missing points; however, these models require large training data, are computationally expensive, and struggle to scale to a large consumer base. Moreover, the interpretability of the imputation is also a concern, hindering trust and acceptance. To address these issues, this paper proposes Temporally Chained Equations (TCE), an interpretable, computationally lightweight missing data imputation approach for smart meters with low data requirements. TCE forms chained equations across the temporal axis using lead and lag features and imputes missing points in a manner coherent with neighboring and seasonally correlated points. Local normalization reduces the impact of outliers, and an iterative process refines the estimates until convergence. Experiments on a real-world dataset show that TCE outperforms related techniques, particularly for random missing points or short sequences of continuous missing points.

Authors

Institutions

Publication Details

Published
2024-11-03
DOI
https://doi.org/10.1109/iecon55916.2024.10905430
Primary Topic
Smart Grid Energy Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Temporally Chained Equations: An Interpretable Missing Data Imputation Approach for Smart Meters with Low Data Requirements

Katarina Grolinger, Madhushan Buwaneswaran
Smart Grid Energy Management
article

Temporally Chained Equations: An Interpretable Missing Data Imputation Approach for Smart Meters with Low Data Requirements

Katarina Grolinger, Madhushan Buwaneswaran
article en

Abstract

Smart grids enable real-time monitoring and optimization of energy generation, transmission, and consumption. Ensuring the integrity of data collected by smart meters is crucial for grid operation and data-driven decision-making, but missing data due to communication failures or device malfunctions can compromise data reliability. Recent studies have proposed deep learning techniques to impute missing points; however, these models require large training data, are computationally expensive, and struggle to scale to a large consumer base. Moreover, the interpretability of the imputation is also a concern, hindering trust and acceptance. To address these issues, this paper proposes Temporally Chained Equations (TCE), an interpretable, computationally lightweight missing data imputation approach for smart meters with low data requirements. TCE forms chained equations across the temporal axis using lead and lag features and imputes missing points in a manner coherent with neighboring and seasonally correlated points. Local normalization reduces the impact of outliers, and an iterative process refines the estimates until convergence. Experiments on a real-world dataset show that TCE outperforms related techniques, particularly for random missing points or short sequences of continuous missing points.

Western University (CA)
Openalex Percentile: Top 74%
Smart Grid Energy Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Temporally Chained Equations: An Interpretable Missing Data Imputation Approach for Smart Meters with Low Data Requirements — Katarina Grolinger, Madhushan Buwaneswaran · (2024) | TGRS Research Map | TGRS