Comparing clustering approaches for smart meter time series: Investigating the influence of dataset properties on performance

The widespread adoption of smart meters for monitoring energy consumption has generated vast quantities of high-resolution time series data which remain underutilised. While clustering has emerged as a fundamental tool for mining smart meter time series (SMTS) data, selecting appropriate clustering methods remains challenging despite numerous comparative studies. These studies often rely on problematic methodologies and consider a limited scope of methods, frequently overlooking compelling methods from the broader time series clustering literature. Consequently, they struggle to provide dependable guidance for practitioners designing their own clustering approaches. This paper presents a comprehensive comparative framework for SMTS clustering methods using expert-informed synthetic datasets that emphasise peak consumption behaviours as fundamental cluster concepts. Using a phased methodology, we first evaluated 31 distance measures and 8 representation methods using leave-one-out classification, then examined the better-suited methods in combination with 11 clustering algorithms. We further assessed the robustness of these combinations to systematic changes in key dataset properties that affect clustering performance on real-world datasets, including cluster balance, noise, and the presence of outliers. Our results revealed that methods accommodating local temporal shifts while maintaining amplitude sensitivity, particularly Dynamic Time Warping and k -sliding distance, consistently outperformed traditional approaches. Among other key findings, we identified that when combined with k -medoids or hierarchical clustering using Ward’s linkage, these methods exhibited consistent robustness across varying dataset characteristics without careful parameter tuning. These and other findings inform actionable recommendations for practitioners, and validation with real-world data demonstrates that our findings translate effectively to practical SMTS clustering tasks. Finally, our datasets and code are publicly available to support the development, evaluation, and comparison of both novel and overlooked methods. • Benchmark study of 31 distances, 8 representations, and 11 clustering algorithms. • Expert-curated synthetic residential load profiles capturing fundamental patterns. • Systematic evaluation of method robustness across five key dataset properties. • Dynamic Time Warping and k -sliding distance demonstrate robust performance. • Key findings from synthetic data validated with labelled real-world data.

Authors

Institutions

Publication Details

Journal
Applied Energy
Published
2025-04-18
DOI
https://doi.org/10.1016/j.apenergy.2025.125811
Citations
6
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
8.91
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparing clustering approaches for smart meter time series: Investigating the influence of dataset properties on performance

Ricardo J. G. B. Campello, Lachlan O’Neil, Luke W. Yerbury, G. C. Livingston et al.
6 citations
Applied Energy
Time Series Analysis and Forecasting
8.91
article

Comparing clustering approaches for smart meter time series: Investigating the influence of dataset properties on performance

Ricardo J. G. B. Campello, Lachlan O’Neil, Luke W. Yerbury, G. C. Livingston, Mark Goldsworthy
article en
6 citations

Abstract

The widespread adoption of smart meters for monitoring energy consumption has generated vast quantities of high-resolution time series data which remain underutilised. While clustering has emerged as a fundamental tool for mining smart meter time series (SMTS) data, selecting appropriate clustering methods remains challenging despite numerous comparative studies. These studies often rely on problematic methodologies and consider a limited scope of methods, frequently overlooking compelling methods from the broader time series clustering literature. Consequently, they struggle to provide dependable guidance for practitioners designing their own clustering approaches. This paper presents a comprehensive comparative framework for SMTS clustering methods using expert-informed synthetic datasets that emphasise peak consumption behaviours as fundamental cluster concepts. Using a phased methodology, we first evaluated 31 distance measures and 8 representation methods using leave-one-out classification, then examined the better-suited methods in combination with 11 clustering algorithms. We further assessed the robustness of these combinations to systematic changes in key dataset properties that affect clustering performance on real-world datasets, including cluster balance, noise, and the presence of outliers. Our results revealed that methods accommodating local temporal shifts while maintaining amplitude sensitivity, particularly Dynamic Time Warping and k -sliding distance, consistently outperformed traditional approaches. Among other key findings, we identified that when combined with k -medoids or hierarchical clustering using Ward’s linkage, these methods exhibited consistent robustness across varying dataset characteristics without careful parameter tuning. These and other findings inform actionable recommendations for practitioners, and validation with real-world data demonstrates that our findings translate effectively to practical SMTS clustering tasks. Finally, our datasets and code are publicly available to support the development, evaluation, and comparison of both novel and overlooked methods. • Benchmark study of 31 distances, 8 representations, and 11 clustering algorithms. • Expert-curated synthetic residential load profiles capturing fundamental patterns. • Systematic evaluation of method robustness across five key dataset properties. • Dynamic Time Warping and k -sliding distance demonstrate robust performance. • Key findings from synthetic data validated with labelled real-world data.

Applied EnergyVol. 391
Commonwealth Scientific and Industrial Research Organisation (AU), University of Southern Denmark (DK), Presbyterian Theological College (AU), Department of Physics, Mathematics and Informatics (BY), University of Newcastle Australia (AU)
Openalex Percentile: Top 2%
Time Series Analysis and Forecasting
8.91
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.