Effect of data imbalance in Machine Learning Models for building energy performance prediction

One of the promising methods that has recently gained attention for investigating building energy performance is utilisation of AI data-driven approaches, such as machine learning (ML) models. These methods, despite their advantages over physics-based models—such as faster prediction time and simplicity of application to case study buildings—have challenges during the model development stage, including the need for large datasets, potential overfitting, and the difficulty of capturing complex physical interactions within the building energy systems. As a result, this research aims to address data imbalance issue in developing a ML model for predicting the Energy Performance Certificate (EPC) rating of residential buildings. On this context, two resampling methods, including SMOTE (Synthetic Minority Over-sampling Technique) and SMOTE-Tomek were applied to XGBoost ML model to improve its accuracy. The results of this study showed that although applying data resampling methods slightly reduced the model’s overall accuracy score (by less than 2%), it significantly enhanced the model's ability to predict minority classes. Specifically, the model's performance in predicting labels B, F, and E improved by more than 7%, 10%, and 6% points, respectively. This highlights how class imbalance in EPC labels can distort evaluation metrics like accuracy, potentially masking poor performance in minority classes. Addressing this imbalance is crucial for effectively integrating ML models into more advanced AI tools and smart systems for comprehensive building performance analysis.

Publication Details

Journal
UWL Repository (University of West London)
Published
2024-12-26
Citations
1
Primary Topic
Building Energy and Comfort Optimization
Type
article
Field-Weighted Citation Impact
0.27
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Effect of data imbalance in Machine Learning Models for building energy performance prediction

1 citations
UWL Repository (University of West London)
Building Energy and Comfort Optimization
0.27
article

Effect of data imbalance in Machine Learning Models for building energy performance prediction

article en
1 citations

Abstract

One of the promising methods that has recently gained attention for investigating building energy performance is utilisation of AI data-driven approaches, such as machine learning (ML) models. These methods, despite their advantages over physics-based models—such as faster prediction time and simplicity of application to case study buildings—have challenges during the model development stage, including the need for large datasets, potential overfitting, and the difficulty of capturing complex physical interactions within the building energy systems. As a result, this research aims to address data imbalance issue in developing a ML model for predicting the Energy Performance Certificate (EPC) rating of residential buildings. On this context, two resampling methods, including SMOTE (Synthetic Minority Over-sampling Technique) and SMOTE-Tomek were applied to XGBoost ML model to improve its accuracy. The results of this study showed that although applying data resampling methods slightly reduced the model’s overall accuracy score (by less than 2%), it significantly enhanced the model's ability to predict minority classes. Specifically, the model's performance in predicting labels B, F, and E improved by more than 7%, 10%, and 6% points, respectively. This highlights how class imbalance in EPC labels can distort evaluation metrics like accuracy, potentially masking poor performance in minority classes. Addressing this imbalance is crucial for effectively integrating ML models into more advanced AI tools and smart systems for comprehensive building performance analysis.

UWL Repository (University of West London)
Affordable and clean energy
Openalex Percentile: Top 39%
Building Energy and Comfort Optimization
0.27
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Effect of data imbalance in Machine Learning Models for building energy performance prediction · UWL Repository (University of West London) (2024) | TGRS Research Map | TGRS