Performance Evaluation of Machine Learning Models for Predicting Energy Consumption and Occupant Dissatisfaction in Buildings

This study evaluates the performance of 15 machine learning models for predicting energy consumption (30–100 kWh/m2·year) and occupant dissatisfaction (Percentage of Dissatisfied, PPD: 6–90%), key metrics for optimizing building performance. Ten evaluation metrics, including Mean Absolute Error (MAE, average prediction error), Root Mean Squared Error (RMSE, penalizing large errors), and the coefficient of determination (R2, variance explained by the model), are used. XGBoost achieves the highest accuracy, with an energy MAE of 1.55 kWh/m2·year and a PPD MAE of 3.14%, alongside R2 values of 0.99 and 0.97, respectively. While these metrics highlight XGBoost’s superiority, its margin of improvement over LightGBM (energy MAE: 2.35 kWh/m2·year, PPD MAE: 3.89%) is context-dependent, suggesting its application in high-precision scenarios. ANN excelled at PPD predictions, achieving the lowest MAE (1.55%) and Mean Absolute Percentage Error (MAPE: 4.97%), demonstrating its ability to model complex nonlinear relationships. This nonlinear modeling advantage contrasts with LightGBM’s balance of speed and accuracy, making it suitable for computationally constrained tasks. In contrast, traditional models like linear regression and KNN exhibit high errors (e.g., energy MAE: 17.56 kWh/m2·year, PPD MAE: 17.89%), underscoring their limitations with respect to capturing the complexities of building performance datasets. The results indicate that advanced methods like XGBoost and ANN are particularly effective owing to their ability to model intricate relationships and manage high-dimensional data. Future research should validate these findings with diverse real-world datasets, including those representing varying building types and climates. Hybrid models combining the interpretability of linear methods with the precision of ensemble or neural models should be explored. Additionally, integrating these machine learning techniques with digital twin platforms could address real-time optimization challenges, including dynamic occupant behavior and time-dependent energy consumption.

Authors

Institutions

Publication Details

Journal
Buildings
Published
2024-12-26
DOI
https://doi.org/10.3390/buildings15010039
Citations
32
Primary Topic
Building Energy and Comfort Optimization
Type
article
Field-Weighted Citation Impact
8.49

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance Evaluation of Machine Learning Models for Predicting Energy Consumption and Occupant Dissatisfaction in Buildings

Silvia Mazzetto, Haidar Hosamo
32 citations
Buildings
Building Energy and Comfort Optimization
8.49
article

Performance Evaluation of Machine Learning Models for Predicting Energy Consumption and Occupant Dissatisfaction in Buildings

Silvia Mazzetto, Haidar Hosamo
article en
32 citations

Abstract

This study evaluates the performance of 15 machine learning models for predicting energy consumption (30–100 kWh/m2·year) and occupant dissatisfaction (Percentage of Dissatisfied, PPD: 6–90%), key metrics for optimizing building performance. Ten evaluation metrics, including Mean Absolute Error (MAE, average prediction error), Root Mean Squared Error (RMSE, penalizing large errors), and the coefficient of determination (R2, variance explained by the model), are used. XGBoost achieves the highest accuracy, with an energy MAE of 1.55 kWh/m2·year and a PPD MAE of 3.14%, alongside R2 values of 0.99 and 0.97, respectively. While these metrics highlight XGBoost’s superiority, its margin of improvement over LightGBM (energy MAE: 2.35 kWh/m2·year, PPD MAE: 3.89%) is context-dependent, suggesting its application in high-precision scenarios. ANN excelled at PPD predictions, achieving the lowest MAE (1.55%) and Mean Absolute Percentage Error (MAPE: 4.97%), demonstrating its ability to model complex nonlinear relationships. This nonlinear modeling advantage contrasts with LightGBM’s balance of speed and accuracy, making it suitable for computationally constrained tasks. In contrast, traditional models like linear regression and KNN exhibit high errors (e.g., energy MAE: 17.56 kWh/m2·year, PPD MAE: 17.89%), underscoring their limitations with respect to capturing the complexities of building performance datasets. The results indicate that advanced methods like XGBoost and ANN are particularly effective owing to their ability to model intricate relationships and manage high-dimensional data. Future research should validate these findings with diverse real-world datasets, including those representing varying building types and climates. Hybrid models combining the interpretability of linear methods with the precision of ensemble or neural models should be explored. Additionally, integrating these machine learning techniques with digital twin platforms could address real-time optimization challenges, including dynamic occupant behavior and time-dependent energy consumption.

BuildingsVol. 15(1)
Prince Sultan University (SA), OsloMet – Oslo Metropolitan University (NO)
Prince Sultan University
Affordable and clean energy
Openalex Percentile: Top 2%
Building Energy and Comfort Optimization
8.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.