Optimization Control of HVAC System and Building Energy Management Based on Machine Learning

This paper discusses the optimal control and building energy management of building heating, ventilation and air conditioning (HVAC) systems based on deep Q networks (DQNs). Traditional control strategies often have difficulty adapting to the dynamic changes of the environment and the personalized needs of users. This paper studies a DQN algorithm based on reinforcement learning to learn the optimal control strategy through interaction with the environment to achieve the best balance between energy saving and comfort. First, the HVAC system is modeled as a Markov decision process (MDP), including three elements: state, action, and reward. Then, a DQN model is designed and implemented to improve the efficiency and stability of learning through experience replay and target network. Experience replay reduces the correlation between samples by randomly sampling past experience, while the target network reduces the oscillation during training by stabilizing the estimation of Q values. Finally, the application effect of DQN in HVAC system control is verified by verification. The specific data of the experimental results show that DQN performs well in energy efficiency. In terms of response speed, the response time of DQN to indoor and outdoor temperature fluctuations is 64.4 seconds, which is significantly faster than other traditional methods. In the adaptability score, DQN's highest adaptability score can reach 91.1 points. The DQN algorithm has significant advantages in HVAC system optimization control and building energy consumption management, and can achieve lower energy consumption and higher control accuracy.

Authors

Institutions

Publication Details

Published
2025-03-07
DOI
https://doi.org/10.1109/csnt64827.2025.10967665
Citations
1
Primary Topic
Advanced Sensor and Control Systems
Type
article
Field-Weighted Citation Impact
1.21
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimization Control of HVAC System and Building Energy Management Based on Machine Learning

Gang Feng
1 citations
Advanced Sensor and Control Systems
1.21
article

Optimization Control of HVAC System and Building Energy Management Based on Machine Learning

Gang Feng
article en
1 citations

Abstract

This paper discusses the optimal control and building energy management of building heating, ventilation and air conditioning (HVAC) systems based on deep Q networks (DQNs). Traditional control strategies often have difficulty adapting to the dynamic changes of the environment and the personalized needs of users. This paper studies a DQN algorithm based on reinforcement learning to learn the optimal control strategy through interaction with the environment to achieve the best balance between energy saving and comfort. First, the HVAC system is modeled as a Markov decision process (MDP), including three elements: state, action, and reward. Then, a DQN model is designed and implemented to improve the efficiency and stability of learning through experience replay and target network. Experience replay reduces the correlation between samples by randomly sampling past experience, while the target network reduces the oscillation during training by stabilizing the estimation of Q values. Finally, the application effect of DQN in HVAC system control is verified by verification. The specific data of the experimental results show that DQN performs well in energy efficiency. In terms of response speed, the response time of DQN to indoor and outdoor temperature fluctuations is 64.4 seconds, which is significantly faster than other traditional methods. In the adaptability score, DQN's highest adaptability score can reach 91.1 points. The DQN algorithm has significant advantages in HVAC system optimization control and building energy consumption management, and can achieve lower energy consumption and higher control accuracy.

Daqing Oilfield General Hospital (CN)
Affordable and clean energy
Openalex Percentile: Top 22%
Advanced Sensor and Control Systems
1.21
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Optimization Control of HVAC System and Building Energy Management Based on Machine Learning — Gang Feng · (2025) | TGRS Research Map | TGRS