A benchmarking framework for energy management systems with commercial hardware models

Energy Management Systems (EMS) for buildings are pivotal in leveraging flexibility from sector coupling in future power systems. Currently, most EMS are designed and evaluated using non-standardized and incompatible simulation models built within the specific EMS development cycle. Such evaluation techniques make it difficult to compare different EMS solutions according to well-defined and universal performance indicators. Therefore, open-access benchmark models of realistic building energy systems would be beneficial for wider research community. This article introduces the ProHMo benchmarking framework which provides experimentally validated commercial heating and cooling equipment models in various building energy system configurations. The building energy system models are available as openly accessible Functional Mock-Up Units (FMU) to allow for toolchain-independent benchmarking of EMS. The framework includes a Python code template that enables easy integration with different EMS interfaces. In a case study, we show the potential of the benchmarking framework by comparing a rule-based, optimization-based, and reinforcement learning-based EMS. The results show that the optimization-based EMS with perfect foresight achieves the lowest costs. Although the reinforcement learning-based EMS performs slightly poorer, it operates independently of forecasts, which makes it attractive for practical applications. The ProHMo benchmarking framework is designed to equip researchers with a robust framework for developing, evaluating, and comparing different EMS, particularly those focused on optimization and data-driven control methods.