A deep reinforcement learning control method for multi-zone precooling in commercial buildings

Abstract

In commercial buildings, implementing precooling measures before office hours in summer can effectively meet the thermal comfort needs of employees. However, in multi-zone environments, differences in the cooling rates between regions often exacerbate the heat transfer interference between zones, increasing the complexity of the precooling system and leading to energy waste with limited cooling capacity. To overcome these challenges, we have developed a novel multi-zone precooling control method, which integrates deep reinforcement learning (DRL) to optimize the heat transfer process by adjusting the Air Handling Units (AHUs) valve openings, thus achieving uniform precooling across the building. Comparisons with traditional precooling control methods demonstrate the effectiveness of the proposed method. The results show that, under conventional conditions, compared with the rule-based control (RBC) and proportional integral derivative (PID) methods, the precooling time is reduced by 11.4% and 5.8%, respectively, the complexity of heat transfer is reduced by 77.6% and 64.1%, and energy consumption is reduced by 14.5% and 9.3%. In addition, the study analyzes the influence of environmental parameters on precooling optimization. The findings indicate that weather conditions have the most substantial impact on short-term precooling performance, followed by building thermal performance and cooling conditions.