F. Cicirelli, A. Guerrieri, C. Mastroianni, G. Spezzano, Andrea Vinci
{"title":"Thermal comfort management leveraging deep reinforcement learning and human-in-the-loop","authors":"F. Cicirelli, A. Guerrieri, C. Mastroianni, G. Spezzano, Andrea Vinci","doi":"10.1109/ICHMS49158.2020.9209555","DOIUrl":null,"url":null,"abstract":"The design and implementation of effective systems devoted to the thermal comfort management in a building is a challenging task because they require to consider both objective and subjective parameters, tied for instance to human profile and behavior. This paper presents a novel approach for the management of thermal comfort in buildings by leveraging cognitive technologies, namely the Deep Reinforcement Learning paradigm. The approach is able to learn how to automatically control the HVAC system and improve people’s comfort. The learning process is driven by a reward that includes and combines an environmental reward, related to objective environmental parameters, with a human reward, related to subjective human perceptions that are implicitly inferred by the way people interact with the HVAC system. Simulation results aim to assess the impact of the two types of reward on the achieved comfort level.","PeriodicalId":132917,"journal":{"name":"2020 IEEE International Conference on Human-Machine Systems (ICHMS)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE International Conference on Human-Machine Systems (ICHMS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICHMS49158.2020.9209555","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3
Abstract
The design and implementation of effective systems devoted to the thermal comfort management in a building is a challenging task because they require to consider both objective and subjective parameters, tied for instance to human profile and behavior. This paper presents a novel approach for the management of thermal comfort in buildings by leveraging cognitive technologies, namely the Deep Reinforcement Learning paradigm. The approach is able to learn how to automatically control the HVAC system and improve people’s comfort. The learning process is driven by a reward that includes and combines an environmental reward, related to objective environmental parameters, with a human reward, related to subjective human perceptions that are implicitly inferred by the way people interact with the HVAC system. Simulation results aim to assess the impact of the two types of reward on the achieved comfort level.