Lehel Dénes-Fazakas, M. Siket, László Szilágyi, G. Eigner, L. Kovács
{"title":"应用强化学习控制血糖水平的奖励函数研究","authors":"Lehel Dénes-Fazakas, M. Siket, László Szilágyi, G. Eigner, L. Kovács","doi":"10.1109/SACI58269.2023.10158621","DOIUrl":null,"url":null,"abstract":"In the present study, we investigated the effect of different reward functions in insulin regulation using reinforcement learning. An artificial pancreas system is able to deliver insulin into the body in an automated way. The control algorithm of an automated insulin delivery system is a key player in achieving personalized therapy. Neural networks provide an approach to customize insulin administration by learning the patient’s habits and administering insulin accordingly. Therefore, we conducted experiments with neural networks based on reinforcement learning. Our goal was to find a neural network-based model and reward function that could learn the patient’s behavior and administers insulin with the best time in ranges. We evaluated the method on simulated virtual patients when sensor noise occurs. The results show that the bump functions were the most efficient in providing acceptable time in ranges.","PeriodicalId":339156,"journal":{"name":"2023 IEEE 17th International Symposium on Applied Computational Intelligence and Informatics (SACI)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Investigation of reward functions for controlling blood glucose level using reinforcement learning\",\"authors\":\"Lehel Dénes-Fazakas, M. Siket, László Szilágyi, G. Eigner, L. Kovács\",\"doi\":\"10.1109/SACI58269.2023.10158621\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the present study, we investigated the effect of different reward functions in insulin regulation using reinforcement learning. An artificial pancreas system is able to deliver insulin into the body in an automated way. The control algorithm of an automated insulin delivery system is a key player in achieving personalized therapy. Neural networks provide an approach to customize insulin administration by learning the patient’s habits and administering insulin accordingly. Therefore, we conducted experiments with neural networks based on reinforcement learning. Our goal was to find a neural network-based model and reward function that could learn the patient’s behavior and administers insulin with the best time in ranges. We evaluated the method on simulated virtual patients when sensor noise occurs. The results show that the bump functions were the most efficient in providing acceptable time in ranges.\",\"PeriodicalId\":339156,\"journal\":{\"name\":\"2023 IEEE 17th International Symposium on Applied Computational Intelligence and Informatics (SACI)\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE 17th International Symposium on Applied Computational Intelligence and Informatics (SACI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SACI58269.2023.10158621\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE 17th International Symposium on Applied Computational Intelligence and Informatics (SACI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SACI58269.2023.10158621","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Investigation of reward functions for controlling blood glucose level using reinforcement learning
In the present study, we investigated the effect of different reward functions in insulin regulation using reinforcement learning. An artificial pancreas system is able to deliver insulin into the body in an automated way. The control algorithm of an automated insulin delivery system is a key player in achieving personalized therapy. Neural networks provide an approach to customize insulin administration by learning the patient’s habits and administering insulin accordingly. Therefore, we conducted experiments with neural networks based on reinforcement learning. Our goal was to find a neural network-based model and reward function that could learn the patient’s behavior and administers insulin with the best time in ranges. We evaluated the method on simulated virtual patients when sensor noise occurs. The results show that the bump functions were the most efficient in providing acceptable time in ranges.