Fengpei Yuan, Amir Sadovnik, Ran Zhang, Devin Casenhiser, Eun Jin Paek, Xiaopeng Zhao
{"title":"A simulated experiment to explore robotic dialogue strategies for people with dementia.","authors":"Fengpei Yuan, Amir Sadovnik, Ran Zhang, Devin Casenhiser, Eun Jin Paek, Xiaopeng Zhao","doi":"10.1177/20556683221105768","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Persons with dementia (PwDs) often show symptoms of repetitive questioning, which brings great burdens on caregivers. Conversational robots hold promise of helping cope with PwDs' repetitive behavior. This paper develops an adaptive conversation strategy to answer PwDs' repetitive questions, follow up with new questions to distract PwDs from repetitive behavior, and stimulate their conversation and cognition.</p><p><strong>Methods: </strong>We propose a general reinforcement learning model to interact with PwDs with repetitive questioning. Q-learning is exploited to learn adaptive conversation strategy (from the perspectives of rate and difficulty level of follow-up questions) for four simulated PwDs. A demonstration is presented using a humanoid robot.</p><p><strong>Results: </strong>The designed Q-learning model performs better than random action selection model. The RL-based conversation strategy is adaptive to PwDs with different cognitive capabilities and engagement levels. In the demonstration, the robot can answer a user's repetitive questions and further come up with a follow-up question to engage the user in continuous conversations.</p><p><strong>Conclusions: </strong>The designed Q-learning model demonstrates noteworthy effectiveness in adaptive action selection. This may provide some insights towards developing conversational social robots to cope with repetitive questioning by PwDs and increase their quality of life.</p>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/03/ef/10.1177_20556683221105768.PMC9174559.pdf","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/20556683221105768","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 4
Abstract
Introduction: Persons with dementia (PwDs) often show symptoms of repetitive questioning, which brings great burdens on caregivers. Conversational robots hold promise of helping cope with PwDs' repetitive behavior. This paper develops an adaptive conversation strategy to answer PwDs' repetitive questions, follow up with new questions to distract PwDs from repetitive behavior, and stimulate their conversation and cognition.
Methods: We propose a general reinforcement learning model to interact with PwDs with repetitive questioning. Q-learning is exploited to learn adaptive conversation strategy (from the perspectives of rate and difficulty level of follow-up questions) for four simulated PwDs. A demonstration is presented using a humanoid robot.
Results: The designed Q-learning model performs better than random action selection model. The RL-based conversation strategy is adaptive to PwDs with different cognitive capabilities and engagement levels. In the demonstration, the robot can answer a user's repetitive questions and further come up with a follow-up question to engage the user in continuous conversations.
Conclusions: The designed Q-learning model demonstrates noteworthy effectiveness in adaptive action selection. This may provide some insights towards developing conversational social robots to cope with repetitive questioning by PwDs and increase their quality of life.