Pub Date : 2017-09-01DOI: 10.1109/COMPANION.2017.8287078
Lihua Cai, Congyu Wu, K. Meimandi, M. Gerber
As smartphones become increasingly intimate and continuous companions, many opportunities are arising in human behavior sensing, modeling, and coaching. This position paper explores opportunities and challenges for mobile-based deployment of behavior change interventions. We suggest the adoption and extension of reinforcement learning for addressing these challenges, and we identify several key areas of future research that, on the basis of prior results, appear ripe for extending the benefits of reinforcement learning to human behavior change. These areas include stronger grounding of states in theories of human behavior, RL agent adaptation and decomposition, cooperative reinforcement learning, and in situ evaluation.
{"title":"Adaptive mobile behavior change intervention using reinforcement learning","authors":"Lihua Cai, Congyu Wu, K. Meimandi, M. Gerber","doi":"10.1109/COMPANION.2017.8287078","DOIUrl":"https://doi.org/10.1109/COMPANION.2017.8287078","url":null,"abstract":"As smartphones become increasingly intimate and continuous companions, many opportunities are arising in human behavior sensing, modeling, and coaching. This position paper explores opportunities and challenges for mobile-based deployment of behavior change interventions. We suggest the adoption and extension of reinforcement learning for addressing these challenges, and we identify several key areas of future research that, on the basis of prior results, appear ripe for extending the benefits of reinforcement learning to human behavior change. These areas include stronger grounding of states in theories of human behavior, RL agent adaptation and decomposition, cooperative reinforcement learning, and in situ evaluation.","PeriodicalId":132735,"journal":{"name":"2017 International Conference on Companion Technology (ICCT)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128199125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2017-09-01DOI: 10.1109/ICCT42709.2017.9151909
Christoph Strauch, Jan Ehlers, A. Huckauf
Affective interaction is assumed to advance interacting among humans and technical systems. Using pupil size as affective information, we review hitherto presented approaches for pupil-based interaction. Three approaches base on different mechanisms; pupil size changes produced by covertly attending towards a set of stimuli changing in brightness, changes in pupil diameter actively produced by the user, and those occurring automatically as a by-product of cognitive processes. While the first two approaches can produce effective but relatively slow target selections, the latter might allow faster selections, but has to be combined with other selection mechanisms. Reanalyzing two data sets obtained with this most promising approach of using cognitive processes as basis for pupil-based target selection, it turns out that despite of differences in task and brightness, signal dynamics are characterized by comparable latencies and effect sizes. These may lay the foundation for future investigations into pupil diameter changes accompanying object selection in human-robot interaction. Finally, we suggest further investigations into the subject, determining when and why pupil diameter changes accompany object selections.
{"title":"Pupil-assisted target selection (PATS): State of the art and future prospects","authors":"Christoph Strauch, Jan Ehlers, A. Huckauf","doi":"10.1109/ICCT42709.2017.9151909","DOIUrl":"https://doi.org/10.1109/ICCT42709.2017.9151909","url":null,"abstract":"Affective interaction is assumed to advance interacting among humans and technical systems. Using pupil size as affective information, we review hitherto presented approaches for pupil-based interaction. Three approaches base on different mechanisms; pupil size changes produced by covertly attending towards a set of stimuli changing in brightness, changes in pupil diameter actively produced by the user, and those occurring automatically as a by-product of cognitive processes. While the first two approaches can produce effective but relatively slow target selections, the latter might allow faster selections, but has to be combined with other selection mechanisms. Reanalyzing two data sets obtained with this most promising approach of using cognitive processes as basis for pupil-based target selection, it turns out that despite of differences in task and brightness, signal dynamics are characterized by comparable latencies and effect sizes. These may lay the foundation for future investigations into pupil diameter changes accompanying object selection in human-robot interaction. Finally, we suggest further investigations into the subject, determining when and why pupil diameter changes accompany object selections.","PeriodicalId":132735,"journal":{"name":"2017 International Conference on Companion Technology (ICCT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127133005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2017-09-01DOI: 10.1109/COMPANION.2017.8287075
Johannes Schwerdt, Michael Kotzyba, A. Nürnberger
Providing an individual user support regarding the current search activity is crucial for adaptive information retrieval systems but requires a reliable identification of user activities. Such a reliable and robust classification would also help to characterize and analyze complex search behavior of users and enable us to build more advanced information-companion technologies that can support users individually in retrieving and organizing information. In order to develop classification models, in this paper we investigate the validity of interaction features and model structures. We provide a methodology for user models utilizing data from interaction logs and eye tracking to classify the two search activities exploratory search and multitasking search. To identify adequate models and features we use a statistical framework that enables us to select relevant parameters that are useful to understand the current search activity while holding discriminative properties between the activities. The model achieved a classification rate of 89.32%.
{"title":"Inferring user's search activity using interaction logs and gaze data","authors":"Johannes Schwerdt, Michael Kotzyba, A. Nürnberger","doi":"10.1109/COMPANION.2017.8287075","DOIUrl":"https://doi.org/10.1109/COMPANION.2017.8287075","url":null,"abstract":"Providing an individual user support regarding the current search activity is crucial for adaptive information retrieval systems but requires a reliable identification of user activities. Such a reliable and robust classification would also help to characterize and analyze complex search behavior of users and enable us to build more advanced information-companion technologies that can support users individually in retrieving and organizing information. In order to develop classification models, in this paper we investigate the validity of interaction features and model structures. We provide a methodology for user models utilizing data from interaction logs and eye tracking to classify the two search activities exploratory search and multitasking search. To identify adequate models and features we use a statistical framework that enables us to select relevant parameters that are useful to understand the current search activity while holding discriminative properties between the activities. The model achieved a classification rate of 89.32%.","PeriodicalId":132735,"journal":{"name":"2017 International Conference on Companion Technology (ICCT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131311870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2017-09-01DOI: 10.1109/ICCT42709.2017.9151910
Steffen Walter, Matthias Haase, Andreas Oschlies-Strobel, L. Jerg-Bretzke, H. Traue, Kerstin Limbrecht
In the following proceeding, we draw on methods developed for behavioral therapy, but it should be emphasized that the PCS can also be adapted and used for any other policy procedures. Broadly speaking, therapeutic work can be divided into three blocks: a) the initiation of treatment, including the establishment of the working relationship, diagnosis, and the motivation of the patient, b) the treatment of the mental disorder, including the development of a disorder model, harnessing the motivation to change, and the implementation of interventions, and c) the end of therapy, including stabilization of newly learned behavior and relapse prevention.
{"title":"Possible applications of companion systems in psychotherapy - perspectives on a new technology","authors":"Steffen Walter, Matthias Haase, Andreas Oschlies-Strobel, L. Jerg-Bretzke, H. Traue, Kerstin Limbrecht","doi":"10.1109/ICCT42709.2017.9151910","DOIUrl":"https://doi.org/10.1109/ICCT42709.2017.9151910","url":null,"abstract":"In the following proceeding, we draw on methods developed for behavioral therapy, but it should be emphasized that the PCS can also be adapted and used for any other policy procedures. Broadly speaking, therapeutic work can be divided into three blocks: a) the initiation of treatment, including the establishment of the working relationship, diagnosis, and the motivation of the patient, b) the treatment of the mental disorder, including the development of a disorder model, harnessing the motivation to change, and the implementation of interventions, and c) the end of therapy, including stabilization of newly learned behavior and relapse prevention.","PeriodicalId":132735,"journal":{"name":"2017 International Conference on Companion Technology (ICCT)","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129646807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1900-01-01DOI: 10.1109/COMPANION.2017.8287074
A. Schulz, M. L. Woldeit, Marcel Brosch, F. Ohl
Companion systems interact with users via flexible and goal-directed dialogs. During dialogs both user and companion system identify and communicate their goals iteratively. In that sense, user and companion system can be conceptualized as communication partners, equipped with a processing scheme producing actions as outputs in consequence of (1) inputs from the other communication partner and (2) internally represented goals. A quite general core competence of communication partners is the capability for strategy change, defined as the modification of action planning under the boundary condition of maintaining a constant goal. Interestingly, the biological mechanism for this capability are largely unknown. Here we describe a serial reversal behavioral task with negative reinforcement that employs an animal model for strategy change. Animals did not develop an optimal solution but behavioral strategies to minimize negative reinforcement regardless of changing environment. This form of flexible strategy adaptation is of potential importance for companion systems.
{"title":"Neurobiological fundamentals of strategy change — A core competence of a companion system","authors":"A. Schulz, M. L. Woldeit, Marcel Brosch, F. Ohl","doi":"10.1109/COMPANION.2017.8287074","DOIUrl":"https://doi.org/10.1109/COMPANION.2017.8287074","url":null,"abstract":"Companion systems interact with users via flexible and goal-directed dialogs. During dialogs both user and companion system identify and communicate their goals iteratively. In that sense, user and companion system can be conceptualized as communication partners, equipped with a processing scheme producing actions as outputs in consequence of (1) inputs from the other communication partner and (2) internally represented goals. A quite general core competence of communication partners is the capability for strategy change, defined as the modification of action planning under the boundary condition of maintaining a constant goal. Interestingly, the biological mechanism for this capability are largely unknown. Here we describe a serial reversal behavioral task with negative reinforcement that employs an animal model for strategy change. Animals did not develop an optimal solution but behavioral strategies to minimize negative reinforcement regardless of changing environment. This form of flexible strategy adaptation is of potential importance for companion systems.","PeriodicalId":132735,"journal":{"name":"2017 International Conference on Companion Technology (ICCT)","volume":"63 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125618840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：