{"title":"Leveraging AI-Generated Emotional Self-Voice to Nudge People towards their Ideal Selves","authors":"Cathy Mengying Fang, Phoebe Chua, Samantha Chan, Joanne Leong, Andria Bao, Pattie Maes","doi":"arxiv-2409.11531","DOIUrl":null,"url":null,"abstract":"Emotions, shaped by past experiences, significantly influence decision-making\nand goal pursuit. Traditional cognitive-behavioral techniques for personal\ndevelopment rely on mental imagery to envision ideal selves, but may be less\neffective for individuals who struggle with visualization. This paper\nintroduces Emotional Self-Voice (ESV), a novel system combining emotionally\nexpressive language models and voice cloning technologies to render customized\nresponses in the user's own voice. We investigate the potential of ESV to nudge\nindividuals towards their ideal selves in a study with 60 participants. Across\nall three conditions (ESV, text-only, and mental imagination), we observed an\nincrease in resilience, confidence, motivation, and goal commitment, but the\nESV condition was perceived as uniquely engaging and personalized. We discuss\nthe implications of designing generated self-voice systems as a personalized\nbehavioral intervention for different scenarios.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"116 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Human-Computer Interaction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.11531","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Emotions, shaped by past experiences, significantly influence decision-making
and goal pursuit. Traditional cognitive-behavioral techniques for personal
development rely on mental imagery to envision ideal selves, but may be less
effective for individuals who struggle with visualization. This paper
introduces Emotional Self-Voice (ESV), a novel system combining emotionally
expressive language models and voice cloning technologies to render customized
responses in the user's own voice. We investigate the potential of ESV to nudge
individuals towards their ideal selves in a study with 60 participants. Across
all three conditions (ESV, text-only, and mental imagination), we observed an
increase in resilience, confidence, motivation, and goal commitment, but the
ESV condition was perceived as uniquely engaging and personalized. We discuss
the implications of designing generated self-voice systems as a personalized
behavioral intervention for different scenarios.