Dasom Choi, SoHyun Park, Kyungah Lee, Hwajung Hong, Young-Ho Kim
{"title":"AACessTalk:通过情境引导和卡片推荐,促进语言能力极弱的自闭症儿童与父母之间的交流","authors":"Dasom Choi, SoHyun Park, Kyungah Lee, Hwajung Hong, Young-Ho Kim","doi":"arxiv-2409.09641","DOIUrl":null,"url":null,"abstract":"As minimally verbal autistic (MVA) children communicate with parents through\nfew words and nonverbal cues, parents often struggle to encourage their\nchildren to express subtle emotions and needs and to grasp their nuanced\nsignals. We present AACessTalk, a tablet-based, AI-mediated communication\nsystem that facilitates meaningful exchanges between an MVA child and a parent.\nAACessTalk provides real-time guides to the parent to engage the child in\nconversation and, in turn, recommends contextual vocabulary cards to the child.\nThrough a two-week deployment study with 11 MVA child-parent dyads, we examine\nhow AACessTalk fosters everyday conversation practice and mutual engagement.\nOur findings show high engagement from all dyads, leading to increased\nfrequency of conversation and turn-taking. AACessTalk also encouraged parents\nto explore their own interaction strategies and empowered the children to have\nmore agency in communication. We discuss the implications of designing\ntechnologies for balanced communication dynamics in parent-MVA child\ninteraction.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"20 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AACessTalk: Fostering Communication between Minimally Verbal Autistic Children and Parents with Contextual Guidance and Card Recommendation\",\"authors\":\"Dasom Choi, SoHyun Park, Kyungah Lee, Hwajung Hong, Young-Ho Kim\",\"doi\":\"arxiv-2409.09641\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As minimally verbal autistic (MVA) children communicate with parents through\\nfew words and nonverbal cues, parents often struggle to encourage their\\nchildren to express subtle emotions and needs and to grasp their nuanced\\nsignals. We present AACessTalk, a tablet-based, AI-mediated communication\\nsystem that facilitates meaningful exchanges between an MVA child and a parent.\\nAACessTalk provides real-time guides to the parent to engage the child in\\nconversation and, in turn, recommends contextual vocabulary cards to the child.\\nThrough a two-week deployment study with 11 MVA child-parent dyads, we examine\\nhow AACessTalk fosters everyday conversation practice and mutual engagement.\\nOur findings show high engagement from all dyads, leading to increased\\nfrequency of conversation and turn-taking. AACessTalk also encouraged parents\\nto explore their own interaction strategies and empowered the children to have\\nmore agency in communication. We discuss the implications of designing\\ntechnologies for balanced communication dynamics in parent-MVA child\\ninteraction.\",\"PeriodicalId\":501541,\"journal\":{\"name\":\"arXiv - CS - Human-Computer Interaction\",\"volume\":\"20 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Human-Computer Interaction\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.09641\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Human-Computer Interaction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09641","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
AACessTalk: Fostering Communication between Minimally Verbal Autistic Children and Parents with Contextual Guidance and Card Recommendation
As minimally verbal autistic (MVA) children communicate with parents through
few words and nonverbal cues, parents often struggle to encourage their
children to express subtle emotions and needs and to grasp their nuanced
signals. We present AACessTalk, a tablet-based, AI-mediated communication
system that facilitates meaningful exchanges between an MVA child and a parent.
AACessTalk provides real-time guides to the parent to engage the child in
conversation and, in turn, recommends contextual vocabulary cards to the child.
Through a two-week deployment study with 11 MVA child-parent dyads, we examine
how AACessTalk fosters everyday conversation practice and mutual engagement.
Our findings show high engagement from all dyads, leading to increased
frequency of conversation and turn-taking. AACessTalk also encouraged parents
to explore their own interaction strategies and empowered the children to have
more agency in communication. We discuss the implications of designing
technologies for balanced communication dynamics in parent-MVA child
interaction.