Qianqian Tong;Wenxuan Wei;Yuan Guo;Tianhao Jin;Ziqi Wang;Hongxing Zhang;Yuru Zhang;Dangxiao Wang
{"title":"Distant Handshakes: Conveying Social Intentions Through Multi-Modal Soft Haptic Gloves","authors":"Qianqian Tong;Wenxuan Wei;Yuan Guo;Tianhao Jin;Ziqi Wang;Hongxing Zhang;Yuru Zhang;Dangxiao Wang","doi":"10.1109/TAFFC.2024.3438761","DOIUrl":null,"url":null,"abstract":"Due to the lack of physical touch, social distancing caused by COVID-19 makes it difficult to convey social intentions through handshakes. To mitigate this situation, one promising solution is to simulate distinguishable handshake patterns through haptic feedback devices during distant social communication. This paper reports a distant handshake scheme with multi-modal soft haptic gloves. To address the challenge of duplicating rich haptic stimuli of real handshakes in a compact glove, we extracted four haptic features including grip location, grip strength, skin temperature, and shaking frequency from abundant components of the haptic perception system to mimic handshake behaviors. To guide the interference-free spatial layout of multiple actuators in a limited hand-sized space, we measured the handshake contact area and grip strength of different handshake patterns, which together with the thermosensitivity of the human hand determine the grip location, grip strength, and salient thermal stimulating location. We developed a multi-modal soft haptic glove by rendering four features through pneumatic pressure, thermal, and vibrotactile stimuli, respectively. A user study was conducted to validate the performance of our glove, which set two states for each of the four features, showing over 90% accuracy in distinguishing 16 handshake patterns. Furthermore, a user study on the identification of social intentions yields the finding that distant handshakes with our haptic gloves can convey positive, neutral, and negative social intentions. These results inform the potential of distant handshakes with haptic gloves to convey social intentions in remote interactions including business, politics, and daily life in severe and post-pandemic situations, as well as in future metaverse-based society.","PeriodicalId":13131,"journal":{"name":"IEEE Transactions on Affective Computing","volume":"16 1","pages":"423-437"},"PeriodicalIF":9.8000,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Affective Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10623890/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Due to the lack of physical touch, social distancing caused by COVID-19 makes it difficult to convey social intentions through handshakes. To mitigate this situation, one promising solution is to simulate distinguishable handshake patterns through haptic feedback devices during distant social communication. This paper reports a distant handshake scheme with multi-modal soft haptic gloves. To address the challenge of duplicating rich haptic stimuli of real handshakes in a compact glove, we extracted four haptic features including grip location, grip strength, skin temperature, and shaking frequency from abundant components of the haptic perception system to mimic handshake behaviors. To guide the interference-free spatial layout of multiple actuators in a limited hand-sized space, we measured the handshake contact area and grip strength of different handshake patterns, which together with the thermosensitivity of the human hand determine the grip location, grip strength, and salient thermal stimulating location. We developed a multi-modal soft haptic glove by rendering four features through pneumatic pressure, thermal, and vibrotactile stimuli, respectively. A user study was conducted to validate the performance of our glove, which set two states for each of the four features, showing over 90% accuracy in distinguishing 16 handshake patterns. Furthermore, a user study on the identification of social intentions yields the finding that distant handshakes with our haptic gloves can convey positive, neutral, and negative social intentions. These results inform the potential of distant handshakes with haptic gloves to convey social intentions in remote interactions including business, politics, and daily life in severe and post-pandemic situations, as well as in future metaverse-based society.
期刊介绍:
The IEEE Transactions on Affective Computing is an international and interdisciplinary journal. Its primary goal is to share research findings on the development of systems capable of recognizing, interpreting, and simulating human emotions and related affective phenomena. The journal publishes original research on the underlying principles and theories that explain how and why affective factors shape human-technology interactions. It also focuses on how techniques for sensing and simulating affect can enhance our understanding of human emotions and processes. Additionally, the journal explores the design, implementation, and evaluation of systems that prioritize the consideration of affect in their usability. We also welcome surveys of existing work that provide new perspectives on the historical and future directions of this field.