Xinge Yu, Zhaoqian Xie, Yang Yu, Jungyup Lee, Abraham Vazquez-Guardado, Haiwen Luan, Jasper Ruban, Xin Ning, Aadeel Akhtar, Dengfeng Li, Bowen Ji, Yiming Liu, Rujie Sun, Jingyue Cao, Qingze Huo, Yishan Zhong, ChanMi Lee, SeungYeop Kim, Philipp Gutruf, Changxing Zhang, Yeguang Xue, Qinglei Guo, Aditya Chempakasseril, Peilin Tian, Wei Lu, JiYoon Jeong, YongJoon Yu, Jesse Cornman, CheeSim Tan, BongHoon Kim, KunHyuk Lee, Xue Feng, Yonggang Huang, John A. Rogers
{"title":"Skin-integrated wireless haptic interfaces for virtual and augmented reality","authors":"Xinge Yu, Zhaoqian Xie, Yang Yu, Jungyup Lee, Abraham Vazquez-Guardado, Haiwen Luan, Jasper Ruban, Xin Ning, Aadeel Akhtar, Dengfeng Li, Bowen Ji, Yiming Liu, Rujie Sun, Jingyue Cao, Qingze Huo, Yishan Zhong, ChanMi Lee, SeungYeop Kim, Philipp Gutruf, Changxing Zhang, Yeguang Xue, Qinglei Guo, Aditya Chempakasseril, Peilin Tian, Wei Lu, JiYoon Jeong, YongJoon Yu, Jesse Cornman, CheeSim Tan, BongHoon Kim, KunHyuk Lee, Xue Feng, Yonggang Huang, John A. Rogers","doi":"10.1038/s41586-019-1687-0","DOIUrl":null,"url":null,"abstract":"Traditional technologies for virtual reality (VR) and augmented reality (AR) create human experiences through visual and auditory stimuli that replicate sensations associated with the physical world. The most widespread VR and AR systems use head-mounted displays, accelerometers and loudspeakers as the basis for three-dimensional, computer-generated environments that can exist in isolation or as overlays on actual scenery. In comparison to the eyes and the ears, the skin is a relatively underexplored sensory interface for VR and AR technology that could, nevertheless, greatly enhance experiences at a qualitative level, with direct relevance in areas such as communications, entertainment and medicine1,2. Here we present a wireless, battery-free platform of electronic systems and haptic (that is, touch-based) interfaces capable of softly laminating onto the curved surfaces of the skin to communicate information via spatio-temporally programmable patterns of localized mechanical vibrations. We describe the materials, device structures, power delivery strategies and communication schemes that serve as the foundations for such platforms. The resulting technology creates many opportunities for use where the skin provides an electronically programmable communication and sensory input channel to the body, as demonstrated through applications in social media and personal engagement, prosthetic control and feedback, and gaming and entertainment. Interfaces for epidermal virtual reality technology are demonstrated that can communicate by programmable patterns of localized mechanical vibrations.","PeriodicalId":18787,"journal":{"name":"Nature","volume":"575 7783","pages":"473-479"},"PeriodicalIF":50.5000,"publicationDate":"2019-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1038/s41586-019-1687-0","citationCount":"482","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature","FirstCategoryId":"103","ListUrlMain":"https://www.nature.com/articles/s41586-019-1687-0","RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 482
Abstract
Traditional technologies for virtual reality (VR) and augmented reality (AR) create human experiences through visual and auditory stimuli that replicate sensations associated with the physical world. The most widespread VR and AR systems use head-mounted displays, accelerometers and loudspeakers as the basis for three-dimensional, computer-generated environments that can exist in isolation or as overlays on actual scenery. In comparison to the eyes and the ears, the skin is a relatively underexplored sensory interface for VR and AR technology that could, nevertheless, greatly enhance experiences at a qualitative level, with direct relevance in areas such as communications, entertainment and medicine1,2. Here we present a wireless, battery-free platform of electronic systems and haptic (that is, touch-based) interfaces capable of softly laminating onto the curved surfaces of the skin to communicate information via spatio-temporally programmable patterns of localized mechanical vibrations. We describe the materials, device structures, power delivery strategies and communication schemes that serve as the foundations for such platforms. The resulting technology creates many opportunities for use where the skin provides an electronically programmable communication and sensory input channel to the body, as demonstrated through applications in social media and personal engagement, prosthetic control and feedback, and gaming and entertainment. Interfaces for epidermal virtual reality technology are demonstrated that can communicate by programmable patterns of localized mechanical vibrations.
传统的虚拟现实(VR)和增强现实(AR)技术通过视觉和听觉刺激,复制与物理世界相关的感觉,创造人类体验。最普遍的虚拟现实和增强现实系统使用头戴式显示器、加速度计和扬声器作为三维计算机生成环境的基础,这些环境可以单独存在,也可以叠加在实际场景上。与眼睛和耳朵相比,皮肤是 VR 和 AR 技术中一个相对未被充分开发的感官界面,但它可以极大地提升体验的质量,与通信、娱乐和医疗等领域直接相关1,2。在这里,我们介绍一种无线、无电池的电子系统平台和触觉(即基于触摸的)界面,它能够柔软地贴合在皮肤的弯曲表面上,通过局部机械振动的时空可编程模式来传递信息。我们介绍了作为此类平台基础的材料、设备结构、动力传输策略和通信方案。由此产生的技术创造了许多使用机会,其中皮肤为身体提供了一个电子可编程通信和感官输入通道,社交媒体和个人参与、假肢控制和反馈以及游戏和娱乐等应用都证明了这一点。表皮虚拟现实技术的界面可以通过可编程的局部机械振动模式进行通信。
期刊介绍:
Nature is a prestigious international journal that publishes peer-reviewed research in various scientific and technological fields. The selection of articles is based on criteria such as originality, importance, interdisciplinary relevance, timeliness, accessibility, elegance, and surprising conclusions. In addition to showcasing significant scientific advances, Nature delivers rapid, authoritative, insightful news, and interpretation of current and upcoming trends impacting science, scientists, and the broader public. The journal serves a dual purpose: firstly, to promptly share noteworthy scientific advances and foster discussions among scientists, and secondly, to ensure the swift dissemination of scientific results globally, emphasizing their significance for knowledge, culture, and daily life.