In spatiotemporal modulation (STM) and lateral modulation (LM) used in conventional mid-air ultrasound tactile stimulation, single or multiple focuses are moved by switching the ultrasound transducer phases. A problem with the phase switching method is the limitation of the focus motion speed due to rapid phase switching that causes sound pressure fluctuations. This paper proposes an LM method using multiple-frequency ultrasound to shift the ultrasound focal point without switching the phase. This method can demonstrate a continuous and stable moving stimulus with high-frequency components, without producing unnecessary audible noise. Using the proposed broadband LM covering up to 400 Hz, we found that a high-frequency 400 Hz LM applied at a finger pad can display a stimulation area with the diameters comparable to or less than the half wavelength of 40 kHz ultrasound, where the perceptual size was evaluated as 4. 2 mm for the long axis diameter and 3. 4 mm for the short axis diameter.
{"title":"Local Area Tactile Stimulation Using Interference of Multi-Frequency Airborne Ultrasound.","authors":"Saya Mizutani, Shun Suzuki, Atsushi Matsubayashi, Masahiro Fujiwara, Yasutoshi Makino, Hiroyuki Shinoda","doi":"10.1109/TOH.2024.3416333","DOIUrl":"10.1109/TOH.2024.3416333","url":null,"abstract":"<p><p>In spatiotemporal modulation (STM) and lateral modulation (LM) used in conventional mid-air ultrasound tactile stimulation, single or multiple focuses are moved by switching the ultrasound transducer phases. A problem with the phase switching method is the limitation of the focus motion speed due to rapid phase switching that causes sound pressure fluctuations. This paper proposes an LM method using multiple-frequency ultrasound to shift the ultrasound focal point without switching the phase. This method can demonstrate a continuous and stable moving stimulus with high-frequency components, without producing unnecessary audible noise. Using the proposed broadband LM covering up to 400 Hz, we found that a high-frequency 400 Hz LM applied at a finger pad can display a stimulation area with the diameters comparable to or less than the half wavelength of 40 kHz ultrasound, where the perceptual size was evaluated as 4. 2 mm for the long axis diameter and 3. 4 mm for the short axis diameter.</p>","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141418729","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-28DOI: 10.1109/TOH.2024.3406251
Guillaume H C Duprez, Benoit P Delhaye, Laurent Delannay
The subcutaneous mechanical response of the fingertip is highly anisotropic due to the presence of a network of collagen fibers linking the outer skin layer to the bone. The impact of this anisotropy on the fingerpad deformation, which had not been studied until now, is here demonstrated using a two-dimensional finite element model of a transverse section of the finger. Different distributions of fiber orientations are considered: radial (physiologic), circumferential, and random (isotropic). The three variants of the model are assessed using experimental observations of a finger pressed on a flat surface. Predictions relying on the physiological orientation of fibers best reproduce experimental trends. Our results show that the orientation of fibers significantly influences the distribution of internal strains and stresses. This leads to a sudden change in the profile of contact pressure when transitioning from sticking to slipping. Interpreted in terms of tactile perception or sensation, these variations might represent important sensory cues for partial slip detection. This is also valuable information for the development of haptic devices.
{"title":"Collagen Induces Anisotropy in Fingertip Subcutaneous Tissues During Contact.","authors":"Guillaume H C Duprez, Benoit P Delhaye, Laurent Delannay","doi":"10.1109/TOH.2024.3406251","DOIUrl":"10.1109/TOH.2024.3406251","url":null,"abstract":"<p><p>The subcutaneous mechanical response of the fingertip is highly anisotropic due to the presence of a network of collagen fibers linking the outer skin layer to the bone. The impact of this anisotropy on the fingerpad deformation, which had not been studied until now, is here demonstrated using a two-dimensional finite element model of a transverse section of the finger. Different distributions of fiber orientations are considered: radial (physiologic), circumferential, and random (isotropic). The three variants of the model are assessed using experimental observations of a finger pressed on a flat surface. Predictions relying on the physiological orientation of fibers best reproduce experimental trends. Our results show that the orientation of fibers significantly influences the distribution of internal strains and stresses. This leads to a sudden change in the profile of contact pressure when transitioning from sticking to slipping. Interpreted in terms of tactile perception or sensation, these variations might represent important sensory cues for partial slip detection. This is also valuable information for the development of haptic devices.</p>","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141160334","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-27DOI: 10.1109/TOH.2024.3405728
Qingyu Sun, Shogo Okamoto, Hongbo Wang
The objective of this study was to investigate the influence of roughened surface features on the perceived hardness of various materials. Thirteen participants used a visual analog scale to evaluate the hardness of ten 3D-printed specimens by sliding a fingertip on them. The specimens had two types of surface features: flat and smooth, or with microscopic rectangular gratings. They were fabricated from two types of plastic with different Young's moduli-2.46 and 9.35 MPa. We found that both surface pattern and mechanical hardness significantly contributed to the perceived hardness of a material individually and without interaction. The roughened surfaces with rectangular gratings were judged to be harder than the flat and smooth surfaces of the same material. Among the parameters of the rectangular gratings, the groove width or periodic surface wavelength significantly contributed to the perceived hardness. Although the root cause of this phenomenon is unknown, friction caused by surface roughness is considered a potential mediator that influences the perceived hardness. The findings of this study can facilitate the manipulation of softness perception through surface design.
本研究旨在调查粗糙表面特征对各种材料感知硬度的影响。13 名参与者用指尖在 10 个 3D 打印试样上滑动,使用视觉模拟量表来评估其硬度。这些试样有两种表面特征:平整光滑或带有微小矩形光栅。它们由两种不同杨氏模量(2.46 和 9.35 兆帕)的塑料制成。我们发现,表面纹路和机械硬度都会对材料的感知硬度产生显著影响,但两者不会相互影响。带有矩形光栅的粗糙表面比相同材料的平滑表面更坚硬。在矩形光栅的参数中,凹槽宽度或周期性表面波长对感知硬度有显著影响。虽然这一现象的根本原因尚不清楚,但表面粗糙度引起的摩擦被认为是影响感知硬度的潜在媒介。本研究的发现有助于通过表面设计来操控软硬度感知。
{"title":"Hardness Perceived When Sliding Over Roughened Surfaces.","authors":"Qingyu Sun, Shogo Okamoto, Hongbo Wang","doi":"10.1109/TOH.2024.3405728","DOIUrl":"https://doi.org/10.1109/TOH.2024.3405728","url":null,"abstract":"<p><p>The objective of this study was to investigate the influence of roughened surface features on the perceived hardness of various materials. Thirteen participants used a visual analog scale to evaluate the hardness of ten 3D-printed specimens by sliding a fingertip on them. The specimens had two types of surface features: flat and smooth, or with microscopic rectangular gratings. They were fabricated from two types of plastic with different Young's moduli-2.46 and 9.35 MPa. We found that both surface pattern and mechanical hardness significantly contributed to the perceived hardness of a material individually and without interaction. The roughened surfaces with rectangular gratings were judged to be harder than the flat and smooth surfaces of the same material. Among the parameters of the rectangular gratings, the groove width or periodic surface wavelength significantly contributed to the perceived hardness. Although the root cause of this phenomenon is unknown, friction caused by surface roughness is considered a potential mediator that influences the perceived hardness. The findings of this study can facilitate the manipulation of softness perception through surface design.</p>","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141158367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-27DOI: 10.1109/TOH.2024.3405551
Astrid M L Kappers, Raymond J Holt, Tessa J W Junggeburth, Max Fa Si Oen, Bart J T van de Wetering, Myrthe A Plaisier
In this survey, we give an overview of hands-free haptic devices specifically designed for navigation guidance while walking. We present and discuss the devices by body part, namely devices for the arm, foot and leg, back, belly and shoulders, waist and finally the head. Although the majority of the experimental tests were successful in terms of reaching the target while being guided by the device, the experimental requirements were wide-ranging. The distances to be covered ranged from just a few meters to more than a kilometer, and while some of the devices worked autonomously, others required the experimenter to act as Wizard of Oz. To compare the usefulness and potential of these devices, we created a table in which we rated several relevant aspects such as autonomy, conspicuity and compactness. Major conclusions are that outdoor devices have the highest technology readiness level, because these allow autonomous navigation through GPS, and that the most compact devices still require the action of an experimenter. Unfortunately, none of the hands-free devices are at a level of readiness where they could be useful to people with visual impairments. The most important factor that should be improved is localization accuracy, which should be high and available at all times.
{"title":"Hands-Free Haptic Navigation Devices for Actual Walking.","authors":"Astrid M L Kappers, Raymond J Holt, Tessa J W Junggeburth, Max Fa Si Oen, Bart J T van de Wetering, Myrthe A Plaisier","doi":"10.1109/TOH.2024.3405551","DOIUrl":"https://doi.org/10.1109/TOH.2024.3405551","url":null,"abstract":"<p><p>In this survey, we give an overview of hands-free haptic devices specifically designed for navigation guidance while walking. We present and discuss the devices by body part, namely devices for the arm, foot and leg, back, belly and shoulders, waist and finally the head. Although the majority of the experimental tests were successful in terms of reaching the target while being guided by the device, the experimental requirements were wide-ranging. The distances to be covered ranged from just a few meters to more than a kilometer, and while some of the devices worked autonomously, others required the experimenter to act as Wizard of Oz. To compare the usefulness and potential of these devices, we created a table in which we rated several relevant aspects such as autonomy, conspicuity and compactness. Major conclusions are that outdoor devices have the highest technology readiness level, because these allow autonomous navigation through GPS, and that the most compact devices still require the action of an experimenter. Unfortunately, none of the hands-free devices are at a level of readiness where they could be useful to people with visual impairments. The most important factor that should be improved is localization accuracy, which should be high and available at all times.</p>","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141158363","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-10DOI: 10.1109/TOH.2024.3399394
Elisabet Henell, Judith Weda, Sophia Cedermalm, Linnea Eklov, Marta Hakansson, Jesper Nordstrom, Marit Reibring, Jonas Stalhand, Nils-Krister Persson, Angelika Mader, Jan B F van Erp, Edwin W H Jager
To design complex wearable haptic interfaces using pressure, we have to explore how we can use pressure stimuli to their full potential. Haptic illusions, such as apparent motion and apparent location, can be a part of this. If these illusions can be evoked with pressure, haptic patterns can increase in complexity without increasing the number of actuators or combining different types of actuators. We did two psychophysical experiments with pressure stimuli on the forearm using a pneumatic sleeve with multiple, individually controlled McKibben actuators. In Experiment 1, we found that spatial integration of two simultaneously presented stimuli occurred for distances up to 61 mm. In Experiment 2, we found that apparent motion can be elicited with distinct pressure stimuli over a range of temporal parameters. These results clearly show spatio-temporal integration in the somatosensory system for pressure stimuli. We discuss these findings in relation to effects found for vibration and the mechanoreceptors in the glabrous skin.
{"title":"Pressure Stimuli and Spatiotemporal Illusions on the Forearm.","authors":"Elisabet Henell, Judith Weda, Sophia Cedermalm, Linnea Eklov, Marta Hakansson, Jesper Nordstrom, Marit Reibring, Jonas Stalhand, Nils-Krister Persson, Angelika Mader, Jan B F van Erp, Edwin W H Jager","doi":"10.1109/TOH.2024.3399394","DOIUrl":"https://doi.org/10.1109/TOH.2024.3399394","url":null,"abstract":"<p><p>To design complex wearable haptic interfaces using pressure, we have to explore how we can use pressure stimuli to their full potential. Haptic illusions, such as apparent motion and apparent location, can be a part of this. If these illusions can be evoked with pressure, haptic patterns can increase in complexity without increasing the number of actuators or combining different types of actuators. We did two psychophysical experiments with pressure stimuli on the forearm using a pneumatic sleeve with multiple, individually controlled McKibben actuators. In Experiment 1, we found that spatial integration of two simultaneously presented stimuli occurred for distances up to 61 mm. In Experiment 2, we found that apparent motion can be elicited with distinct pressure stimuli over a range of temporal parameters. These results clearly show spatio-temporal integration in the somatosensory system for pressure stimuli. We discuss these findings in relation to effects found for vibration and the mechanoreceptors in the glabrous skin.</p>","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140903992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-25DOI: 10.1109/TOH.2024.3392473
Jan Peters, Bani Anvari, Johann Licher, M. Wiese, Annika Raatz, H. Wurdemann
Fully autonomous vehicles, capable of completing entire end-to-end journeys without the interference of a human driver, will be one of the biggest transforming technologies of the next decades. As the journey towards fully autonomous vehicles progresses, there will be an increase in the number of highly automated vehicles on the roads, requiring the human driver to take back control in situations, which cannot be handled by the vehicle autonomously. These human-robot take-over requests can lead to safety risks, in particular in scenarios when the driver fails to understand the take-over request and, hence, lacks situational awareness. This paper presents the acceptance and usability assessment of a haptic feedback driver seat capable of informing the driver of a take-over request through static mechano-tactile haptic feedback. The seat is equipped with an embedded array of soft pneumatic actuators, that have been fully modelled and characterised. The evaluation process of the haptic feedback seat engaged 21 participants who experienced both auditory and haptic feedback from the seat in a number of simulation experiments within a driving simulator. The vehicular technology was assessed through well-established methods to understand the acceptance (usefulness and satisfaction) and usability of the haptic feedback driver seat.
{"title":"Acceptance and Usability of a Soft Robotic, Haptic Feedback Seat for Autonomy Level Transitions in Highly Automated Vehicles.","authors":"Jan Peters, Bani Anvari, Johann Licher, M. Wiese, Annika Raatz, H. Wurdemann","doi":"10.1109/TOH.2024.3392473","DOIUrl":"https://doi.org/10.1109/TOH.2024.3392473","url":null,"abstract":"Fully autonomous vehicles, capable of completing entire end-to-end journeys without the interference of a human driver, will be one of the biggest transforming technologies of the next decades. As the journey towards fully autonomous vehicles progresses, there will be an increase in the number of highly automated vehicles on the roads, requiring the human driver to take back control in situations, which cannot be handled by the vehicle autonomously. These human-robot take-over requests can lead to safety risks, in particular in scenarios when the driver fails to understand the take-over request and, hence, lacks situational awareness. This paper presents the acceptance and usability assessment of a haptic feedback driver seat capable of informing the driver of a take-over request through static mechano-tactile haptic feedback. The seat is equipped with an embedded array of soft pneumatic actuators, that have been fully modelled and characterised. The evaluation process of the haptic feedback seat engaged 21 participants who experienced both auditory and haptic feedback from the seat in a number of simulation experiments within a driving simulator. The vehicular technology was assessed through well-established methods to understand the acceptance (usefulness and satisfaction) and usability of the haptic feedback driver seat.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140653365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-08DOI: 10.1109/toh.2024.3385294
Astrid M. L. Kappers, Marloes P. A. van der Burgt, Savannah M. Nowak, Fabiènne P. van der Weide, Wouter K. Vos, Myrthe A. Plaisier
{"title":"Influence of Back Length on Vibrotactile Acuity in Vertical Direction","authors":"Astrid M. L. Kappers, Marloes P. A. van der Burgt, Savannah M. Nowak, Fabiènne P. van der Weide, Wouter K. Vos, Myrthe A. Plaisier","doi":"10.1109/toh.2024.3385294","DOIUrl":"https://doi.org/10.1109/toh.2024.3385294","url":null,"abstract":"","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140572828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-08DOI: 10.1109/toh.2024.3386199
Takuya Noto, Takuto Nakamura, Tomohiro Amemiya
{"title":"Synergistic Illusions: Enhancing Perceptual Effects of Pseudo-Attraction Force by Kinesthetic Illusory Hand Movement","authors":"Takuya Noto, Takuto Nakamura, Tomohiro Amemiya","doi":"10.1109/toh.2024.3386199","DOIUrl":"https://doi.org/10.1109/toh.2024.3386199","url":null,"abstract":"","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140572839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-03DOI: 10.1109/toh.2024.3384482
Catie Cuan, Allison Okamura, Mohi Khansari
{"title":"Leveraging Haptic Feedback to Improve Data Quality and Quantity for Deep Imitation Learning Models","authors":"Catie Cuan, Allison Okamura, Mohi Khansari","doi":"10.1109/toh.2024.3384482","DOIUrl":"https://doi.org/10.1109/toh.2024.3384482","url":null,"abstract":"","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140573009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-27DOI: 10.1109/TOH.2024.3382258
Negin Heravi, Heather Culbertson, Allison M Okamura, Jeannette Bohg
Current Virtual Reality (VR) environments lack the haptic signals that humans experience during real-life interactions, such as the sensation of texture during lateral movement on a surface. Adding realistic haptic textures to VR environments requires a model that generalizes to variations of a user's interaction and to the wide variety of existing textures in the world. Current methodologies for haptic texture rendering exist, but they usually develop one model per texture, resulting in low scalability. We present a deep learning-based action-conditional model for haptic texture rendering and evaluate its perceptual performance in rendering realistic texture vibrations through a multi-part human user study. This model is unified over all materials and uses data from a vision-based tactile sensor (GelSight) to render the appropriate surface conditioned on the user's action in real-time. For rendering texture, we use a high-bandwidth vibrotactile transducer attached to a 3D Systems Touch device. The results of our user study shows that our learning-based method creates high-frequency texture renderings with comparable or better quality than state-of-the-art methods without the need to learn a separate model per texture. Furthermore, we show that the method is capable of rendering previously unseen textures using a single GelSight image of their surface.
当前的虚拟现实(VR)环境缺乏人类在现实生活交互过程中体验到的触觉信号,例如在表面上横向移动时的纹理感。要在 VR 环境中添加逼真的触觉纹理,就需要建立一个模型,以适应用户交互的各种变化和世界上现有的各种纹理。目前已有用于触觉纹理渲染的方法,但它们通常为每种纹理开发一个模型,导致可扩展性较低。我们为触觉纹理渲染提出了一种基于深度学习的动作条件模型,并通过多部分人类用户研究评估了该模型在渲染逼真纹理振动时的感知性能。该模型对所有材料进行了统一,并使用来自视觉触觉传感器(GelSight)的数据,根据用户的动作实时渲染适当的表面。为了渲染纹理,我们使用了一个连接在 3D Systems Touch 设备上的高带宽振动触觉传感器。用户研究结果表明,我们基于学习的方法创建的高频纹理渲染质量可与最先进的方法媲美,甚至更好,而无需为每种纹理学习单独的模型。此外,我们还展示了该方法能够使用单一的 GelSight 纹理表面图像渲染以前未见过的纹理。
{"title":"Development and Evaluation of a Learning-based Model for Real-time Haptic Texture Rendering.","authors":"Negin Heravi, Heather Culbertson, Allison M Okamura, Jeannette Bohg","doi":"10.1109/TOH.2024.3382258","DOIUrl":"https://doi.org/10.1109/TOH.2024.3382258","url":null,"abstract":"<p><p>Current Virtual Reality (VR) environments lack the haptic signals that humans experience during real-life interactions, such as the sensation of texture during lateral movement on a surface. Adding realistic haptic textures to VR environments requires a model that generalizes to variations of a user's interaction and to the wide variety of existing textures in the world. Current methodologies for haptic texture rendering exist, but they usually develop one model per texture, resulting in low scalability. We present a deep learning-based action-conditional model for haptic texture rendering and evaluate its perceptual performance in rendering realistic texture vibrations through a multi-part human user study. This model is unified over all materials and uses data from a vision-based tactile sensor (GelSight) to render the appropriate surface conditioned on the user's action in real-time. For rendering texture, we use a high-bandwidth vibrotactile transducer attached to a 3D Systems Touch device. The results of our user study shows that our learning-based method creates high-frequency texture renderings with comparable or better quality than state-of-the-art methods without the need to learn a separate model per texture. Furthermore, we show that the method is capable of rendering previously unseen textures using a single GelSight image of their surface.</p>","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140305448","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}