Learning and navigating digitally rendered haptic spatial layouts

IF 3.6 1区 心理学 Q1 EDUCATION & EDUCATIONAL RESEARCH npj Science of Learning Pub Date : 2023-12-16 DOI:10.1038/s41539-023-00208-4
Ruxandra I. Tivadar, Benedetta Franceschiello, Astrid Minier, Micah M. Murray
{"title":"Learning and navigating digitally rendered haptic spatial layouts","authors":"Ruxandra I. Tivadar, Benedetta Franceschiello, Astrid Minier, Micah M. Murray","doi":"10.1038/s41539-023-00208-4","DOIUrl":null,"url":null,"abstract":"<p>Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments.</p>","PeriodicalId":48503,"journal":{"name":"npj Science of Learning","volume":null,"pages":null},"PeriodicalIF":3.6000,"publicationDate":"2023-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"npj Science of Learning","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1038/s41539-023-00208-4","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
学习和浏览数字渲染的触觉空间布局
学习空间布局和浏览空间布局不仅仅依靠视觉,而是依靠包括触觉在内的多感官过程。基于超声波的数字触觉可以有效地为视力正常和视力受损的参与者创建和操作单个物体的心理图像。在这里,我们测试了这是否适用于场景和场景中的导航。25 名视力正常的蒙眼参与者仅通过数字触摸屏(即数字交互式地图)上的超声波反馈来获得触觉刺激,他们首先仅通过数字触觉来了解公寓的基本布局,然后从两条路线中选择一条穿过公寓。在仍然蒙着眼睛的情况下,参与者成功地重建了通过触觉学习到的二维空间,并在这些空间中进行了导航。因此,数字触觉是一种有效的学习手段,一方面可以将二维图像转化为三维重建布局,另一方面还可以在真实空间中进行导航操作。以超声波为基础的数字触觉技术是复杂场景的另一种学习工具,也是在以前不熟悉的布局中成功导航的另一种学习工具,有可能进一步应用于空间功能的康复和视力障碍的缓解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
5.40
自引率
7.10%
发文量
29
期刊最新文献
Targeted memory reactivation with sleep disruption does not weaken week-old memories. A transient memory lapse in humans 1-3 h after training. Sex differences in motivational biases over instrumental actions. Evaluating large language models in analysing classroom dialogue. A systematic review of observational practice for adaptation of reaching movements.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1