... IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)最新文献
Pub Date : 2024-10-01Epub Date: 2024-12-02DOI: 10.1109/ismar-adjunct64951.2024.00055
Jaewook Lee, Yang Li, Dylan Bunarto, Eujean Lee, Olivia H Wang, Adrian Rodriguez, Yuhang Zhao, Yapeng Tian, Jon E Froehlich
People with low vision (LV) experience challenges in visually tracking balls and players in sports like basketball and tennis, which can adversely impact their participation and health. We introduce ARSports, a wearable AR research prototype that overlays instance segmentation masks in near real-time for improving sports accessibility. To create ARSports, we manually collected and annotated novel first-person perspective sports datasets, fine-tuned instance segmentation models using this labeled data, and built an initial wearable AR prototype by combining the ZED Mini stereo camera with the Oculus Quest 2 VR headset. Our evaluations suggest that combining real-time computer vision and augmented reality to create scene-aware visual augmentations is a promising approach to enhancing sports participation for LV individuals. We contribute open-sourced egocentric basketball and tennis datasets and models, as well as insights and design recommendations from our pilot study with an LV research team member.
{"title":"Towards AI-Powered AR for Enhancing Sports Playability for People with Low Vision: An Exploration of ARSports.","authors":"Jaewook Lee, Yang Li, Dylan Bunarto, Eujean Lee, Olivia H Wang, Adrian Rodriguez, Yuhang Zhao, Yapeng Tian, Jon E Froehlich","doi":"10.1109/ismar-adjunct64951.2024.00055","DOIUrl":"10.1109/ismar-adjunct64951.2024.00055","url":null,"abstract":"<p><p>People with low vision (LV) experience challenges in visually tracking balls and players in sports like basketball and tennis, which can adversely impact their participation and health. We introduce <i>ARSports</i>, a wearable AR research prototype that overlays instance segmentation masks in near real-time for improving sports accessibility. To create ARSports, we manually collected and annotated novel first-person perspective sports datasets, fine-tuned instance segmentation models using this labeled data, and built an initial wearable AR prototype by combining the <i>ZED Mini</i> stereo camera with the <i>Oculus Quest 2</i> VR headset. Our evaluations suggest that combining real-time computer vision and augmented reality to create scene-aware visual augmentations is a promising approach to enhancing sports participation for LV individuals. We contribute open-sourced egocentric basketball and tennis datasets and models, as well as insights and design recommendations from our pilot study with an LV research team member.</p>","PeriodicalId":519868,"journal":{"name":"... IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"2024 ","pages":"228-233"},"PeriodicalIF":0.0,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12279022/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144683988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-01Epub Date: 2023-12-04DOI: 10.1109/ismar-adjunct60411.2023.00139
Xiaorui Zhang, Andreas Keller, Mehran Armand, Alejandro Martin Gomez
Accurate depth estimation poses a significant challenge in egocentric Augmented Reality (AR), particularly for precision-dependent tasks in the medical field, such as needle or tool insertions during percutaneous procedures. Augmented Mirrors (AMs) provide a unique solution to this problem by offering additional non-egocentric viewpoints that enhance spatial understanding of an AR scene. Despite the perceptual advantages of using AMs, their practical utility has yet to be thoroughly tested. In this work, we present results from a pilot study involving five participants tasked with simulating epidural injection procedures in an AR environment, both with and without the aid of an AM. Our findings indicate that using AM contributes to reducing mental effort while improving alignment accuracy. These results highlight the potential of AM as a powerful tool for AR-enabled medical procedures, setting the stage for future exploration involving medical professionals.
在以自我为中心的增强现实（Augmented Reality，AR）中，准确的深度估计是一项重大挑战，尤其是对于医疗领域中依赖精度的任务，例如经皮手术中的针头或工具插入。增强镜（AM）为这一问题提供了独特的解决方案，它提供了额外的非自我中心视角，增强了对 AR 场景的空间理解。尽管使用增强镜具有感知上的优势，但其实际效用仍有待全面测试。在这项工作中，我们介绍了一项试点研究的结果，该研究涉及五名参与者，他们在 AR 环境中模拟硬膜外注射过程，包括使用和不使用 AM 的情况。我们的研究结果表明，使用调幅装置有助于减少脑力劳动，同时提高对准的准确性。这些结果凸显了AM作为AR辅助医疗程序的强大工具的潜力，为未来涉及医疗专业人员的探索奠定了基础。
{"title":"Feasibility Study of Using Augmented Mirrors for Alignment Task during Orthopaedic Procedures in Mixed Reality.","authors":"Xiaorui Zhang, Andreas Keller, Mehran Armand, Alejandro Martin Gomez","doi":"10.1109/ismar-adjunct60411.2023.00139","DOIUrl":"https://doi.org/10.1109/ismar-adjunct60411.2023.00139","url":null,"abstract":"<p><p>Accurate depth estimation poses a significant challenge in egocentric Augmented Reality (AR), particularly for precision-dependent tasks in the medical field, such as needle or tool insertions during percutaneous procedures. Augmented Mirrors (AMs) provide a unique solution to this problem by offering additional non-egocentric viewpoints that enhance spatial understanding of an AR scene. Despite the perceptual advantages of using AMs, their practical utility has yet to be thoroughly tested. In this work, we present results from a pilot study involving five participants tasked with simulating epidural injection procedures in an AR environment, both with and without the aid of an AM. Our findings indicate that using AM contributes to reducing mental effort while improving alignment accuracy. These results highlight the potential of AM as a powerful tool for AR-enabled medical procedures, setting the stage for future exploration involving medical professionals.</p>","PeriodicalId":519868,"journal":{"name":"... IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)","volume":"2023 ","pages":"650-651"},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10986428/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140874373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
... IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
扫码关注我们
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号