Pub Date : 2023-09-01DOI: 10.1177/21695067231205569
Huao Li, Maximilian Chis, Keyang Zheng, Michael Lewis, Dana Hughes, Katia Sycara
The potential of Artificial Intelligence in assisting human teamwork has yet to be fully realized, despite its success in other domains. To ensure AI’s effectiveness and credibility as a team advisor, it must be able to effectively infer team dynamics and issue appropriate interventions. This study focuses on AI-mediated human teamwork in an simulated search and rescue (SAR) task, where a team of humans is monitored and guided by an artifical social intelligence (ASI). Six different ASIs are compared against a human baseline investigating the characteristics and effectiveness of their interventions. When adjusted for initial player competence ASIs performed on par with the human advisor although the human advisor was rated as more trustworthy and useful. Additionally, sentiment analysis of the interventions reveals that participants were more likely to accept interventions with negative emotions and resulted in improved team performance.
{"title":"Sentiment analysis of Artificial Advisors in Search and Rescue Tasks","authors":"Huao Li, Maximilian Chis, Keyang Zheng, Michael Lewis, Dana Hughes, Katia Sycara","doi":"10.1177/21695067231205569","DOIUrl":"https://doi.org/10.1177/21695067231205569","url":null,"abstract":"The potential of Artificial Intelligence in assisting human teamwork has yet to be fully realized, despite its success in other domains. To ensure AI’s effectiveness and credibility as a team advisor, it must be able to effectively infer team dynamics and issue appropriate interventions. This study focuses on AI-mediated human teamwork in an simulated search and rescue (SAR) task, where a team of humans is monitored and guided by an artifical social intelligence (ASI). Six different ASIs are compared against a human baseline investigating the characteristics and effectiveness of their interventions. When adjusted for initial player competence ASIs performed on par with the human advisor although the human advisor was rated as more trustworthy and useful. Additionally, sentiment analysis of the interventions reveals that participants were more likely to accept interventions with negative emotions and resulted in improved team performance.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"22 1","pages":"2564 - 2570"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139343946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192293
Matthew M. Willett, Mustafa Demir
This research concentrates on the impact of Artificial Social Intelligence (ASI)'s advice intervention text messages and the compliance of three human team members, who communicate via voice to carry out victim rescue operations, on the team's performance. This experiment takes place in a simulated Urban Search and Rescue (USAR) task environment built using Minecraft. The ASI agent, utilizing its analytical components designed around interactive real-time measurements, oversees the team's behavior in the USAR task environment. The agent discerns and forecasts the human team members' actions, offering interventions via text messages to foster and sustain team efficacy. The study examines (1) the influence of the team's cognitive load on message compliance from the advisor, and (2) how these elements collectively affect team performance. The results show a positive association between cognitive load, compliance, and enhanced task performance, despite the lack of a significant correlation between cognitive load and compliance.
{"title":"Understanding the Impact of Team Cognitive Load and Advice Compliance in Urban Search and Rescue Task","authors":"Matthew M. Willett, Mustafa Demir","doi":"10.1177/21695067231192293","DOIUrl":"https://doi.org/10.1177/21695067231192293","url":null,"abstract":"This research concentrates on the impact of Artificial Social Intelligence (ASI)'s advice intervention text messages and the compliance of three human team members, who communicate via voice to carry out victim rescue operations, on the team's performance. This experiment takes place in a simulated Urban Search and Rescue (USAR) task environment built using Minecraft. The ASI agent, utilizing its analytical components designed around interactive real-time measurements, oversees the team's behavior in the USAR task environment. The agent discerns and forecasts the human team members' actions, offering interventions via text messages to foster and sustain team efficacy. The study examines (1) the influence of the team's cognitive load on message compliance from the advisor, and (2) how these elements collectively affect team performance. The results show a positive association between cognitive load, compliance, and enhanced task performance, despite the lack of a significant correlation between cognitive load and compliance.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"17 1","pages":"2484 - 2489"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139345310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231205507
Anna Hall, Ronald L. Boring, Thomas A. Ulrich, Roger T. Lew, Michelle Velazquez, Jinding Xing, Tim A. Whiting, Georgios Michail Makrakis
The nuclear power industry has historically used paper-based procedures, but a shift towards computer-based procedures (CBPs) has the potential to reduce human errors, alleviate mental workload, and improve work performance. Twenty-seven participants were randomly assigned to one of three CBP types using the Rancor Microworld Simulator, and each performed two different types of operational scenarios (startup and loss of feedwater). The three CBP types varied in levels of digitalization. It was hypothesized that there would be less favorable impressions of the most basic procedures, and that these would demonstrate lower usability than types with greater digitalization. Overall, our predictions were partially supported with some interesting caveats, specifically with some performance benefits for CBPs that provided indicators but not embedded controls. We discuss our findings in terms of optimal levels of digitalization/automation within nuclear operations and suggest pathways for future directions.
{"title":"A Comparison of Three Types of Computer-Based Procedures: An Experiment Using the Rancor Microworld Simulator","authors":"Anna Hall, Ronald L. Boring, Thomas A. Ulrich, Roger T. Lew, Michelle Velazquez, Jinding Xing, Tim A. Whiting, Georgios Michail Makrakis","doi":"10.1177/21695067231205507","DOIUrl":"https://doi.org/10.1177/21695067231205507","url":null,"abstract":"The nuclear power industry has historically used paper-based procedures, but a shift towards computer-based procedures (CBPs) has the potential to reduce human errors, alleviate mental workload, and improve work performance. Twenty-seven participants were randomly assigned to one of three CBP types using the Rancor Microworld Simulator, and each performed two different types of operational scenarios (startup and loss of feedwater). The three CBP types varied in levels of digitalization. It was hypothesized that there would be less favorable impressions of the most basic procedures, and that these would demonstrate lower usability than types with greater digitalization. Overall, our predictions were partially supported with some interesting caveats, specifically with some performance benefits for CBPs that provided indicators but not embedded controls. We discuss our findings in terms of optimal levels of digitalization/automation within nuclear operations and suggest pathways for future directions.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"19 1","pages":"2552 - 2557"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139345762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192630
Mansoor Nasir, Kalyani Sonawane, Nikhitha Bekkanti, Walter Talamonti
The work presented herein quantifies the limitations of the technology provided by two prominent suppliers in Emotion AI. Each Software Development Kit (SDK) performance was measured for accuracy using image and video databases. The results indicate that while the SDKs show high accuracy in detecting positive emotions (e.g., Happy), the performance suffered for negative emotions (e.g., Angry) due to missed and false detections. The results were worse for structured video datasets and degraded further when subjects were in naturalistic settings. Although Emotion AI have improved greatly in recent years, the current versions are not reliable enough for automotive applications. The paper provides perspectives on the reasons for subpar performance and guidance for improvement for future emotion estimation software.
{"title":"Perspective on Emotion Detection for Automotive Applications: Performance Evaluation of Two Emotion AI SDKs","authors":"Mansoor Nasir, Kalyani Sonawane, Nikhitha Bekkanti, Walter Talamonti","doi":"10.1177/21695067231192630","DOIUrl":"https://doi.org/10.1177/21695067231192630","url":null,"abstract":"The work presented herein quantifies the limitations of the technology provided by two prominent suppliers in Emotion AI. Each Software Development Kit (SDK) performance was measured for accuracy using image and video databases. The results indicate that while the SDKs show high accuracy in detecting positive emotions (e.g., Happy), the performance suffered for negative emotions (e.g., Angry) due to missed and false detections. The results were worse for structured video datasets and degraded further when subjects were in naturalistic settings. Although Emotion AI have improved greatly in recent years, the current versions are not reliable enough for automotive applications. The paper provides perspectives on the reasons for subpar performance and guidance for improvement for future emotion estimation software.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"217 1","pages":"2366 - 2371"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192196
Martha Sanders
College students report poor sleep quality that impacts class attendance, productivity, and overall success in college. Circadian lighting has helped to regulate sleep patterns and improve sleep quality in populations who traditionally experience poor sleep. A feasibility study was conducted to determine the practicality of conducting a study in which a circadian lighting intervention would be implemented in college students’ dorms to study the effect on sleep, mood, and productivity. This study examined the process, resources, data management, and preliminary efficacy of a 4-wk, daily, one-hour lightbox exposure. Results indicated the lightbox was well-received by students. Recommendations to facilitate the study include improved recruitment efforts, data management, use of a research-grade activity tracker, modification of data collection days, and utilization of research associates to assist in data collection. Preliminary outcomes showed improved sleep quality and productivity for schoolwork in this sample of college students.
{"title":"Feasibility of a Circadian Lighting Intervention to Promote Sleep in College Students","authors":"Martha Sanders","doi":"10.1177/21695067231192196","DOIUrl":"https://doi.org/10.1177/21695067231192196","url":null,"abstract":"College students report poor sleep quality that impacts class attendance, productivity, and overall success in college. Circadian lighting has helped to regulate sleep patterns and improve sleep quality in populations who traditionally experience poor sleep. A feasibility study was conducted to determine the practicality of conducting a study in which a circadian lighting intervention would be implemented in college students’ dorms to study the effect on sleep, mood, and productivity. This study examined the process, resources, data management, and preliminary efficacy of a 4-wk, daily, one-hour lightbox exposure. Results indicated the lightbox was well-received by students. Recommendations to facilitate the study include improved recruitment efforts, data management, use of a research-grade activity tracker, modification of data collection days, and utilization of research associates to assist in data collection. Preliminary outcomes showed improved sleep quality and productivity for schoolwork in this sample of college students.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"79 1","pages":"2228 - 2232"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231205572
John Hayes, Shivangi Dwivedi, Isabella Pedron, Joe Gabbard, Ranjana K. Mehta
Recent challenges such as COVID-19 call for innovative methods of delivering training. In this study, we compare the effectiveness of augmented reality (AR) based psychomotor learning compared to videobased training. Participants completed either AR or video training to learn four basic AR interactions, before completing an AR evaluation. The AR group reported greater workload during training but demonstrated better performance during evaluation. We used functional near infrared spectroscopy (fNIRS) to compare brain activation and functional connectivity across groups during evaluation. We found that participants in the AR group displayed smaller brain networks during the evaluation, suggesting more efficient utilization of neural resources. Sex differences in activation and connectivity suggest that men and women potentially employ different neural strategies while learning motor skills in AR. Future studies should examine how these differences could impact performance and user experience in future AR-based training programs.
最近的挑战(如 COVID-19)需要创新的培训方法。在这项研究中,我们比较了基于增强现实(AR)的心理运动学习与基于视频的培训的效果。参与者在完成增强现实评估之前,通过增强现实或视频培训学习四种基本的增强现实互动。AR组在培训期间的工作量更大,但在评估期间的表现更好。我们使用功能性近红外光谱(fNIRS)来比较各组在评估期间的大脑激活和功能连接情况。我们发现,在评估期间,AR 组的参与者显示出更小的大脑网络,这表明他们更有效地利用了神经资源。激活和连接方面的性别差异表明,男性和女性在学习 AR 运动技能时可能采用了不同的神经策略。未来的研究应探讨这些差异会如何影响未来基于 AR 的培训项目的表现和用户体验。
{"title":"Learning across Diverse Training Modalities is Different across Gender: Insights from a Neuroergonomics Approach","authors":"John Hayes, Shivangi Dwivedi, Isabella Pedron, Joe Gabbard, Ranjana K. Mehta","doi":"10.1177/21695067231205572","DOIUrl":"https://doi.org/10.1177/21695067231205572","url":null,"abstract":"Recent challenges such as COVID-19 call for innovative methods of delivering training. In this study, we compare the effectiveness of augmented reality (AR) based psychomotor learning compared to videobased training. Participants completed either AR or video training to learn four basic AR interactions, before completing an AR evaluation. The AR group reported greater workload during training but demonstrated better performance during evaluation. We used functional near infrared spectroscopy (fNIRS) to compare brain activation and functional connectivity across groups during evaluation. We found that participants in the AR group displayed smaller brain networks during the evaluation, suggesting more efficient utilization of neural resources. Sex differences in activation and connectivity suggest that men and women potentially employ different neural strategies while learning motor skills in AR. Future studies should examine how these differences could impact performance and user experience in future AR-based training programs.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"1 1","pages":"2558 - 2559"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231194321
Jacquelyn A. Schreck, Eric Sikorski, Michael King
This paper presents practical lessons learned for conducting field research based on challenges faced during a complex field study. Communication between soldiers was captured via audio recorders as Army squads conducted simulated battle drills. The communication data provided critical information regarding squad performance in a realistic context that would not have been obtainable in a lab environment. The field study, despite intensive preparation, presented unforeseen issues requiring both short-term and long-term solutions. Issues were encountered with the environment, data collection, and data handling, which were able to be dealt with in real-time because we were adequately prepared. Preparations, challenges with specific examples, and universal lessons learned that can be applied to other field studies are discussed.
{"title":"I thought we tested that!: Lessons learned from a team communications field study","authors":"Jacquelyn A. Schreck, Eric Sikorski, Michael King","doi":"10.1177/21695067231194321","DOIUrl":"https://doi.org/10.1177/21695067231194321","url":null,"abstract":"This paper presents practical lessons learned for conducting field research based on challenges faced during a complex field study. Communication between soldiers was captured via audio recorders as Army squads conducted simulated battle drills. The communication data provided critical information regarding squad performance in a realistic context that would not have been obtainable in a lab environment. The field study, despite intensive preparation, presented unforeseen issues requiring both short-term and long-term solutions. Issues were encountered with the environment, data collection, and data handling, which were able to be dealt with in real-time because we were adequately prepared. Preparations, challenges with specific examples, and universal lessons learned that can be applied to other field studies are discussed.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"7 1","pages":"86 - 90"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192877
K. Tabattanon, Emily Nakisher, Ekim Koca, Bernard J.
Environmental interventions provide a promising opportunity to support inclusive mobility in our rapidly changing society and workforce. Concurrently, the trends for aging into mobility disability, working into older age, and health and economic burdens of unpaid caregiving continue to rise. Hence, providing equitable mobility for all is an urgent need. In the context of manual wheelchair control, a novel method investigating the impact of environmental interventions on individual’s internal representation of motor actions is proposed. In addition to measuring objective and subjective performance metrics, we propose that an understanding of how internal representations of tasks are influenced by user perception of the environment has promising potential towards informing effective and inclusive task-environment interactions. The application explored in this pilot study aims to facilitate mobility.
{"title":"Environmental Intervention Evaluation to Support Motor Planning of Wheelchair Movements: A Pilot Study","authors":"K. Tabattanon, Emily Nakisher, Ekim Koca, Bernard J.","doi":"10.1177/21695067231192877","DOIUrl":"https://doi.org/10.1177/21695067231192877","url":null,"abstract":"Environmental interventions provide a promising opportunity to support inclusive mobility in our rapidly changing society and workforce. Concurrently, the trends for aging into mobility disability, working into older age, and health and economic burdens of unpaid caregiving continue to rise. Hence, providing equitable mobility for all is an urgent need. In the context of manual wheelchair control, a novel method investigating the impact of environmental interventions on individual’s internal representation of motor actions is proposed. In addition to measuring objective and subjective performance metrics, we propose that an understanding of how internal representations of tasks are influenced by user perception of the environment has promising potential towards informing effective and inclusive task-environment interactions. The application explored in this pilot study aims to facilitate mobility.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"30 1","pages":"321 - 326"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192217
Cherin Lim, Prashanth Rajivan
Modern vehicles have evolved into intelligent and autonomous transportation systems, yet such computer-driven developments also create opportunities for unforeseen cyber-security attacks on self-driving cars. These threats may pose critical risks to human lives but there is a considerable lack of understanding in designing vehicle systems to support driver response during rare and hazardous security events. We conducted an interview with autonomous vehicle drivers to understand their perception of automotive threats and design needs for effective response during security events. Results show that drivers expect information relating to malfunction detection, trouble-shooting instructions, and log data from the vehicle. Moreover, drivers were more likely to act based on instincts the more the driver perceives the threat to be urgent, rather than process the situation during the initial stages of an attack. We thus propose a ‘Driver Response Phase’ and corresponding design implications for future vehicles that support user response to security risks.
{"title":"Who Hacked My Car? Designing Autonomous Vehicles to Support Driver Response to Security Threats","authors":"Cherin Lim, Prashanth Rajivan","doi":"10.1177/21695067231192217","DOIUrl":"https://doi.org/10.1177/21695067231192217","url":null,"abstract":"Modern vehicles have evolved into intelligent and autonomous transportation systems, yet such computer-driven developments also create opportunities for unforeseen cyber-security attacks on self-driving cars. These threats may pose critical risks to human lives but there is a considerable lack of understanding in designing vehicle systems to support driver response during rare and hazardous security events. We conducted an interview with autonomous vehicle drivers to understand their perception of automotive threats and design needs for effective response during security events. Results show that drivers expect information relating to malfunction detection, trouble-shooting instructions, and log data from the vehicle. Moreover, drivers were more likely to act based on instincts the more the driver perceives the threat to be urgent, rather than process the situation during the initial stages of an attack. We thus propose a ‘Driver Response Phase’ and corresponding design implications for future vehicles that support user response to security risks.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"93 1","pages":"247 - 252"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231210845
Alesawy N., Halim P., Nadai M., Son J., Davis S., Teixeira C., Nelson T., Wang A., Holliman-Lopez G., Alesawy S., Stirling L.
Augmented reality (AR) technology faces a prevailing challenge when dealing with harsh lighting environments, which are common in space. The study aims to evaluate the lighting compatibility for successful hand gestures using HoloLens 2, a device that utilizes AR technology for heads-up displays (HUDs), as a potential way to provide critical information to astronauts during extravehicular activities (EVAs). The study modulated luminance (dim, neutral, bright) and hand coverings (bare hand, white glove, black glove) to determine the HoloLens functionality. The results will inform design changes to support the astronaut experience by enhancing hand gesture recognition and reducing time wasted re-gesturing. By understanding the lighting requirements for HoloLens, we can improve the AR experience for future space missions. This study highlights the importance of considering lighting conditions in the development of AR technology, especially in challenging environments like space.
增强现实(AR)技术在应对太空中常见的恶劣照明环境时面临着普遍挑战。这项研究旨在评估使用 HoloLens 2 成功做出手势的照明兼容性,HoloLens 2 是一种利用 AR 技术的平视显示器(HUD)设备,是在舱外活动(EVA)期间向宇航员提供关键信息的一种潜在方式。这项研究通过调节亮度(昏暗、中性、明亮)和手部覆盖物(裸手、白手套、黑手套)来确定 HoloLens 的功能。研究结果将为设计变更提供信息,以通过增强手势识别和减少重新比划所浪费的时间来支持宇航员的体验。通过了解 HoloLens 的照明要求,我们可以改善未来太空任务的 AR 体验。这项研究强调了在开发 AR 技术时考虑照明条件的重要性,尤其是在太空这样充满挑战的环境中。
{"title":"Illuminating the augmented reality stage: Assessment of lighting conditions for space exploration","authors":"Alesawy N., Halim P., Nadai M., Son J., Davis S., Teixeira C., Nelson T., Wang A., Holliman-Lopez G., Alesawy S., Stirling L.","doi":"10.1177/21695067231210845","DOIUrl":"https://doi.org/10.1177/21695067231210845","url":null,"abstract":"Augmented reality (AR) technology faces a prevailing challenge when dealing with harsh lighting environments, which are common in space. The study aims to evaluate the lighting compatibility for successful hand gestures using HoloLens 2, a device that utilizes AR technology for heads-up displays (HUDs), as a potential way to provide critical information to astronauts during extravehicular activities (EVAs). The study modulated luminance (dim, neutral, bright) and hand coverings (bare hand, white glove, black glove) to determine the HoloLens functionality. The results will inform design changes to support the astronaut experience by enhancing hand gesture recognition and reducing time wasted re-gesturing. By understanding the lighting requirements for HoloLens, we can improve the AR experience for future space missions. This study highlights the importance of considering lighting conditions in the development of AR technology, especially in challenging environments like space.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"442 1","pages":"2571 - 2576"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139345932","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}