Steven Yoo, Casper Harteveld, Nicholas Wilson, Kemi Jona, Mohsen Moghaddam
{"title":"Exploring Dimensions of Expertise in AR-Guided Psychomotor Tasks","authors":"Steven Yoo, Casper Harteveld, Nicholas Wilson, Kemi Jona, Mohsen Moghaddam","doi":"arxiv-2409.11599","DOIUrl":null,"url":null,"abstract":"This study aimed to explore how novices and experts differ in performing\ncomplex psychomotor tasks guided by augmented reality (AR), focusing on\ndecision-making and technical proficiency. Participants were divided into\nnovice and expert groups based on a pre-questionnaire assessing their technical\nskills and theoretical knowledge of precision inspection. Participants\ncompleted a post-study questionnaire that evaluated cognitive load (NASA-TLX),\nself-efficacy, and experience with the HoloLens 2 and AR app, along with\ngeneral feedback. We used multimodal data from AR devices and wearables,\nincluding hand tracking, galvanic skin response, and gaze tracking, to measure\nkey performance metrics. We found that experts significantly outperformed\nnovices in decision-making speed, efficiency, accuracy, and dexterity in the\nexecution of technical tasks. Novices exhibited a positive correlation between\nperceived performance in the NASA-TLX and the GSR amplitude, indicating that\nhigher perceived performance is associated with increased physiological stress\nresponses. This study provides a foundation for designing multidimensional\nexpertise estimation models to enable personalized industrial AR training\nsystems.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"8 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Human-Computer Interaction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.11599","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This study aimed to explore how novices and experts differ in performing
complex psychomotor tasks guided by augmented reality (AR), focusing on
decision-making and technical proficiency. Participants were divided into
novice and expert groups based on a pre-questionnaire assessing their technical
skills and theoretical knowledge of precision inspection. Participants
completed a post-study questionnaire that evaluated cognitive load (NASA-TLX),
self-efficacy, and experience with the HoloLens 2 and AR app, along with
general feedback. We used multimodal data from AR devices and wearables,
including hand tracking, galvanic skin response, and gaze tracking, to measure
key performance metrics. We found that experts significantly outperformed
novices in decision-making speed, efficiency, accuracy, and dexterity in the
execution of technical tasks. Novices exhibited a positive correlation between
perceived performance in the NASA-TLX and the GSR amplitude, indicating that
higher perceived performance is associated with increased physiological stress
responses. This study provides a foundation for designing multidimensional
expertise estimation models to enable personalized industrial AR training
systems.
本研究旨在探索新手和专家在执行由增强现实(AR)引导的复杂心理运动任务时有何不同,重点关注决策制定和技术熟练程度。根据评估技术技能和精密检测理论知识的前置问卷,参与者被分为新手组和专家组。参与者填写了一份研究后问卷,评估认知负荷(NASA-TLX)、自我效能、使用 HoloLens 2 和 AR 应用程序的经验以及一般反馈。我们使用来自 AR 设备和可穿戴设备的多模态数据(包括手部跟踪、皮肤电反应和注视跟踪)来测量关键的性能指标。我们发现,在执行技术任务时,专家在决策速度、效率、准确性和灵巧性方面都明显优于新手。新手在NASA-TLX中的感知表现与GSR振幅呈正相关,这表明较高的感知表现与生理压力反应的增加有关。这项研究为设计多维度技能估计模型奠定了基础,从而实现个性化的工业AR培训系统。