首页 > 最新文献

IEEE Transactions on Human-Machine Systems最新文献

英文 中文
Fusion of Temporal Transformer and Spatial Graph Convolutional Network for 3-D Skeleton-Parts-Based Human Motion Prediction 融合时空变换器和空间图卷积网络,实现基于三维骨骼-部件的人体运动预测
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-09-11 DOI: 10.1109/thms.2024.3452133
Mayank Lovanshi, Vivek Tiwari, Rajesh Ingle, Swati Jain
{"title":"Fusion of Temporal Transformer and Spatial Graph Convolutional Network for 3-D Skeleton-Parts-Based Human Motion Prediction","authors":"Mayank Lovanshi, Vivek Tiwari, Rajesh Ingle, Swati Jain","doi":"10.1109/thms.2024.3452133","DOIUrl":"https://doi.org/10.1109/thms.2024.3452133","url":null,"abstract":"","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design of a Robotic System Featured With High Operation Transparency for Quantifying Arm Impedance During Ultrasound Scanning 设计操作透明度高的机器人系统,用于在超声波扫描过程中量化手臂阻抗
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-09-10 DOI: 10.1109/thms.2024.3442537
Baoshan Niu, Dapeng Yang, Yangjunjian Zhou, Le Zhang, Qi Huang, Yikun Gu
{"title":"Design of a Robotic System Featured With High Operation Transparency for Quantifying Arm Impedance During Ultrasound Scanning","authors":"Baoshan Niu, Dapeng Yang, Yangjunjian Zhou, Le Zhang, Qi Huang, Yikun Gu","doi":"10.1109/thms.2024.3442537","DOIUrl":"https://doi.org/10.1109/thms.2024.3442537","url":null,"abstract":"","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development of a MR Training System for Living Donor Liver Transplantation Using Simulated Liver Phantom and ICP Tracking Technology 利用模拟肝脏模型和 ICP 跟踪技术开发活体肝脏移植 MR 培训系统
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-09-10 DOI: 10.1109/thms.2024.3450689
Tsung-Han Yang, Yi-Chun Du, Cheng-Bin Xu, Wei-Siang Ciou
{"title":"Development of a MR Training System for Living Donor Liver Transplantation Using Simulated Liver Phantom and ICP Tracking Technology","authors":"Tsung-Han Yang, Yi-Chun Du, Cheng-Bin Xu, Wei-Siang Ciou","doi":"10.1109/thms.2024.3450689","DOIUrl":"https://doi.org/10.1109/thms.2024.3450689","url":null,"abstract":"","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199164","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Layered Modeling of Affective, Perception, and Visual Properties: Optimizing Structure With Genetic Algorithm 情感、感知和视觉特性的分层建模:利用遗传算法优化结构
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-08-30 DOI: 10.1109/THMS.2024.3434573
Shuhei Watanabe;Takahiko Horiuchi
To design the “Kansei value” aspect of a product, it is useful to design multilayered relationships of perceptual and affective responses via the physical or psychophysical properties of the product. However, because they are qualitative and ambiguous, designing a model is time-consuming. Moreover, the design was conducted by hypothesis and trial-and-error by the experimenter. In this article, we developed a method to automatically construct several semioptimal structures by applying a genetic algorithm to model design based on structural equation modeling, using the results of image measurement and subjective evaluation experiments on various material samples. Under set convergence conditions, the method constructed statistically optimized structures that represent the relationships among adjectives describing perception and affective, and the properties. A semantic validation was performed to determine the final model. As a result, the proposed method could be used to construct a model that can be interpreted as semantically and statistically superior compared to methods in related studies. A unique feature of this article was the use of the physical and psychophysical properties obtained by measurements in the construction of a multilayer model. Also, the advantage of this method is that it can be used to construct important structures that may be overlooked.
要设计产品的 "关西价值",可以通过产品的物理或心理物理特性来设计感知和情感反应的多层关系。然而,由于它们是定性的、模糊的,因此设计模型非常耗时。而且,设计是通过假设和实验者的试错来进行的。在本文中,我们开发了一种基于结构方程建模的方法,通过将遗传算法应用于模型设计,利用对各种材料样本进行图像测量和主观评价实验的结果,自动构建若干半优化结构。在设定的收敛条件下,该方法构建了统计优化结构,这些结构代表了描述感知和情感的形容词与属性之间的关系。通过语义验证确定了最终模型。因此,与相关研究中的方法相比,所提出的方法可用于构建一个在语义和统计上都更优越的模型。本文的一个独特之处是在构建多层模型时使用了通过测量获得的物理和心理物理特性。此外,这种方法的优点还在于可以用来构建可能被忽视的重要结构。
{"title":"Layered Modeling of Affective, Perception, and Visual Properties: Optimizing Structure With Genetic Algorithm","authors":"Shuhei Watanabe;Takahiko Horiuchi","doi":"10.1109/THMS.2024.3434573","DOIUrl":"10.1109/THMS.2024.3434573","url":null,"abstract":"To design the “Kansei value” aspect of a product, it is useful to design multilayered relationships of perceptual and affective responses via the physical or psychophysical properties of the product. However, because they are qualitative and ambiguous, designing a model is time-consuming. Moreover, the design was conducted by hypothesis and trial-and-error by the experimenter. In this article, we developed a method to automatically construct several semioptimal structures by applying a genetic algorithm to model design based on structural equation modeling, using the results of image measurement and subjective evaluation experiments on various material samples. Under set convergence conditions, the method constructed statistically optimized structures that represent the relationships among adjectives describing perception and affective, and the properties. A semantic validation was performed to determine the final model. As a result, the proposed method could be used to construct a model that can be interpreted as semantically and statistically superior compared to methods in related studies. A unique feature of this article was the use of the physical and psychophysical properties obtained by measurements in the construction of a multilayer model. Also, the advantage of this method is that it can be used to construct important structures that may be overlooked.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
To Err is Automation: Can Trust be Repaired by the Automated Driving System After its Failure? 错误就是自动化:自动驾驶系统失灵后能否修复信任?
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-08-13 DOI: 10.1109/THMS.2024.3434680
Peng Liu;Yueying Chu;Guanqun Wang;Zhigang Xu
Failures of the automated driving system (ADS) in automated vehicles (AVs) can damage driver–ADS cooperation (e.g., causing trust damage) and traffic safety. Researchers suggest infusing a human-like ability, active trust repair, into automated systems, to mitigate broken trust and other negative impacts resulting from their failures. Trust repair is regarded as a key ergonomic design in automated systems. Trust repair strategies (e.g., apology) are examined and supported by some evidence in controlled environments, however, rarely subjected to empirical evaluations in more naturalistic environments. To fill this gap, we conducted a test track study, invited participants (N = 257) to experience an ADS failure, and tested the influence of the ADS’ trust repair on trust and other psychological responses. Half of participants (n = 128) received the ADS’ verbal message (consisting of apology, explanation, and promise) by a human voice (n = 63) or by Apple's Siri (n = 65) after its failure. We measured seven psychological responses to AVs and ADS [e.g., trust and behavioral intention (BI)]. We found that both strategies cannot repair damaged trust. The human-voice-repair strategy can to some degree mitigate other detrimental influences (e.g., reductions in BI) resulting from the ADS failure, but this effect is only notable among participants without substantial driving experience. It points to the importance of conducting ecologically valid and field studies for validating human-like trust repair strategies in human–automation interaction and of developing trust repair strategies specific to safety-critical situations.
自动驾驶汽车(AV)中自动驾驶系统(ADS)的故障会损害驾驶员与自动驾驶系统之间的合作(例如,造成信任受损)和交通安全。研究人员建议在自动驾驶系统中注入一种类似于人类的能力--主动信任修复,以减轻信任缺失和系统故障造成的其他负面影响。信任修复被认为是自动化系统中一项关键的人机工程学设计。信任修复策略(如道歉)在受控环境中得到了研究和一些证据的支持,但很少在更自然的环境中进行实证评估。为了填补这一空白,我们进行了一项测试跟踪研究,邀请参与者(257 人)体验一次自动驾驶辅助系统故障,并测试自动驾驶辅助系统的信任修复对信任和其他心理反应的影响。半数参与者(n = 128)在自动驾驶汽车出现故障后收到了由人工声音(n = 63)或苹果 Siri(n = 65)发出的口头信息(包括道歉、解释和承诺)。我们测量了对 AV 和 ADS 的七种心理反应[如信任和行为意向(BI)]。我们发现,这两种策略都无法修复受损的信任。人工语音修复策略可以在一定程度上缓解因自动驾驶辅助系统故障造成的其他不利影响(如行为意向的降低),但这种效果只在没有丰富驾驶经验的参与者中明显。这表明,在人机交互过程中进行生态验证和实地研究以验证类似人类的信任修复策略,以及开发专门针对安全关键情况的信任修复策略非常重要。
{"title":"To Err is Automation: Can Trust be Repaired by the Automated Driving System After its Failure?","authors":"Peng Liu;Yueying Chu;Guanqun Wang;Zhigang Xu","doi":"10.1109/THMS.2024.3434680","DOIUrl":"10.1109/THMS.2024.3434680","url":null,"abstract":"Failures of the automated driving system (ADS) in automated vehicles (AVs) can damage driver–ADS cooperation (e.g., causing trust damage) and traffic safety. Researchers suggest infusing a human-like ability, active trust repair, into automated systems, to mitigate broken trust and other negative impacts resulting from their failures. Trust repair is regarded as a key ergonomic design in automated systems. Trust repair strategies (e.g., apology) are examined and supported by some evidence in controlled environments, however, rarely subjected to empirical evaluations in more naturalistic environments. To fill this gap, we conducted a test track study, invited participants (\u0000<italic>N</i>\u0000 = 257) to experience an ADS failure, and tested the influence of the ADS’ trust repair on trust and other psychological responses. Half of participants (\u0000<italic>n</i>\u0000 = 128) received the ADS’ verbal message (consisting of apology, explanation, and promise) by a human voice (\u0000<italic>n</i>\u0000 = 63) or by Apple's Siri (\u0000<italic>n</i>\u0000 = 65) after its failure. We measured seven psychological responses to AVs and ADS [e.g., trust and behavioral intention (BI)]. We found that both strategies cannot repair damaged trust. The human-voice-repair strategy can to some degree mitigate other detrimental influences (e.g., reductions in BI) resulting from the ADS failure, but this effect is only notable among participants without substantial driving experience. It points to the importance of conducting ecologically valid and field studies for validating human-like trust repair strategies in human–automation interaction and of developing trust repair strategies specific to safety-critical situations.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimating Perceived Mental Workload From Eye-Tracking Data Based on Benign Anisocoria 根据眼球跟踪数据估算良性眼球异位症患者的心理工作量
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-08-07 DOI: 10.1109/THMS.2024.3432864
Suvodip Chakraborty;Peter Kiefer;Martin Raubal
From the initial phases of human–computer interaction, where the computer was unaware of the users' mental states, we are now progressing toward cognition-aware user interfaces. One crucial cognitive state considered by research on cognition-aware user interfaces is the cognitive load. Eye-tracking has been suggested as one particularly unobtrusive method for estimating cognitive load. Although the accuracy of cognitive load detection has improved in recent work, it is still insufficient for cognition-aware user interfaces, which require high accuracy for getting accepted by the user. This article introduces two new eye-tracking metrics for estimating perceived cognitive load based on benign anisocoria (BA). Unlike previous pupil-based metrics, our metrics are based on pupil size asymmetry between the left and right eye. As a case study, we illustrate the effectiveness of the proposed metrics on a recently published eye-tracking dataset recorded under laboratory conditions. The results show that our proposed features based on BA can improve the performance of classifiers for detecting the perceived mental workload associated with an $N$-back test. The best classification accuracy was 84.24% while the classification accuracy in the absence of the proposed features was 81.91% for the light gradient boosting classifier.
在人机交互的最初阶段,计算机对用户的心理状态一无所知,而现在,我们正朝着认知感知用户界面的方向迈进。认知感知用户界面研究考虑的一个关键认知状态是认知负荷。眼球跟踪被认为是估算认知负荷的一种特别不显眼的方法。虽然认知负荷检测的准确度在最近的研究中有所提高,但对于认知感知用户界面来说仍然不够,因为用户界面需要高准确度才能被用户接受。本文介绍了两种新的眼动跟踪指标,用于估计基于良性异视(BA)的感知认知负荷。与以往基于瞳孔的指标不同,我们的指标基于左右眼瞳孔大小的不对称。作为一项案例研究,我们在最近发布的实验室条件下记录的眼动数据集上说明了所提指标的有效性。结果表明,我们提出的基于 BA 的特征可以提高分类器在检测与 N$-back 测试相关的感知脑力劳动负荷时的性能。光梯度提升分类器的最佳分类准确率为 84.24%,而在没有使用所提出特征的情况下,分类准确率为 81.91%。
{"title":"Estimating Perceived Mental Workload From Eye-Tracking Data Based on Benign Anisocoria","authors":"Suvodip Chakraborty;Peter Kiefer;Martin Raubal","doi":"10.1109/THMS.2024.3432864","DOIUrl":"10.1109/THMS.2024.3432864","url":null,"abstract":"From the initial phases of human–computer interaction, where the computer was unaware of the users' mental states, we are now progressing toward cognition-aware user interfaces. One crucial cognitive state considered by research on cognition-aware user interfaces is the cognitive load. Eye-tracking has been suggested as one particularly unobtrusive method for estimating cognitive load. Although the accuracy of cognitive load detection has improved in recent work, it is still insufficient for cognition-aware user interfaces, which require high accuracy for getting accepted by the user. This article introduces two new eye-tracking metrics for estimating perceived cognitive load based on benign anisocoria (BA). Unlike previous pupil-based metrics, our metrics are based on pupil size asymmetry between the left and right eye. As a case study, we illustrate the effectiveness of the proposed metrics on a recently published eye-tracking dataset recorded under laboratory conditions. The results show that our proposed features based on BA can improve the performance of classifiers for detecting the perceived mental workload associated with an \u0000<inline-formula><tex-math>$N$</tex-math></inline-formula>\u0000-back test. The best classification accuracy was 84.24% while the classification accuracy in the absence of the proposed features was 81.91% for the light gradient boosting classifier.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10629234","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141931222","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Responses to External Repeated Perturbations Vary With Time Intervals 对外部重复扰动的响应随时间间隔而变化
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-08-02 DOI: 10.1109/THMS.2024.3426302
Dongwon Kim;Jong-Moon Hwang
It is generally accepted that stimuli with different time intervals lead to different contributions of relevant learning substrates. We investigated postural responses in men to trains of perturbations with different time intervals. A total of 12 male volunteers with no neurological deficits (age: 33.33±3.12 S.D.) experienced a sequence of perturbations. Two sequences of perturbations by a translational plate to still standing participants in the anterior-posterior direction were designed and administered: the first sequence consisted of 24 repeated perturbations with an interval of 5 s, while the second sequence consisted of ones with an interval of 2.5 s. A perturbation of a smaller magnitude was inserted into each sequence as a catch trial. We found that while a shorter interval and a longer interval both led to the learning effect (P < 0.05), a shorter interval results in a stiff strategy, presumably through muscle cocontraction, minimizing the degree of body sway. The learned motor response continued after experiencing the catch trial (P < 0.05). The results imply that stimulus intervals could lead to a different adaptation mechanism in the neuromotor system in the way to regain postural stability. Also, our results suggest that training for male individuals with repetition of postural perturbations with a shorter time interval leads to a stiff strategy with a greater degree. A stiff strategy could lower the ability to cope with unexpected postural threats, possibly leading to falls.
一般认为,不同时间间隔的刺激会导致相关学习底物的不同贡献。我们研究了男性对不同时间间隔的扰动序列的姿势反应。共有 12 名无神经障碍的男性志愿者(年龄:33.33±3.12 S.D.)经历了一连串的扰动。我们设计并实施了两个由平移板沿前后方向对静止参与者进行扰动的序列:第一个序列由 24 次重复扰动组成,每次间隔 5 秒钟;第二个序列由每次间隔 2.5 秒钟的扰动组成。我们发现,虽然较短的间隔和较长的间隔都会导致学习效果(P < 0.05),但较短的间隔会导致一种僵硬的策略,可能是通过肌肉共收缩,将身体摇摆的程度降到最低。在经历捕捉试验后,学习到的运动反应仍在继续(P < 0.05)。这些结果表明,在恢复姿势稳定性的过程中,刺激间隔可能会导致神经运动系统产生不同的适应机制。此外,我们的结果还表明,以较短的时间间隔对男性个体进行重复姿势扰动训练,会导致更大程度的僵硬策略。僵硬策略可能会降低应对意外姿势威胁的能力,从而可能导致跌倒。
{"title":"Responses to External Repeated Perturbations Vary With Time Intervals","authors":"Dongwon Kim;Jong-Moon Hwang","doi":"10.1109/THMS.2024.3426302","DOIUrl":"10.1109/THMS.2024.3426302","url":null,"abstract":"It is generally accepted that stimuli with different time intervals lead to different contributions of relevant learning substrates. We investigated postural responses in men to trains of perturbations with different time intervals. A total of 12 male volunteers with no neurological deficits (age: 33.33±3.12 S.D.) experienced a sequence of perturbations. Two sequences of perturbations by a translational plate to still standing participants in the anterior-posterior direction were designed and administered: the first sequence consisted of 24 repeated perturbations with an interval of 5 s, while the second sequence consisted of ones with an interval of 2.5 s. A perturbation of a smaller magnitude was inserted into each sequence as a catch trial. We found that while a shorter interval and a longer interval both led to the learning effect (P < 0.05), a shorter interval results in a stiff strategy, presumably through muscle cocontraction, minimizing the degree of body sway. The learned motor response continued after experiencing the catch trial (P < 0.05). The results imply that stimulus intervals could lead to a different adaptation mechanism in the neuromotor system in the way to regain postural stability. Also, our results suggest that training for male individuals with repetition of postural perturbations with a shorter time interval leads to a stiff strategy with a greater degree. A stiff strategy could lower the ability to cope with unexpected postural threats, possibly leading to falls.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141886117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ARMedicalSketch: Exploring 3D Sketching for Medical Image Using True 2D-3D Interlinked Visualization and Interaction ARMedicalSketch:探索使用真正的 2D-3D 互联可视化和交互技术绘制医学图像的 3D 草图
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-08-02 DOI: 10.1109/THMS.2024.3432735
Nan Zhang;Tianqi Huang;Hongen Liao
In traditional clinical practice, doctors often have to deal with 3D information based on 2D-displayed medical images. There is a considerable mismatch between the 2D and 3D dimensions in image interaction during clinical diagnosis, making image manipulation challenging and time-consuming. In this study, we explored 3D sketching for medical images using true 2D-3D interlinked visualization and interaction, presenting a novel AR environment named ARMedicalSketch. It supports image display enhancement preprocessing and 3D interaction tasks for original 3D medical images. Our interaction interface, based on 3D autostereoscopic display technology, provides both floating 3D display and 2D tablet display while enabling glasses-free visualization. We presented a method of 2D-3D interlinked visualization and interaction, employing synchronized projection visualization and a virtual synchronized interactive plane to establish an integrated relationship between 2D and 3D displays. Additionally, we utilized gesture sensors and a 2D touch tablet to capture the user's hand information for convenient interaction. We constructed the prototype and conducted a user study involving 23 students and 2 clinical experts. The controlled study compared our proposed system with a 2D display prototype, showing enhanced efficiency in interacting with medical images while maintaining 2D interaction accuracy, particularly in tasks involving strong 3D spatial correlation. In the future, we aim to further enhance the interaction precision and application scenarios of ARMedicalSketch.
在传统临床实践中,医生往往需要根据二维显示的医学图像处理三维信息。在临床诊断过程中,图像交互的 2D 和 3D 维度之间存在相当大的不匹配,使得图像处理变得具有挑战性且耗时。在这项研究中,我们利用真正的 2D-3D 互联可视化和交互技术探索了医学图像的 3D 草图绘制,并提出了一种名为 ARMedicalSketch 的新型 AR 环境。它支持原始三维医学图像的图像显示增强预处理和三维交互任务。我们的交互界面基于三维自动立体显示技术,可提供浮动三维显示和二维平板显示,同时实现裸眼可视化。我们提出了一种 2D-3D 互联可视化和交互方法,采用同步投影可视化和虚拟同步交互平面来建立 2D 和 3D 显示屏之间的集成关系。此外,我们还利用手势传感器和二维触摸板来捕捉用户的手部信息,从而实现便捷的交互。我们制作了原型并进行了用户研究,共有 23 名学生和 2 名临床专家参与。对照研究将我们提出的系统与二维显示器原型进行了比较,结果表明,在保持二维交互准确性的同时,我们提高了与医学图像交互的效率,尤其是在涉及三维空间相关性较强的任务中。未来,我们的目标是进一步提高 ARMedicalSketch 的交互精度和应用场景。
{"title":"ARMedicalSketch: Exploring 3D Sketching for Medical Image Using True 2D-3D Interlinked Visualization and Interaction","authors":"Nan Zhang;Tianqi Huang;Hongen Liao","doi":"10.1109/THMS.2024.3432735","DOIUrl":"10.1109/THMS.2024.3432735","url":null,"abstract":"In traditional clinical practice, doctors often have to deal with 3D information based on 2D-displayed medical images. There is a considerable mismatch between the 2D and 3D dimensions in image interaction during clinical diagnosis, making image manipulation challenging and time-consuming. In this study, we explored 3D sketching for medical images using true 2D-3D interlinked visualization and interaction, presenting a novel AR environment named ARMedicalSketch. It supports image display enhancement preprocessing and 3D interaction tasks for original 3D medical images. Our interaction interface, based on 3D autostereoscopic display technology, provides both floating 3D display and 2D tablet display while enabling glasses-free visualization. We presented a method of 2D-3D interlinked visualization and interaction, employing synchronized projection visualization and a virtual synchronized interactive plane to establish an integrated relationship between 2D and 3D displays. Additionally, we utilized gesture sensors and a 2D touch tablet to capture the user's hand information for convenient interaction. We constructed the prototype and conducted a user study involving 23 students and 2 clinical experts. The controlled study compared our proposed system with a 2D display prototype, showing enhanced efficiency in interacting with medical images while maintaining 2D interaction accuracy, particularly in tasks involving strong 3D spatial correlation. In the future, we aim to further enhance the interaction precision and application scenarios of ARMedicalSketch.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141886116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Emotion Recognition of Playing Musicians From EEG, ECG, and Acoustic Signals 从脑电图、心电图和声学信号识别演奏音乐家的情绪
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-08-01 DOI: 10.1109/THMS.2024.3430327
Luca Turchet;Barry O'Sullivan;Rupert Ortner;Christoph Guger
This article investigated the automatic recognition of felt and musically communicated emotions using electroencephalogram (EEG), electrocardiogram (ECG), and acoustic signals, which were recorded from eleven musicians instructed to perform music in order to communicate happiness, sadness, relaxation, and anger. Musicians' self-reports indicated that the emotions they musically expressed were highly consistent with those they actually felt. Results showed that the best classification performances, in a subject-dependent classification using a KNN classifier were achieved by using features derived from both the EEG and ECG (with an accuracy of 98.11%). Which was significantly more accurate than using ECG features alone, but was not significantly more accurate than using EEG features alone. The use of acoustic features alone or in combination with EEG and/or ECG features did not lead to better performances than those achieved with EEG plus ECG or EEG alone. Our results suggest that emotion detection of playing musicians, both felt and musically communicated, when coherent, can be classified in a more reliable way using physiological features than involving acoustic features. The reported machine learning results are a step toward the development of affective brain–computer interfaces capable of automatically inferring the emotions of a playing musician in real-time.
这篇文章利用脑电图(EEG)、心电图(ECG)和声学信号研究了感受到的情绪和音乐传达的情绪的自动识别,这些信号是由 11 位音乐家录制的,他们被要求演奏音乐以传达快乐、悲伤、放松和愤怒。音乐家的自我报告表明,他们用音乐表达的情绪与他们的实际感受高度一致。结果显示,在使用 KNN 分类器进行的受试者分类中,同时使用脑电图和心电图特征的分类效果最好(准确率达 98.11%)。其准确率明显高于单独使用心电图特征的准确率,但并不明显高于单独使用脑电图特征的准确率。单独使用声学特征或将声学特征与脑电图和/或心电图特征结合使用,都不会比使用脑电图和心电图或单独使用脑电图时取得更好的效果。我们的研究结果表明,在连贯的情况下,使用生理特征比使用声学特征能更可靠地分类演奏音乐家的情绪检测,包括感觉和音乐交流。所报告的机器学习结果为开发能够实时自动推断演奏音乐家情绪的情感脑机接口迈出了一步。
{"title":"Emotion Recognition of Playing Musicians From EEG, ECG, and Acoustic Signals","authors":"Luca Turchet;Barry O'Sullivan;Rupert Ortner;Christoph Guger","doi":"10.1109/THMS.2024.3430327","DOIUrl":"10.1109/THMS.2024.3430327","url":null,"abstract":"This article investigated the automatic recognition of felt and musically communicated emotions using electroencephalogram (EEG), electrocardiogram (ECG), and acoustic signals, which were recorded from eleven musicians instructed to perform music in order to communicate happiness, sadness, relaxation, and anger. Musicians' self-reports indicated that the emotions they musically expressed were highly consistent with those they actually felt. Results showed that the best classification performances, in a subject-dependent classification using a KNN classifier were achieved by using features derived from both the EEG and ECG (with an accuracy of 98.11%). Which was significantly more accurate than using ECG features alone, but was not significantly more accurate than using EEG features alone. The use of acoustic features alone or in combination with EEG and/or ECG features did not lead to better performances than those achieved with EEG plus ECG or EEG alone. Our results suggest that emotion detection of playing musicians, both felt and musically communicated, when coherent, can be classified in a more reliable way using physiological features than involving acoustic features. The reported machine learning results are a step toward the development of affective brain–computer interfaces capable of automatically inferring the emotions of a playing musician in real-time.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10620218","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141886137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
User Characteristics and Their Impact on the Perceived Usable Security of Physical Authentication Devices 用户特征及其对物理认证设备可用安全性的影响
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-24 DOI: 10.1109/THMS.2024.3421538
Jongkil Jay Jeong;Syed Wajid Ali Shah;Ashish Nanda;Robin Doss;Mohammad Nosouhi;Jeb Webb
Physical authentication devices (PADs) offer a higher level of security than other authentication technologies commonly used in multifactor authentication (MFA) schemes because they are much less vulnerable to attack. However, PAD uptake remains significantly lower than that for SMS and app-based approaches, accounting for only 10% of all authentication technologies currently being utilized in MFA. Prior studies indicate that the primary reason for this low adoption rate is due to negative users' perceptions and attitudes toward the usability of PADs; many of these studies often skew toward a particular set of users (e.g., young university students, etc.), often creating a bias toward what usable security entails. To address this limitation, we have formulated an original research methodology that segments users into specific groups based on their user characteristics (i.e., age, education, and experience) and examines how each group defines usability and ranks their preferences regarding certain security features. Based on a survey of 410 participants, our results indicate that there are indeed different usable security preferences for each user group, and we, therefore, provide recommendations on how existing PADs might be enhanced to support usability and improve adoption rates.
与多因素身份验证(MFA)方案中常用的其他身份验证技术相比,物理身份验证设备(PAD)具有更高的安全性,因为它们更不易受到攻击。然而,与基于短信和应用程序的方法相比,物理身份验证设备的使用率仍然很低,只占目前多因素身份验证(MFA)中使用的所有身份验证技术的 10%。先前的研究表明,采用率低的主要原因是用户对 PAD 可用性的负面看法和态度;其中许多研究往往偏向于特定的用户群体(如年轻的大学生等),往往会对可用的安全性产生偏见。为了解决这一局限性,我们制定了一种独创的研究方法,根据用户特征(如年龄、教育程度和经验)将用户划分为特定的群体,并研究每个群体如何定义可用性以及他们对某些安全功能的偏好程度。在对 410 名参与者进行调查的基础上,我们的结果表明,每个用户群体确实有不同的可用安全偏好,因此,我们就如何增强现有 PAD 以支持可用性和提高采用率提出了建议。
{"title":"User Characteristics and Their Impact on the Perceived Usable Security of Physical Authentication Devices","authors":"Jongkil Jay Jeong;Syed Wajid Ali Shah;Ashish Nanda;Robin Doss;Mohammad Nosouhi;Jeb Webb","doi":"10.1109/THMS.2024.3421538","DOIUrl":"10.1109/THMS.2024.3421538","url":null,"abstract":"Physical authentication devices (PADs) offer a higher level of security than other authentication technologies commonly used in multifactor authentication (MFA) schemes because they are much less vulnerable to attack. However, PAD uptake remains significantly lower than that for SMS and app-based approaches, accounting for only 10% of all authentication technologies currently being utilized in MFA. Prior studies indicate that the primary reason for this low adoption rate is due to negative users' perceptions and attitudes toward the usability of PADs; many of these studies often skew toward a particular set of users (e.g., young university students, etc.), often creating a bias toward what usable security entails. To address this limitation, we have formulated an original research methodology that segments users into specific groups based on their user characteristics (i.e., age, education, and experience) and examines how each group defines usability and ranks their preferences regarding certain security features. Based on a survey of 410 participants, our results indicate that there are indeed different usable security preferences for each user group, and we, therefore, provide recommendations on how existing PADs might be enhanced to support usability and improve adoption rates.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141772570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Transactions on Human-Machine Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1