首页 > 最新文献

IEEE Transactions on Human-Machine Systems最新文献

英文 中文
IEEE Systems, Man, and Cybernetics Society Information 电气和电子工程师学会系统、人和控制论学会信息
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-18 DOI: 10.1109/THMS.2024.3427293
{"title":"IEEE Systems, Man, and Cybernetics Society Information","authors":"","doi":"10.1109/THMS.2024.3427293","DOIUrl":"https://doi.org/10.1109/THMS.2024.3427293","url":null,"abstract":"","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10604688","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Call for Papers: Special Issue on Trustworthy Human-Autonomy Teaming: Featured Research from the 4th International Conference on Human-Machine Systems (ICHMS 2024) 征稿:可信赖的人机协作特刊:第四届国际人机系统大会(ICHMS 2024)的特色研究
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-18 DOI: 10.1109/THMS.2024.3427300
{"title":"Call for Papers: Special Issue on Trustworthy Human-Autonomy Teaming: Featured Research from the 4th International Conference on Human-Machine Systems (ICHMS 2024)","authors":"","doi":"10.1109/THMS.2024.3427300","DOIUrl":"https://doi.org/10.1109/THMS.2024.3427300","url":null,"abstract":"","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10604702","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Transactions on Human-Machine Systems Information for Authors 电气和电子工程师学会《人机系统学报》(IEEE Transactions on Human-Machine Systems)为作者提供的信息
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-18 DOI: 10.1109/THMS.2024.3427297
{"title":"IEEE Transactions on Human-Machine Systems Information for Authors","authors":"","doi":"10.1109/THMS.2024.3427297","DOIUrl":"https://doi.org/10.1109/THMS.2024.3427297","url":null,"abstract":"","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10604671","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Systems, Man, and Cybernetics Society Information 电气和电子工程师学会系统、人和控制论学会信息
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-18 DOI: 10.1109/THMS.2024.3427295
{"title":"IEEE Systems, Man, and Cybernetics Society Information","authors":"","doi":"10.1109/THMS.2024.3427295","DOIUrl":"https://doi.org/10.1109/THMS.2024.3427295","url":null,"abstract":"","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10604716","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-Time Posture Identification System for Wheelchair Users Preventing the Generation of Pressure Ulcers 用于轮椅使用者的实时姿势识别系统,防止产生压疮
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-16 DOI: 10.1109/THMS.2024.3422267
Aura Ximena Gonzalez-Cely;Cristian Felipe Blanco-Diaz;Teodiano Bastos-Filho;Camilo Arturo Rodriguez-Diaz
Prevention is key to avoid pressure ulcer generation in people with mobility restrictions. In recent years, preventive medicine has focused on posture control by considering people who frequently have the same position for too long, such as wheelchair users. Optical fiber sensors have gained recognition for their applications in biomedical engineering; however, approaches to assistive devices, such as wheelchairs, have been relatively unexplored. This study proposes a polymeric-optical-fiber (POF) sensing system based on machine learning (ML) for human posture recognition in an electrical wheelchair-based human machine interface (HMI). The ML-based model was used to classify time- and frequency-domain features obtained from a matrix of POF-based pressure sensors and 24 photodetectors during the execution of eight body postures. In an offline stage, multiclassification was conducted using k-nearest neighbors (KNN), decision tree, extra tree classifier (ETC), and random forest, where the best performance, in terms of accuracy (ACC), was obtained through the use of ETC (94%). Hence, this classifier was implemented in real-time, where the wheelchair-based HMI achieved a CPU time of approximately 117 ms, and an ACC higher than 96%, outperforming the metrics previously reported in the literature. We believe that this study contributes to the development of smart assistive systems that integrate ML and soft sensors to recognize body postures in an HMI, which is a promising approach for preventing the generation of pressure ulcers in wheelchair users.
预防是避免行动不便者产生压疮的关键。近年来,预防医学将重点放在姿势控制上,考虑到那些经常长时间保持同一姿势的人,如轮椅使用者。光纤传感器因其在生物医学工程中的应用而获得认可;然而,用于辅助设备(如轮椅)的方法却相对较少。本研究提出了一种基于机器学习(ML)的聚合光纤(POF)传感系统,用于识别电动轮椅人机界面(HMI)中的人体姿势。基于 ML 的模型被用于对从基于 POF 的压力传感器矩阵和 24 个光电探测器获得的时域和频域特征进行分类,这些特征是在八个身体姿势的执行过程中获得的。在离线阶段,使用 k-近邻(KNN)、决策树、额外树分类器(ETC)和随机森林进行了多重分类,其中使用 ETC 的准确率(ACC)最高(94%)。因此,该分类器是实时实现的,基于轮椅的人机界面的 CPU 时间约为 117 毫秒,ACC 高于 96%,优于以前文献中报告的指标。我们相信,这项研究有助于开发智能辅助系统,该系统集成了人工智能和软传感器,可识别人机界面中的身体姿势,是防止轮椅使用者产生压疮的一种有前途的方法。
{"title":"Real-Time Posture Identification System for Wheelchair Users Preventing the Generation of Pressure Ulcers","authors":"Aura Ximena Gonzalez-Cely;Cristian Felipe Blanco-Diaz;Teodiano Bastos-Filho;Camilo Arturo Rodriguez-Diaz","doi":"10.1109/THMS.2024.3422267","DOIUrl":"10.1109/THMS.2024.3422267","url":null,"abstract":"Prevention is key to avoid pressure ulcer generation in people with mobility restrictions. In recent years, preventive medicine has focused on posture control by considering people who frequently have the same position for too long, such as wheelchair users. Optical fiber sensors have gained recognition for their applications in biomedical engineering; however, approaches to assistive devices, such as wheelchairs, have been relatively unexplored. This study proposes a polymeric-optical-fiber (POF) sensing system based on machine learning (ML) for human posture recognition in an electrical wheelchair-based human machine interface (HMI). The ML-based model was used to classify time- and frequency-domain features obtained from a matrix of POF-based pressure sensors and 24 photodetectors during the execution of eight body postures. In an offline stage, multiclassification was conducted using k-nearest neighbors (KNN), decision tree, extra tree classifier (ETC), and random forest, where the best performance, in terms of accuracy (ACC), was obtained through the use of ETC (94%). Hence, this classifier was implemented in real-time, where the wheelchair-based HMI achieved a CPU time of approximately 117 ms, and an ACC higher than 96%, outperforming the metrics previously reported in the literature. We believe that this study contributes to the development of smart assistive systems that integrate ML and soft sensors to recognize body postures in an HMI, which is a promising approach for preventing the generation of pressure ulcers in wheelchair users.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141722593","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resilience in Operators, Technologies, and Systems 运营商、技术和系统的复原力
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-09 DOI: 10.1109/THMS.2024.3408804
P. A. Hancock;Jessica Cruit
Changes in technology, particularly for example in commercial air operations, have led to incremental increases in the number and variety of associated safety procedures and checklists. This work addresses concerns about how people and systems respond to unanticipated events, as applicable to such commercial air operations, and to examine whether these “if–then” approaches prove sufficient to respond to prospective operational uncertainties. The current work draws from the literature on systems resilience, cognitive flexibility, and adaptation to consider how response strategies that are integrated into human–machine training at all levels of operation can aid in effective resolution to such unanticipated events. A number of scientific insights, methods, and domains are identified as being able to be employed to avoid catastrophic failure in current and prospective operational environments. While heuristics for advisement do provide an initial level of defensive protection, evolving airspace operations need to be adaptive to, and resilient in respect of, emerging and even unanticipated challenges. Prospective response strategies need to encompass both the demands that can be evidently foreseen and those that remain at present, indeterminate. Resilience in responding appears to be a primary dimension of success in relation to these challenges. The information herein distilled can increase operator performance and aviation systems’ response to nonproceduralized and unanticipated events as well as being applied to a vast array of other safety-critical operations beyond this one realm.
技术的变化,特别是商业航空运营中的技术变化,导致相关安全程序和检查表的数量和种类逐步增加。这项工作涉及人们和系统如何应对意外事件的问题,适用于此类商业航空运营,并研究这些 "如果-那么 "方法是否足以应对未来的运营不确定性。目前的工作借鉴了有关系统恢复能力、认知灵活性和适应性的文献,以考虑将应对策略纳入各级操作的人机培训中,如何帮助有效解决此类意外事件。在当前和未来的作战环境中,许多科学见解、方法和领域都可用于避免灾难性故障。虽然启发式建议确实提供了初步的防御保护,但不断发展的空域运行需要适应新出现的、甚至是意料之外的挑战,并具有应变能力。前瞻性的应对战略既要包括可以明显预见的需求,也要包括目前仍不确定的需求。应变能力似乎是成功应对这些挑战的一个主要方面。本文所提炼的信息可以提高操作员的绩效和航空系统对非程序化和未预见到的事件的反应能力,并可应用于这一领域之外的大量其他安全关键操作。
{"title":"Resilience in Operators, Technologies, and Systems","authors":"P. A. Hancock;Jessica Cruit","doi":"10.1109/THMS.2024.3408804","DOIUrl":"10.1109/THMS.2024.3408804","url":null,"abstract":"Changes in technology, particularly for example in commercial air operations, have led to incremental increases in the number and variety of associated safety procedures and checklists. This work addresses concerns about how people and systems respond to unanticipated events, as applicable to such commercial air operations, and to examine whether these “\u0000<sc>if–then</small>\u0000” approaches prove sufficient to respond to prospective operational uncertainties. The current work draws from the literature on systems resilience, cognitive flexibility, and adaptation to consider how response strategies that are integrated into human–machine training at all levels of operation can aid in effective resolution to such unanticipated events. A number of scientific insights, methods, and domains are identified as being able to be employed to avoid catastrophic failure in current and prospective operational environments. While heuristics for advisement do provide an initial level of defensive protection, evolving airspace operations need to be adaptive to, and resilient in respect of, emerging and even unanticipated challenges. Prospective response strategies need to encompass both the demands that can be evidently foreseen and those that remain at present, indeterminate. Resilience in responding appears to be a primary dimension of success in relation to these challenges. The information herein distilled can increase operator performance and aviation systems’ response to nonproceduralized and unanticipated events as well as being applied to a vast array of other safety-critical operations beyond this one realm.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141567776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Supporting Human–Robot Interaction by Projected Augmented Reality and a Brain Interface 通过投射式增强现实和大脑接口支持人机交互
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-02 DOI: 10.1109/THMS.2024.3414208
Francesco De Pace;Federico Manuri;Matteo Bosco;Andrea Sanna;Hannes Kaufmann
This article presents a brain–computer interface (BCI) coupled with an augmented reality (AR) system to support human–robot interaction in controlling a robotic arm for pick-and-place tasks. BCIs can process steady-state visual evoked potentials (SSVEPs), which are signals generated through visual stimuli. The visual stimuli may be conveyed to the user with AR systems, expanding the range of possible applications. The proposed approach leverages the capabilities of the NextMind BCI to enable users to select objects in the range of the robotic arm. By displaying a visual anchor associated with each object in the scene with projected AR, the NextMind device can detect when users focus their eyesight on one of them, thus triggering the pick-up action of the robotic arm. The proposed system has been designed considering the needs and limitations of mobility-impaired people to support them when controlling a robotic arm for pick-and-place tasks. Two different approaches for positioning the visual anchors are proposed and analyzed. Experimental tests involving users show that both approaches are highly appreciated. The system performances are extremely robust, thus allowing the users to select objects in an easy, fast, and reliable way.
本文介绍了一种与增强现实(AR)系统相结合的脑机接口(BCI),用于支持人机交互,控制机械臂完成拾放任务。脑机接口可以处理稳态视觉诱发电位(SSVEPs),这是通过视觉刺激产生的信号。视觉刺激可通过 AR 系统传达给用户,从而扩大了可能的应用范围。所提出的方法充分利用了 NextMind BCI 的功能,使用户能够选择机械臂范围内的物体。通过投射 AR 显示与场景中每个物体相关的视觉锚点,NextMind 设备可以检测用户何时将视线集中在其中一个物体上,从而触发机械臂的拾取动作。该系统的设计考虑到了行动不便者的需求和局限性,以支持他们控制机械臂完成拾放任务。系统提出并分析了两种不同的视觉锚定位方法。用户参与的实验测试表明,这两种方法都受到了高度评价。系统性能非常稳定,因此用户可以轻松、快速、可靠地选择对象。
{"title":"Supporting Human–Robot Interaction by Projected Augmented Reality and a Brain Interface","authors":"Francesco De Pace;Federico Manuri;Matteo Bosco;Andrea Sanna;Hannes Kaufmann","doi":"10.1109/THMS.2024.3414208","DOIUrl":"10.1109/THMS.2024.3414208","url":null,"abstract":"This article presents a brain–computer interface (BCI) coupled with an augmented reality (AR) system to support human–robot interaction in controlling a robotic arm for pick-and-place tasks. BCIs can process steady-state visual evoked potentials (SSVEPs), which are signals generated through visual stimuli. The visual stimuli may be conveyed to the user with AR systems, expanding the range of possible applications. The proposed approach leverages the capabilities of the NextMind BCI to enable users to select objects in the range of the robotic arm. By displaying a visual anchor associated with each object in the scene with projected AR, the NextMind device can detect when users focus their eyesight on one of them, thus triggering the pick-up action of the robotic arm. The proposed system has been designed considering the needs and limitations of mobility-impaired people to support them when controlling a robotic arm for pick-and-place tasks. Two different approaches for positioning the visual anchors are proposed and analyzed. Experimental tests involving users show that both approaches are highly appreciated. The system performances are extremely robust, thus allowing the users to select objects in an easy, fast, and reliable way.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10581874","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141516478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
hmOS: An Extensible Platform for Task-Oriented Human–Machine Computing hmOS:面向任务的人机计算可扩展平台
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-02 DOI: 10.1109/THMS.2024.3414432
Hui Wang;Zhiwen Yu;Yao Zhang;Yanfei Wang;Fan Yang;Liang Wang;Jiaqi Liu;Bin Guo
With rapid advancements in artificial intelligence (AI) technologies, AI-powered machines are increasingly capable of collaborating with humans to enhance decision-making in various human–machine collaboration scenarios, e.g., medical diagnosis, criminal justice, and autonomous driving. As a result, human–machine computing (HMC) has emerged as a promising computing paradigm that integrates the expertise of humans with the reliable data processing capabilities of machines. Using HMC to facilitate the processing of domain-specific tasks has a lot of potential, but is limited in system-level scalability, i.e., there is no one common easy-to-use interface. In this article, we present human-machine operating system (hmOS), an open extensible platform for researchers to experiment with HMC for investigating system-centric human–machine collaboration problems. hmOS supports flexible human–machine collaboration on the strength of the quality-aware task decomposition and allocation. To achieve that, the underlying system architecture and runtime environment are first developed to build a foundational abstraction for the kernel of hmOS. Second, hmOS facilitates flexible human–machine collaboration through a suitability-based task allocation mechanism, quality estimation guided by fuzzy rules, and iterative feedback on result tuning. We implement the newly proposed hmOS in a prototype featuring interactive interfaces. Finally, we conduct extensive and realistic experiments to validate the effectiveness of our platform across diverse tasks, showcasing the broad feasibility of hmOS.
随着人工智能(AI)技术的飞速发展,人工智能驱动的机器越来越有能力与人类协作,在医疗诊断、刑事司法和自动驾驶等各种人机协作场景中增强决策能力。因此,人机计算(HMC)已成为一种前景广阔的计算模式,它将人类的专业知识与机器可靠的数据处理能力融为一体。使用 HMC 来促进特定领域任务的处理具有很大的潜力,但在系统级可扩展性方面受到限制,即没有一个通用的易于使用的界面。在本文中,我们介绍了人机操作系统(hmOS),这是一个开放的可扩展平台,供研究人员尝试使用 HMC 来研究以系统为中心的人机协作问题。为此,首先开发了底层系统架构和运行环境,为 hmOS 的内核建立了基础抽象。其次,hmOS 通过基于适宜性的任务分配机制、模糊规则指导下的质量评估以及结果调整的迭代反馈,促进了灵活的人机协作。我们在一个具有交互界面的原型中实现了新提出的 hmOS。最后,我们进行了广泛而真实的实验,验证了我们的平台在不同任务中的有效性,展示了 hmOS 的广泛可行性。
{"title":"hmOS: An Extensible Platform for Task-Oriented Human–Machine Computing","authors":"Hui Wang;Zhiwen Yu;Yao Zhang;Yanfei Wang;Fan Yang;Liang Wang;Jiaqi Liu;Bin Guo","doi":"10.1109/THMS.2024.3414432","DOIUrl":"10.1109/THMS.2024.3414432","url":null,"abstract":"With rapid advancements in artificial intelligence (AI) technologies, AI-powered machines are increasingly capable of collaborating with humans to enhance decision-making in various human–machine collaboration scenarios, e.g., medical diagnosis, criminal justice, and autonomous driving. As a result, human–machine computing (HMC) has emerged as a promising computing paradigm that integrates the expertise of humans with the reliable data processing capabilities of machines. Using HMC to facilitate the processing of domain-specific tasks has a lot of potential, but is limited in system-level scalability, i.e., there is no one common easy-to-use interface. In this article, we present human-machine operating system \u0000<monospace>(hmOS)</monospace>\u0000, an open extensible platform for researchers to experiment with HMC for investigating system-centric human–machine collaboration problems. \u0000<monospace>hmOS</monospace>\u0000 supports flexible human–machine collaboration on the strength of the quality-aware task decomposition and allocation. To achieve that, the underlying system architecture and runtime environment are first developed to build a foundational abstraction for the kernel of \u0000<monospace>hmOS</monospace>\u0000. Second, \u0000<monospace>hmOS</monospace>\u0000 facilitates flexible human–machine collaboration through a suitability-based task allocation mechanism, quality estimation guided by fuzzy rules, and iterative feedback on result tuning. We implement the newly proposed \u0000<monospace>hmOS</monospace>\u0000 in a prototype featuring interactive interfaces. Finally, we conduct extensive and realistic experiments to validate the effectiveness of our platform across diverse tasks, showcasing the broad feasibility of \u0000<monospace>hmOS</monospace>\u0000.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141516476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robust Object Selection in Spontaneous Gaze-Controlled Application Using Exponential Moving Average and Hidden Markov Model 使用指数移动平均法和隐马尔可夫模型在自发凝视控制应用中进行稳健的目标选择
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-02 DOI: 10.1109/THMS.2024.3413781
Suatmi Murnani;Noor Akhmad Setiawan;Sunu Wibirama
The human gaze is a promising input modality for interactive applications due to its advantages: giving benefits to motion-impaired people while providing faster, intuitive, and easy interaction. The most common form of gaze interaction is object selection. During the last decade, gaze gestures and smooth pursuit-based interaction have been emerging techniques for spontaneous object selection in various gaze-controlled applications. Unfortunately, the challenge of spontaneous interaction demands no prior gaze-to-screen calibration, which leads to inaccurate object selection. To overcome the accuracy issue, this article proposes a novel method for spontaneous gaze interaction based on Pearson product-moment correlation as a measure of similarity, an exponential moving average filter for signal denoising, and a hidden Markov model to perform eye movement classification. Based on experimental results, our approach yielded the best object selection accuracy and success time of $text{89.60}pm text{10.59}%$ and $text{4364}pm text{235.86}$ ms, respectively. Our results imply that spontaneous interaction for gaze-controlled applications is possible with careful consideration of the underlying techniques to handle noisy data generated by the eye tracker. Furthermore, the proposed method is promising for future development of interactive touchless display systems that comply with the health protocols of the World Health Organization during the COVID-19 pandemic.
人类凝视是一种很有前途的交互应用输入模式,因为它具有以下优势:既能为行动不便的人带来好处,又能提供更快、更直观、更简便的交互。最常见的凝视交互形式是选择对象。在过去十年中,凝视手势和基于平滑追逐的交互技术已成为各种凝视控制应用程序中用于自发选择对象的新兴技术。遗憾的是,自发交互的挑战在于不需要事先进行凝视到屏幕的校准,这导致了对象选择的不准确。为了克服准确性问题,本文提出了一种新的自发凝视交互方法,该方法基于皮尔逊积矩相关性(Pearson product-moment correlation)作为相似性度量,指数移动平均滤波器(exponential moving average filter)用于信号去噪,隐马尔可夫模型(hidden Markov model)用于眼动分类。根据实验结果,我们的方法获得了最佳的对象选择准确率和成功时间,分别为 $text{89.60}pm text{10.59}%$ 和 $text{4364}pm text{235.86}$ ms。我们的研究结果表明,只要仔细考虑处理眼动仪产生的噪声数据的基本技术,凝视控制应用的自发交互是有可能实现的。此外,所提出的方法对于未来开发符合世界卫生组织 COVID-19 大流行期间卫生协议的交互式无触摸显示系统大有可为。
{"title":"Robust Object Selection in Spontaneous Gaze-Controlled Application Using Exponential Moving Average and Hidden Markov Model","authors":"Suatmi Murnani;Noor Akhmad Setiawan;Sunu Wibirama","doi":"10.1109/THMS.2024.3413781","DOIUrl":"10.1109/THMS.2024.3413781","url":null,"abstract":"The human gaze is a promising input modality for interactive applications due to its advantages: giving benefits to motion-impaired people while providing faster, intuitive, and easy interaction. The most common form of gaze interaction is object selection. During the last decade, gaze gestures and smooth pursuit-based interaction have been emerging techniques for spontaneous object selection in various gaze-controlled applications. Unfortunately, the challenge of spontaneous interaction demands no prior gaze-to-screen calibration, which leads to inaccurate object selection. To overcome the accuracy issue, this article proposes a novel method for spontaneous gaze interaction based on Pearson product-moment correlation as a measure of similarity, an exponential moving average filter for signal denoising, and a hidden Markov model to perform eye movement classification. Based on experimental results, our approach yielded the best object selection accuracy and success time of \u0000<inline-formula><tex-math>$text{89.60}pm text{10.59}%$</tex-math></inline-formula>\u0000 and \u0000<inline-formula><tex-math>$text{4364}pm text{235.86}$</tex-math></inline-formula>\u0000 ms, respectively. Our results imply that spontaneous interaction for gaze-controlled applications is possible with careful consideration of the underlying techniques to handle noisy data generated by the eye tracker. Furthermore, the proposed method is promising for future development of interactive touchless display systems that comply with the health protocols of the World Health Organization during the COVID-19 pandemic.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10582450","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141516475","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Systematic Review on Custom Data Gloves 定制数据手套系统综述
IF 3.5 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-28 DOI: 10.1109/THMS.2024.3394674
Valerio Belcamino;Alessandro Carfì;Fulvio Mastrogiovanni
Hands are a fundamental tool humans use to interact with the environment and objects. Through hand motions, we can obtain information about the shape and materials of the surfaces we touch, modify our surroundings by interacting with objects, manipulate objects and tools, or communicate with other people by leveraging the power of gestures. For these reasons, sensorized gloves, which can collect information about hand motions and interactions, have been of interest since the 1980s in various fields, such as human–machine interaction and the analysis and control of human motions. Over the last 40 years, research in this field explored different technological approaches and contributed to the popularity of wearable custom and commercial products targeting hand sensorization. Despite a positive research trend, these instruments are not widespread yet outside research environments and devices aimed at research are often ad hoc solutions with a low chance of being reused. This article aims to provide a systematic literature review for custom gloves to analyze their main characteristics and critical issues, from the type and number of sensors to the limitations due to device encumbrance. The collection of this information lays the foundation for a standardization process necessary for future breakthroughs in this research field.
手是人类用来与环境和物体互动的基本工具。通过手部动作,我们可以获得所接触表面的形状和材料信息,通过与物体互动来改变周围环境,操纵物体和工具,或利用手势的力量与他人交流。因此,自 20 世纪 80 年代以来,能够收集手部动作和交互信息的传感手套一直受到人机交互、人体动作分析和控制等多个领域的关注。在过去的 40 年中,该领域的研究探索了不同的技术方法,促进了以手部传感为目标的可穿戴定制产品和商业产品的普及。尽管研究趋势良好,但这些设备在研究环境之外尚未普及,而且针对研究的设备往往是临时解决方案,重复使用的几率很低。本文旨在对定制手套进行系统的文献综述,分析其主要特点和关键问题,包括传感器的类型和数量,以及由于设备笨重而造成的限制。这些信息的收集为该研究领域未来取得突破所需的标准化进程奠定了基础。
{"title":"A Systematic Review on Custom Data Gloves","authors":"Valerio Belcamino;Alessandro Carfì;Fulvio Mastrogiovanni","doi":"10.1109/THMS.2024.3394674","DOIUrl":"10.1109/THMS.2024.3394674","url":null,"abstract":"Hands are a fundamental tool humans use to interact with the environment and objects. Through hand motions, we can obtain information about the shape and materials of the surfaces we touch, modify our surroundings by interacting with objects, manipulate objects and tools, or communicate with other people by leveraging the power of gestures. For these reasons, sensorized gloves, which can collect information about hand motions and interactions, have been of interest since the 1980s in various fields, such as human–machine interaction and the analysis and control of human motions. Over the last 40 years, research in this field explored different technological approaches and contributed to the popularity of wearable custom and commercial products targeting hand sensorization. Despite a positive research trend, these instruments are not widespread yet outside research environments and devices aimed at research are often ad hoc solutions with a low chance of being reused. This article aims to provide a systematic literature review for custom gloves to analyze their main characteristics and critical issues, from the type and number of sensors to the limitations due to device encumbrance. The collection of this information lays the foundation for a standardization process necessary for future breakthroughs in this research field.","PeriodicalId":48916,"journal":{"name":"IEEE Transactions on Human-Machine Systems","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Transactions on Human-Machine Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1