Recognizing situation awareness of forklift operators based on eye-movement & EEG features

IF 2.5 2区 工程技术 Q2 ENGINEERING, INDUSTRIAL International Journal of Industrial Ergonomics Pub Date : 2024-01-18 DOI:10.1016/j.ergon.2024.103552
Yutao Kang , Feng Liu , Weijiong Chen , Xin Li , Yajie Tao , Wei Huang
{"title":"Recognizing situation awareness of forklift operators based on eye-movement & EEG features","authors":"Yutao Kang ,&nbsp;Feng Liu ,&nbsp;Weijiong Chen ,&nbsp;Xin Li ,&nbsp;Yajie Tao ,&nbsp;Wei Huang","doi":"10.1016/j.ergon.2024.103552","DOIUrl":null,"url":null,"abstract":"<div><p><span>Lack of situation awareness (SA) is a major source of human error in forklift operations. Effective assessment of SA levels is a critical link in improving the SA of forklift operators. Aiming at the intrusive, subjective and intermittent problems of current measurement methods, this paper proposed a SA recognition method based on eye movement and electroencephalography (EEG) features. A forklift operation experiment was designed in a real-life scenario, where eye movement and EEG data of forklift operators were collected, and the Situation Awareness Rating Technique (SART) method was used to calculate SA scores. Independent sample </span><em>t</em><span>-test and Mann-Whitney test were used to investigate the differences in eye movement and EEG indicators among participants with different SA levels. Finally, the classification models of K-Nearest neighbor (KNN), Random Forest (RF) and Support Vector Machine (SVM) were used to recognize the SA levels of forklift operators. The results indicated that the visiting time indicators, fixation time indicators and fixation count indicators in particular Areas of Interest (AOIs) are significantly different from the SA levels; The combined EEG indicators θ/β, (α+θ)/(α+β), θ/(α+β) in Frontal (F) lobe, Parietal (P) lobe and Central (C) lobe, and (α+θ)/β in P lobe and C lobe are significantly different from the SA levels; The average recognition accuracies of the models of KNN, RF and SVM are 90.61%, 94.18% and 91.15%, respectively, with the RF model having the highest recognition accuracy. The results confirmed that the method can be used to assess the SA of forklift operators in the real environment, which provides a new avenue for SA measurement.</span></p></div>","PeriodicalId":50317,"journal":{"name":"International Journal of Industrial Ergonomics","volume":null,"pages":null},"PeriodicalIF":2.5000,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Industrial Ergonomics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0169814124000088","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0

Abstract

Lack of situation awareness (SA) is a major source of human error in forklift operations. Effective assessment of SA levels is a critical link in improving the SA of forklift operators. Aiming at the intrusive, subjective and intermittent problems of current measurement methods, this paper proposed a SA recognition method based on eye movement and electroencephalography (EEG) features. A forklift operation experiment was designed in a real-life scenario, where eye movement and EEG data of forklift operators were collected, and the Situation Awareness Rating Technique (SART) method was used to calculate SA scores. Independent sample t-test and Mann-Whitney test were used to investigate the differences in eye movement and EEG indicators among participants with different SA levels. Finally, the classification models of K-Nearest neighbor (KNN), Random Forest (RF) and Support Vector Machine (SVM) were used to recognize the SA levels of forklift operators. The results indicated that the visiting time indicators, fixation time indicators and fixation count indicators in particular Areas of Interest (AOIs) are significantly different from the SA levels; The combined EEG indicators θ/β, (α+θ)/(α+β), θ/(α+β) in Frontal (F) lobe, Parietal (P) lobe and Central (C) lobe, and (α+θ)/β in P lobe and C lobe are significantly different from the SA levels; The average recognition accuracies of the models of KNN, RF and SVM are 90.61%, 94.18% and 91.15%, respectively, with the RF model having the highest recognition accuracy. The results confirmed that the method can be used to assess the SA of forklift operators in the real environment, which provides a new avenue for SA measurement.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
根据眼动和脑电图特征识别叉车操作员的情境意识
缺乏情况意识(SA)是叉车操作中人为失误的主要原因。有效评估态势感知水平是提高叉车操作员态势感知水平的关键环节。针对现有测量方法的侵入性、主观性和间歇性问题,本文提出了一种基于眼动和脑电图(EEG)特征的 SA 识别方法。在真实场景中设计了一个叉车操作实验,收集了叉车操作员的眼动和脑电数据,并采用情境意识评级技术(SART)方法计算 SA 分数。采用独立样本 t 检验和 Mann-Whitney 检验来研究不同 SA 水平的参与者在眼动和脑电指标上的差异。最后,使用 K-近邻(KNN)、随机森林(RF)和支持向量机(SVM)分类模型识别叉车操作员的 SA 水平。结果表明,特定兴趣区(AOIs)的访问时间指标、固定时间指标和固定次数指标与 SA 水平存在显著差异;额叶(F)、顶叶(P)和中央叶(C)的脑电综合指标θ/β、(α+θ)/(α+β)、θ/(α+β)以及P叶和C叶的(α+θ)/β均与SA水平有显著差异;KNN、RF和SVM模型的平均识别准确率分别为90.KNN、RF 和 SVM 模型的平均识别准确率分别为 90.61%、94.18% 和 91.15%,其中 RF 模型的识别准确率最高。结果证实,该方法可用于评估真实环境中叉车操作员的 SA,为 SA 测量提供了一条新途径。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
International Journal of Industrial Ergonomics
International Journal of Industrial Ergonomics 工程技术-工程:工业
CiteScore
6.40
自引率
12.90%
发文量
110
审稿时长
56 days
期刊介绍: The journal publishes original contributions that add to our understanding of the role of humans in today systems and the interactions thereof with various system components. The journal typically covers the following areas: industrial and occupational ergonomics, design of systems, tools and equipment, human performance measurement and modeling, human productivity, humans in technologically complex systems, and safety. The focus of the articles includes basic theoretical advances, applications, case studies, new methodologies and procedures; and empirical studies.
期刊最新文献
Assessing the link between occupational risk factors, work-related musculoskeletal disorders and quality of work life: An analysis using PLS-SEM Ergonomic design of mastectomy bra based on emotion measurements Sedentary behavior and musculoskeletal symptoms among work from home employees Research on similarity bias in dual objective visual search based on nuclear power human-machine interface icons The impact of camera-monitor system viewing angles on drivers’ distance perception: A simulated driving study
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1