mmDrive: Fine-Grained Fatigue Driving Detection Using mmWave Radar

IF 3.5 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS ACM Transactions on Internet of Things Pub Date : 2023-08-10 DOI:10.1145/3614437
Juncen Zhu, Jiannong Cao, Yanni Yang, Wei Ren, Huizi Han
{"title":"mmDrive: Fine-Grained Fatigue Driving Detection Using mmWave Radar","authors":"Juncen Zhu, Jiannong Cao, Yanni Yang, Wei Ren, Huizi Han","doi":"10.1145/3614437","DOIUrl":null,"url":null,"abstract":"Early detection of fatigue driving is pivotal for safety of drivers and pedestrians. Traditional approaches mainly employ cameras and wearable sensors to detect fatigue features, which are intrusive to drivers. Recent advances in radio frequency (RF) sensing enable non-intrusive fatigue feature detection from the signal reflected by driver’s body. However, existing RF-based solutions only detect partial or coarse-grained fatigue features, which reduces the detection accuracy. To tackle above limitations, we propose a mmWave-based fatigue driving detection system, called mmDrive, which can detect multiple fine-grained fatigue features from different body parts. However, achieving accurate detection of various fatigue features during driving encounters practical challenges. Specifically, normal driving activities and driver’s involuntary facial movements inevitably cause interference to fatigue features. Thus, we exploit unique geometric and behavioral characteristics of fatigue features and design effective signal processing methods to remove noises from fatigue-irrelevant activities. Based on the detected fatigue features, we further develop a fatigue determination algorithm to decide driver’s fatigue state. Extensive experiment results from both simulated and real driving environments show that the average accuracy for detecting nodding and yawning features is about \\(96\\% \\) , and the average errors for estimating eye blink, respiration, and heartbeat rates are around 2.21bpm, 0.54bpm, and 2.52bpm, respectively. And the accuracy of the fatigue detection algorithm we proposed reached \\(97.63\\% \\) .","PeriodicalId":29764,"journal":{"name":"ACM Transactions on Internet of Things","volume":"45 1","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2023-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Transactions on Internet of Things","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3614437","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Early detection of fatigue driving is pivotal for safety of drivers and pedestrians. Traditional approaches mainly employ cameras and wearable sensors to detect fatigue features, which are intrusive to drivers. Recent advances in radio frequency (RF) sensing enable non-intrusive fatigue feature detection from the signal reflected by driver’s body. However, existing RF-based solutions only detect partial or coarse-grained fatigue features, which reduces the detection accuracy. To tackle above limitations, we propose a mmWave-based fatigue driving detection system, called mmDrive, which can detect multiple fine-grained fatigue features from different body parts. However, achieving accurate detection of various fatigue features during driving encounters practical challenges. Specifically, normal driving activities and driver’s involuntary facial movements inevitably cause interference to fatigue features. Thus, we exploit unique geometric and behavioral characteristics of fatigue features and design effective signal processing methods to remove noises from fatigue-irrelevant activities. Based on the detected fatigue features, we further develop a fatigue determination algorithm to decide driver’s fatigue state. Extensive experiment results from both simulated and real driving environments show that the average accuracy for detecting nodding and yawning features is about \(96\% \) , and the average errors for estimating eye blink, respiration, and heartbeat rates are around 2.21bpm, 0.54bpm, and 2.52bpm, respectively. And the accuracy of the fatigue detection algorithm we proposed reached \(97.63\% \) .
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
mmDrive:使用毫米波雷达进行细粒度疲劳驾驶检测
早期发现疲劳驾驶对驾驶员和行人的安全至关重要。传统方法主要采用摄像头和可穿戴传感器来检测疲劳特征,这对驾驶员来说是一种干扰。射频(RF)传感技术的最新进展使驾驶员身体反射的信号能够进行非侵入式疲劳特征检测。然而,现有的基于rf的解决方案只能检测部分或粗粒度的疲劳特征,从而降低了检测精度。为了解决上述限制,我们提出了一种基于毫米波的疲劳驱动检测系统,称为mmDrive,它可以检测来自不同身体部位的多个细粒度疲劳特征。然而,在驾驶过程中实现各种疲劳特征的准确检测遇到了实际挑战。具体来说,正常的驾驶活动和驾驶员不自觉的面部运动不可避免地会对疲劳特征产生干扰。因此,我们利用疲劳特征的独特几何和行为特征,设计有效的信号处理方法来去除疲劳无关活动的噪声。基于检测到的疲劳特征,进一步开发了疲劳判定算法,确定驾驶员的疲劳状态。模拟和真实驾驶环境的大量实验结果表明,检测点头和打哈欠特征的平均准确率约为\(96\% \),估计眨眼、呼吸和心跳速率的平均误差分别约为2.21bpm、0.54bpm和2.52bpm。提出的疲劳检测算法的精度达到\(97.63\% \)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
5.20
自引率
3.70%
发文量
0
期刊最新文献
Introduction to the Special Issue on Wireless Sensing for IoT Special Issue on Wireless Sensing for IoT: A Word from the Editor-in-Chief Resilient Intermediary‐Based Key Exchange Protocol for IoT A Two-Mode, Adaptive Security Framework for Smart Home Security Applications Online learning for dynamic impending collision prediction using FMCW radar
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1