Utilizing Neutrosophic Logic in a Hybrid CNN-GRU Framework for Driver Drowsiness Level Detection with Dynamic Spatio-Temporal Analysis Based on Eye Aspect Ratio

Abdel-Haleem Abdel Abdel-Aty, Ahmed A. H. Abdellatif, Kottakkaran Sooppy Nisar, Shankar Rao Munjam, Rasha M. Abd El El-Aziz, Ahmed I. Taloba
{"title":"Utilizing Neutrosophic Logic in a Hybrid CNN-GRU Framework for Driver Drowsiness Level Detection with Dynamic Spatio-Temporal Analysis Based on Eye Aspect Ratio","authors":"Abdel-Haleem Abdel Abdel-Aty, Ahmed A. H. Abdellatif, Kottakkaran Sooppy Nisar, Shankar Rao Munjam, Rasha M. Abd El El-Aziz, Ahmed I. Taloba","doi":"10.54216/ijns.220212","DOIUrl":null,"url":null,"abstract":"Driver drowsiness has been identified as a major cause of roadway accidents globally. Efficiently determining the extent of drowsiness can greatly enhance preventive measures. This study proposes a novel approach, combining convolutional neural networks (CNN) and Gated Recurrent Units (GRU) to dynamically evaluate both the presence of drowsiness and its severity based on the Eye Aspect Ratio (EAR). By bridging spatial features extracted by CNNs with temporal sequences through GRU, our model offers a robust and real-time assessment of drowsiness levels, paving the way for enhanced safety measures in vehicular systems. Incorporating Neutrosophic Logic enables a more robust representation of uncertainty and ambiguity in the data and enhances the accuracy of driver drowsiness level detection within the Hybrid CNN-GRU framework. The model’s hybrid CNN-GRU structure combines CNN layers to extract spatial information from Human eye Images and GRU units to represent temporal correlations between frames. In-car cameras and sensors must be integrated to implement the suggested system in real-time and enable continuous driver behavior monitoring. The system alerts early warnings and takes action when drowsiness is detected, lowering the likelihood of accidents caused by weary drivers. The CNN-GRU hybrid architecture accurately detects fatigue during real-time driving. Performance metrics, including accuracy, recall, and F1-score, are provided for comparative research utilizing baseline models. Model behavior may be understood by visualizing tiredness detection and carefully examining false positives and negatives. The proposed CNN-GRU framework outperforms traditional methods such as SVM, KNN, and BPNN by achieving a significantly higher accuracy of 99.5%. It increases the recognition of driver tiredness by proposing a trustworthy and adaptable hybrid CNN-GRU deep learning system. This project is implemented in Python; it offers a practical and versatile solution for real-time driver drowsiness level detection. The proposed technology has the potential to dramatically increase traffic safety by sending out early warnings and taking steps to lessen the risks related to driver fatigue.","PeriodicalId":192295,"journal":{"name":"International Journal of Neutrosophic Science","volume":"36 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Neutrosophic Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.54216/ijns.220212","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Driver drowsiness has been identified as a major cause of roadway accidents globally. Efficiently determining the extent of drowsiness can greatly enhance preventive measures. This study proposes a novel approach, combining convolutional neural networks (CNN) and Gated Recurrent Units (GRU) to dynamically evaluate both the presence of drowsiness and its severity based on the Eye Aspect Ratio (EAR). By bridging spatial features extracted by CNNs with temporal sequences through GRU, our model offers a robust and real-time assessment of drowsiness levels, paving the way for enhanced safety measures in vehicular systems. Incorporating Neutrosophic Logic enables a more robust representation of uncertainty and ambiguity in the data and enhances the accuracy of driver drowsiness level detection within the Hybrid CNN-GRU framework. The model’s hybrid CNN-GRU structure combines CNN layers to extract spatial information from Human eye Images and GRU units to represent temporal correlations between frames. In-car cameras and sensors must be integrated to implement the suggested system in real-time and enable continuous driver behavior monitoring. The system alerts early warnings and takes action when drowsiness is detected, lowering the likelihood of accidents caused by weary drivers. The CNN-GRU hybrid architecture accurately detects fatigue during real-time driving. Performance metrics, including accuracy, recall, and F1-score, are provided for comparative research utilizing baseline models. Model behavior may be understood by visualizing tiredness detection and carefully examining false positives and negatives. The proposed CNN-GRU framework outperforms traditional methods such as SVM, KNN, and BPNN by achieving a significantly higher accuracy of 99.5%. It increases the recognition of driver tiredness by proposing a trustworthy and adaptable hybrid CNN-GRU deep learning system. This project is implemented in Python; it offers a practical and versatile solution for real-time driver drowsiness level detection. The proposed technology has the potential to dramatically increase traffic safety by sending out early warnings and taking steps to lessen the risks related to driver fatigue.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于眼宽高比动态时空分析的混合CNN-GRU框架下嗜中性逻辑驾驶员睡意水平检测
司机困倦已被确定为全球道路交通事故的主要原因。有效地确定困倦程度可以大大加强预防措施。本研究提出了一种新颖的方法,将卷积神经网络(CNN)和门控循环单元(GRU)结合起来,基于眼宽高比(EAR)动态评估困倦的存在及其严重程度。通过GRU将cnn提取的空间特征与时间序列连接起来,我们的模型提供了对嗜睡水平的鲁棒实时评估,为增强车辆系统的安全措施铺平了道路。在混合CNN-GRU框架中,结合嗜中性逻辑可以更稳健地表示数据中的不确定性和模糊性,并提高驾驶员困倦水平检测的准确性。该模型的混合CNN-GRU结构结合了CNN层从人眼图像中提取空间信息和GRU单元来表示帧之间的时间相关性。车载摄像头和传感器必须集成在一起,以实时实现所建议的系统,并实现对驾驶员行为的持续监控。该系统会发出早期预警,并在检测到困倦时采取行动,从而降低驾驶员疲劳造成事故的可能性。CNN-GRU混合架构在实时驾驶过程中精确检测疲劳。性能指标,包括准确性、召回率和f1分数,为利用基线模型的比较研究提供了依据。模型行为可以通过可视化疲劳检测和仔细检查假阳性和阴性来理解。提出的CNN-GRU框架优于传统的SVM、KNN和BPNN方法,准确率达到99.5%。提出了一种可信赖、适应性强的CNN-GRU混合深度学习系统,提高了对驾驶员疲劳的识别能力。该项目是用Python实现的;它提供了一个实用和通用的解决方案,实时驾驶员困倦水平检测。这项拟议中的技术有可能通过发出早期预警和采取措施减少与驾驶员疲劳相关的风险,大大提高交通安全。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Unveiling an Innovative Approach to Q-Complex Neutrosophic Soft Rings A Note on Invertible Neutrosophic Square Matrices Selection of neutral networks using q-rung neutrosophic vague soft set TOPSIS aggregating operator setting multi-criteria group decision making Polynomial ideals of a ring based on neutrosophic sets SEE Transform in Difference Equations and Differential-Difference Equations Compared With Neutrosophic Difference Equations
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1