基于pynqz1和jetsonxavier NX的ADAS疲劳控制系统设计

Yassin Kortli, Souhir Gabsi, L. L. Y. Lew Yan Voon, M. Jridi
{"title":"基于pynqz1和jetsonxavier NX的ADAS疲劳控制系统设计","authors":"Yassin Kortli, Souhir Gabsi, L. L. Y. Lew Yan Voon, M. Jridi","doi":"10.1109/SETIT54465.2022.9875823","DOIUrl":null,"url":null,"abstract":"In recent years, driver fatigue and drowsiness have been presented as the main factors of road accidents with a high rate of passenger deaths, injuries and property losses. In this paper, we developed a monitoring system for vehicle drivers that detects and warns of the presence of fatigue and drowsiness through computer vision or machine vision. Our developed system consists of four steps: training of the classifier to perform the detection module, image acquisition and processing, detection and alarm activation. Firstly, training of classifier was performed using Haar technique to locate face features. Secondly, a Jetson Xavier NX or Pynq Z1 development board was used to perform real-time video using a 4K camera, thirdly, we use the training classifier to detect the face image and facial landmark algorithm proposed by Kazemi & Sullivan to detect face features. Finally, our system analyses the state characteristics of the eyes; once the processing is completed, the detection of drowsiness and fatigue is carried out.","PeriodicalId":126155,"journal":{"name":"2022 IEEE 9th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Design of ADAS Fatigue Control System using Pynq z1 and Jetson Xavier NX\",\"authors\":\"Yassin Kortli, Souhir Gabsi, L. L. Y. Lew Yan Voon, M. Jridi\",\"doi\":\"10.1109/SETIT54465.2022.9875823\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, driver fatigue and drowsiness have been presented as the main factors of road accidents with a high rate of passenger deaths, injuries and property losses. In this paper, we developed a monitoring system for vehicle drivers that detects and warns of the presence of fatigue and drowsiness through computer vision or machine vision. Our developed system consists of four steps: training of the classifier to perform the detection module, image acquisition and processing, detection and alarm activation. Firstly, training of classifier was performed using Haar technique to locate face features. Secondly, a Jetson Xavier NX or Pynq Z1 development board was used to perform real-time video using a 4K camera, thirdly, we use the training classifier to detect the face image and facial landmark algorithm proposed by Kazemi & Sullivan to detect face features. Finally, our system analyses the state characteristics of the eyes; once the processing is completed, the detection of drowsiness and fatigue is carried out.\",\"PeriodicalId\":126155,\"journal\":{\"name\":\"2022 IEEE 9th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT)\",\"volume\":\"26 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE 9th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SETIT54465.2022.9875823\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 9th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SETIT54465.2022.9875823","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

近年来,驾驶员疲劳和嗜睡已成为道路交通事故的主要因素,造成乘客伤亡和财产损失的比例很高。在本文中,我们为车辆驾驶员开发了一个监测系统,该系统通过计算机视觉或机器视觉检测并警告疲劳和困倦的存在。我们开发的系统包括四个步骤:训练分类器执行检测模块,图像采集和处理,检测和报警激活。首先,利用Haar技术对分类器进行训练,定位人脸特征;其次,使用Jetson Xavier NX或Pynq Z1开发板使用4K摄像机进行实时视频,第三,使用训练分类器检测人脸图像,使用Kazemi & Sullivan提出的人脸地标算法检测人脸特征。最后,系统分析了人眼的状态特征;一旦处理完成,就进行困倦和疲劳的检测。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Design of ADAS Fatigue Control System using Pynq z1 and Jetson Xavier NX
In recent years, driver fatigue and drowsiness have been presented as the main factors of road accidents with a high rate of passenger deaths, injuries and property losses. In this paper, we developed a monitoring system for vehicle drivers that detects and warns of the presence of fatigue and drowsiness through computer vision or machine vision. Our developed system consists of four steps: training of the classifier to perform the detection module, image acquisition and processing, detection and alarm activation. Firstly, training of classifier was performed using Haar technique to locate face features. Secondly, a Jetson Xavier NX or Pynq Z1 development board was used to perform real-time video using a 4K camera, thirdly, we use the training classifier to detect the face image and facial landmark algorithm proposed by Kazemi & Sullivan to detect face features. Finally, our system analyses the state characteristics of the eyes; once the processing is completed, the detection of drowsiness and fatigue is carried out.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A Comparison of Machine Learning Methods for best Accuracy COVID-19 Diagnosis Using Chest X-Ray Images Design and Simulation of a PV System Controlled through a Hybrid INC-PSO Algorithm using XSG Tool Analysing ICT Initiatives towards Smart Policing to Assist African Law Enforcement in Combating Cybercrimes Preliminary Study Of A Smart Computer System For Scholar Support Distributed Consensus Control for Multi-Agent Oscillatory Systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1