Amira Mohamed, Doha Eid, Mariam M Ezzat, Mayar Ehab, Maye Khaled, Sarah Gaber, Amira Gaber
{"title":"Facia-Fix:利用计算机视觉和深度学习进行贝尔氏麻痹诊断和评估的移动应用程序。","authors":"Amira Mohamed, Doha Eid, Mariam M Ezzat, Mayar Ehab, Maye Khaled, Sarah Gaber, Amira Gaber","doi":"10.1088/2057-1976/ad8094","DOIUrl":null,"url":null,"abstract":"<p><p>Facial paralysis (FP) is a condition characterized by the inability to move some or all of the muscles on one or both sides of the face. Diagnosing FP presents challenges due to the limitations of traditional methods, which are time-consuming, uncomfortable for patients, and require specialized clinicians. Additionally, more advanced tools are often uncommonly available to all healthcare providers. Early and accurate detection of FP is crucial, as timely intervention can prevent long-term complications and improve patient outcomes. To address these challenges, our research introduces Facia-Fix, a mobile application for Bell's palsy diagnosis, integrating computer vision and deep learning techniques to provide real-time analysis of facial landmarks. The classification algorithms are trained on the publicly available YouTube FP (YFP) dataset, which is labeled using the House-Brackmann (HB) method, a standardized system for assessing the severity of FP. Different deep learning models were employed to classify the FP severity, such as MobileNet, CNN, MLP, VGG16, and Vision Transformer. The MobileNet model which uses transfer learning, achieved the highest performance (Accuracy: 0.9812, Precision: 0.9753, Recall: 0.9727, F1 Score: 0.974), establishing it as the optimal choice among the evaluated models. The innovation of this approach lies in its use of advanced deep learning models to provide accurate, objective, non-invasive and real-time comprehensive quantitative assessment of FP severity. Preliminary results highlight the potential of Facia-Fix to significantly improve the diagnostic and follow-up experiences for both clinicians and patients.</p>","PeriodicalId":8896,"journal":{"name":"Biomedical Physics & Engineering Express","volume":" ","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Facia-fix: mobile application for bell's palsy diagnosis and assessment using computer vision and deep learning.\",\"authors\":\"Amira Mohamed, Doha Eid, Mariam M Ezzat, Mayar Ehab, Maye Khaled, Sarah Gaber, Amira Gaber\",\"doi\":\"10.1088/2057-1976/ad8094\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Facial paralysis (FP) is a condition characterized by the inability to move some or all of the muscles on one or both sides of the face. Diagnosing FP presents challenges due to the limitations of traditional methods, which are time-consuming, uncomfortable for patients, and require specialized clinicians. Additionally, more advanced tools are often uncommonly available to all healthcare providers. Early and accurate detection of FP is crucial, as timely intervention can prevent long-term complications and improve patient outcomes. To address these challenges, our research introduces Facia-Fix, a mobile application for Bell's palsy diagnosis, integrating computer vision and deep learning techniques to provide real-time analysis of facial landmarks. The classification algorithms are trained on the publicly available YouTube FP (YFP) dataset, which is labeled using the House-Brackmann (HB) method, a standardized system for assessing the severity of FP. Different deep learning models were employed to classify the FP severity, such as MobileNet, CNN, MLP, VGG16, and Vision Transformer. The MobileNet model which uses transfer learning, achieved the highest performance (Accuracy: 0.9812, Precision: 0.9753, Recall: 0.9727, F1 Score: 0.974), establishing it as the optimal choice among the evaluated models. The innovation of this approach lies in its use of advanced deep learning models to provide accurate, objective, non-invasive and real-time comprehensive quantitative assessment of FP severity. Preliminary results highlight the potential of Facia-Fix to significantly improve the diagnostic and follow-up experiences for both clinicians and patients.</p>\",\"PeriodicalId\":8896,\"journal\":{\"name\":\"Biomedical Physics & Engineering Express\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":1.3000,\"publicationDate\":\"2024-10-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical Physics & Engineering Express\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1088/2057-1976/ad8094\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Physics & Engineering Express","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1088/2057-1976/ad8094","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
Facia-fix: mobile application for bell's palsy diagnosis and assessment using computer vision and deep learning.
Facial paralysis (FP) is a condition characterized by the inability to move some or all of the muscles on one or both sides of the face. Diagnosing FP presents challenges due to the limitations of traditional methods, which are time-consuming, uncomfortable for patients, and require specialized clinicians. Additionally, more advanced tools are often uncommonly available to all healthcare providers. Early and accurate detection of FP is crucial, as timely intervention can prevent long-term complications and improve patient outcomes. To address these challenges, our research introduces Facia-Fix, a mobile application for Bell's palsy diagnosis, integrating computer vision and deep learning techniques to provide real-time analysis of facial landmarks. The classification algorithms are trained on the publicly available YouTube FP (YFP) dataset, which is labeled using the House-Brackmann (HB) method, a standardized system for assessing the severity of FP. Different deep learning models were employed to classify the FP severity, such as MobileNet, CNN, MLP, VGG16, and Vision Transformer. The MobileNet model which uses transfer learning, achieved the highest performance (Accuracy: 0.9812, Precision: 0.9753, Recall: 0.9727, F1 Score: 0.974), establishing it as the optimal choice among the evaluated models. The innovation of this approach lies in its use of advanced deep learning models to provide accurate, objective, non-invasive and real-time comprehensive quantitative assessment of FP severity. Preliminary results highlight the potential of Facia-Fix to significantly improve the diagnostic and follow-up experiences for both clinicians and patients.
期刊介绍:
BPEX is an inclusive, international, multidisciplinary journal devoted to publishing new research on any application of physics and/or engineering in medicine and/or biology. Characterized by a broad geographical coverage and a fast-track peer-review process, relevant topics include all aspects of biophysics, medical physics and biomedical engineering. Papers that are almost entirely clinical or biological in their focus are not suitable. The journal has an emphasis on publishing interdisciplinary work and bringing research fields together, encompassing experimental, theoretical and computational work.