Lincoln Chivinge, Leslie Kudzai Nyandoro, Kudakwashe Zvarevashe
{"title":"二次加权Kappa评分在糖尿病视网膜病变严重程度分级中的应用","authors":"Lincoln Chivinge, Leslie Kudzai Nyandoro, Kudakwashe Zvarevashe","doi":"10.1109/ZCICT55726.2022.10045938","DOIUrl":null,"url":null,"abstract":"Diabetic Retinopathy (DR), chronic progressive disease of the eye, may give rise to permanent sight loss. Clinicians use fundus pictures to check if DR is present and rely on physicians to diagnose the stage or severity by visual inspection of the images. In relying on a clinician’s subjective prognosis, this is deemed a procedure that takes a lot of time and susceptible to misjudgements. In discovering DR, poor Quadratic Weighted Kappa (QWK) scores have resulted from poor quality of pictures and imbalanced distribution of classes. Even though studies have shown high accuracy, sensitivity, specificity and ROC metrics, their limitation is that they do not consider the level of disparity across the classified labels. The QWK score demonstrates that even if an algorithm presents high accuracy, it is still not best fit to classify DR into its 5 classes. Many researchers have tried fine-tuning the neural network to create noise-resistant deep learning and recorded high accuracy and sensitivity but low QWK scores. The problem with the other methods is mainly pre-processing of the images and model building patterns. Most of the studied literature lacks the image augmentation step which might lead to an erroneous result. This research aims to create an algorithm from deep learning models with a data augmentation step and demonstrate how important it is for attaining better QWK scores for all stages of diabetic retinopathy. The model met study objectives and obtained an accuracy of 93% and a QWK score of 0.961. The outcomes show that the method can make accurate predictions without need for human feature extraction and that it may be used as an early DR diagnostic and staging screening tool.","PeriodicalId":125540,"journal":{"name":"2022 1st Zimbabwe Conference of Information and Communication Technologies (ZCICT)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Quadratic Weighted Kappa Score Exploration in Diabetic Retinopathy Severity Classification Using EfficientNet\",\"authors\":\"Lincoln Chivinge, Leslie Kudzai Nyandoro, Kudakwashe Zvarevashe\",\"doi\":\"10.1109/ZCICT55726.2022.10045938\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Diabetic Retinopathy (DR), chronic progressive disease of the eye, may give rise to permanent sight loss. Clinicians use fundus pictures to check if DR is present and rely on physicians to diagnose the stage or severity by visual inspection of the images. In relying on a clinician’s subjective prognosis, this is deemed a procedure that takes a lot of time and susceptible to misjudgements. In discovering DR, poor Quadratic Weighted Kappa (QWK) scores have resulted from poor quality of pictures and imbalanced distribution of classes. Even though studies have shown high accuracy, sensitivity, specificity and ROC metrics, their limitation is that they do not consider the level of disparity across the classified labels. The QWK score demonstrates that even if an algorithm presents high accuracy, it is still not best fit to classify DR into its 5 classes. Many researchers have tried fine-tuning the neural network to create noise-resistant deep learning and recorded high accuracy and sensitivity but low QWK scores. The problem with the other methods is mainly pre-processing of the images and model building patterns. Most of the studied literature lacks the image augmentation step which might lead to an erroneous result. This research aims to create an algorithm from deep learning models with a data augmentation step and demonstrate how important it is for attaining better QWK scores for all stages of diabetic retinopathy. The model met study objectives and obtained an accuracy of 93% and a QWK score of 0.961. The outcomes show that the method can make accurate predictions without need for human feature extraction and that it may be used as an early DR diagnostic and staging screening tool.\",\"PeriodicalId\":125540,\"journal\":{\"name\":\"2022 1st Zimbabwe Conference of Information and Communication Technologies (ZCICT)\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 1st Zimbabwe Conference of Information and Communication Technologies (ZCICT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ZCICT55726.2022.10045938\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 1st Zimbabwe Conference of Information and Communication Technologies (ZCICT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ZCICT55726.2022.10045938","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Quadratic Weighted Kappa Score Exploration in Diabetic Retinopathy Severity Classification Using EfficientNet
Diabetic Retinopathy (DR), chronic progressive disease of the eye, may give rise to permanent sight loss. Clinicians use fundus pictures to check if DR is present and rely on physicians to diagnose the stage or severity by visual inspection of the images. In relying on a clinician’s subjective prognosis, this is deemed a procedure that takes a lot of time and susceptible to misjudgements. In discovering DR, poor Quadratic Weighted Kappa (QWK) scores have resulted from poor quality of pictures and imbalanced distribution of classes. Even though studies have shown high accuracy, sensitivity, specificity and ROC metrics, their limitation is that they do not consider the level of disparity across the classified labels. The QWK score demonstrates that even if an algorithm presents high accuracy, it is still not best fit to classify DR into its 5 classes. Many researchers have tried fine-tuning the neural network to create noise-resistant deep learning and recorded high accuracy and sensitivity but low QWK scores. The problem with the other methods is mainly pre-processing of the images and model building patterns. Most of the studied literature lacks the image augmentation step which might lead to an erroneous result. This research aims to create an algorithm from deep learning models with a data augmentation step and demonstrate how important it is for attaining better QWK scores for all stages of diabetic retinopathy. The model met study objectives and obtained an accuracy of 93% and a QWK score of 0.961. The outcomes show that the method can make accurate predictions without need for human feature extraction and that it may be used as an early DR diagnostic and staging screening tool.