Performance and limitation of machine learning algorithms for diabetic retinopathy screening and its application in health management: a meta-analysis.
Mehrsa Moannaei, Faezeh Jadidian, Tahereh Doustmohammadi, Amir Mohammad Kiapasha, Romina Bayani, Mohammadreza Rahmani, Mohammad Reza Jahanbazy, Fereshteh Sohrabivafa, Mahsa Asadi Anar, Amin Magsudy, Seyyed Kiarash Sadat Rafiei, Yaser Khakpour
{"title":"Performance and limitation of machine learning algorithms for diabetic retinopathy screening and its application in health management: a meta-analysis.","authors":"Mehrsa Moannaei, Faezeh Jadidian, Tahereh Doustmohammadi, Amir Mohammad Kiapasha, Romina Bayani, Mohammadreza Rahmani, Mohammad Reza Jahanbazy, Fereshteh Sohrabivafa, Mahsa Asadi Anar, Amin Magsudy, Seyyed Kiarash Sadat Rafiei, Yaser Khakpour","doi":"10.1186/s12938-025-01336-1","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>In recent years, artificial intelligence and machine learning algorithms have been used more extensively to diagnose diabetic retinopathy and other diseases. Still, the effectiveness of these methods has not been thoroughly investigated. This study aimed to evaluate the performance and limitations of machine learning and deep learning algorithms in detecting diabetic retinopathy.</p><p><strong>Methods: </strong>This study was conducted based on the PRISMA checklist. We searched online databases, including PubMed, Scopus, and Google Scholar, for relevant articles up to September 30, 2023. After the title, abstract, and full-text screening, data extraction and quality assessment were done for the included studies. Finally, a meta-analysis was performed.</p><p><strong>Results: </strong>We included 76 studies with a total of 1,371,517 retinal images, of which 51 were used for meta-analysis. Our meta-analysis showed a significant sensitivity and specificity with a percentage of 90.54 (95%CI [90.42, 90.66], P < 0.001) and 78.33% (95%CI [78.21, 78.45], P < 0.001). However, the AUC (area under curvature) did not statistically differ across studies, but had a significant figure of 0.94 (95% CI [- 46.71, 48.60], P = 1).</p><p><strong>Conclusions: </strong>Although machine learning and deep learning algorithms can properly diagnose diabetic retinopathy, their discriminating capacity is limited. However, they could simplify the diagnosing process. Further studies are required to improve algorithms.</p>","PeriodicalId":8927,"journal":{"name":"BioMedical Engineering OnLine","volume":"24 1","pages":"34"},"PeriodicalIF":2.9000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BioMedical Engineering OnLine","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1186/s12938-025-01336-1","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Background: In recent years, artificial intelligence and machine learning algorithms have been used more extensively to diagnose diabetic retinopathy and other diseases. Still, the effectiveness of these methods has not been thoroughly investigated. This study aimed to evaluate the performance and limitations of machine learning and deep learning algorithms in detecting diabetic retinopathy.
Methods: This study was conducted based on the PRISMA checklist. We searched online databases, including PubMed, Scopus, and Google Scholar, for relevant articles up to September 30, 2023. After the title, abstract, and full-text screening, data extraction and quality assessment were done for the included studies. Finally, a meta-analysis was performed.
Results: We included 76 studies with a total of 1,371,517 retinal images, of which 51 were used for meta-analysis. Our meta-analysis showed a significant sensitivity and specificity with a percentage of 90.54 (95%CI [90.42, 90.66], P < 0.001) and 78.33% (95%CI [78.21, 78.45], P < 0.001). However, the AUC (area under curvature) did not statistically differ across studies, but had a significant figure of 0.94 (95% CI [- 46.71, 48.60], P = 1).
Conclusions: Although machine learning and deep learning algorithms can properly diagnose diabetic retinopathy, their discriminating capacity is limited. However, they could simplify the diagnosing process. Further studies are required to improve algorithms.
期刊介绍:
BioMedical Engineering OnLine is an open access, peer-reviewed journal that is dedicated to publishing research in all areas of biomedical engineering.
BioMedical Engineering OnLine is aimed at readers and authors throughout the world, with an interest in using tools of the physical and data sciences and techniques in engineering to understand and solve problems in the biological and medical sciences. Topical areas include, but are not limited to:
Bioinformatics-
Bioinstrumentation-
Biomechanics-
Biomedical Devices & Instrumentation-
Biomedical Signal Processing-
Healthcare Information Systems-
Human Dynamics-
Neural Engineering-
Rehabilitation Engineering-
Biomaterials-
Biomedical Imaging & Image Processing-
BioMEMS and On-Chip Devices-
Bio-Micro/Nano Technologies-
Biomolecular Engineering-
Biosensors-
Cardiovascular Systems Engineering-
Cellular Engineering-
Clinical Engineering-
Computational Biology-
Drug Delivery Technologies-
Modeling Methodologies-
Nanomaterials and Nanotechnology in Biomedicine-
Respiratory Systems Engineering-
Robotics in Medicine-
Systems and Synthetic Biology-
Systems Biology-
Telemedicine/Smartphone Applications in Medicine-
Therapeutic Systems, Devices and Technologies-
Tissue Engineering