Abadh K Chaurasia, Guei-Sheung Liu, Connor J Greatbatch, Puya Gharahkhani, Jamie E Craig, David A Mackey, Stuart MacGregor, Alex W Hewitt
{"title":"A generalised computer vision model for improved glaucoma screening using fundus images.","authors":"Abadh K Chaurasia, Guei-Sheung Liu, Connor J Greatbatch, Puya Gharahkhani, Jamie E Craig, David A Mackey, Stuart MacGregor, Alex W Hewitt","doi":"10.1038/s41433-024-03388-4","DOIUrl":null,"url":null,"abstract":"<p><strong>Importance: </strong>Worldwide, glaucoma is a leading cause of irreversible blindness. Timely detection is paramount yet challenging, particularly in resource-limited settings. A novel, computer vision-based model for glaucoma screening using fundus images could enhance early and accurate disease detection.</p><p><strong>Objective: </strong>To develop and validate a generalised deep-learning-based algorithm for screening glaucoma using fundus image.</p><p><strong>Design, setting and participants: </strong>The glaucomatous fundus data were collected from 20 publicly accessible databases worldwide, resulting in 18,468 images from multiple clinical settings, of which 10,900 were classified as healthy and 7568 as glaucoma. All the data were evaluated and downsized to fit the model's input requirements. The potential model was selected from 20 pre-trained models and trained on the whole dataset except Drishti-GS. The best-performing model was further trained to classify healthy and glaucomatous fundus images using Fastai and PyTorch libraries.</p><p><strong>Main outcomes and measures: </strong>The model's performance was compared against the actual class using the area under the receiver operating characteristic (AUROC), sensitivity, specificity, accuracy, precision and the F1-score.</p><p><strong>Results: </strong>The high discriminative ability of the best-performing model was evaluated on a dataset comprising 1364 glaucomatous discs and 2047 healthy discs. The model reflected robust performance metrics, with an AUROC of 0.9920 (95% CI: 0.9920-0.9921) for both the glaucoma and healthy classes. The sensitivity, specificity, accuracy, precision, recall and F1-scores were consistently higher than 0.9530 for both classes. The model performed well on an external validation set of the Drishti-GS dataset, with an AUROC of 0.8751 and an accuracy of 0.8713.</p><p><strong>Conclusions and relevance: </strong>This study demonstrated the high efficacy of our classification model in distinguishing between glaucomatous and healthy discs. However, the model's accuracy slightly dropped when evaluated on unseen data, indicating potential inconsistencies among the datasets-the model needs to be refined and validated on larger, more diverse datasets to ensure reliability and generalisability. Despite this, our model can be utilised for screening glaucoma at the population level.</p>","PeriodicalId":12125,"journal":{"name":"Eye","volume":" ","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Eye","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1038/s41433-024-03388-4","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Importance: Worldwide, glaucoma is a leading cause of irreversible blindness. Timely detection is paramount yet challenging, particularly in resource-limited settings. A novel, computer vision-based model for glaucoma screening using fundus images could enhance early and accurate disease detection.
Objective: To develop and validate a generalised deep-learning-based algorithm for screening glaucoma using fundus image.
Design, setting and participants: The glaucomatous fundus data were collected from 20 publicly accessible databases worldwide, resulting in 18,468 images from multiple clinical settings, of which 10,900 were classified as healthy and 7568 as glaucoma. All the data were evaluated and downsized to fit the model's input requirements. The potential model was selected from 20 pre-trained models and trained on the whole dataset except Drishti-GS. The best-performing model was further trained to classify healthy and glaucomatous fundus images using Fastai and PyTorch libraries.
Main outcomes and measures: The model's performance was compared against the actual class using the area under the receiver operating characteristic (AUROC), sensitivity, specificity, accuracy, precision and the F1-score.
Results: The high discriminative ability of the best-performing model was evaluated on a dataset comprising 1364 glaucomatous discs and 2047 healthy discs. The model reflected robust performance metrics, with an AUROC of 0.9920 (95% CI: 0.9920-0.9921) for both the glaucoma and healthy classes. The sensitivity, specificity, accuracy, precision, recall and F1-scores were consistently higher than 0.9530 for both classes. The model performed well on an external validation set of the Drishti-GS dataset, with an AUROC of 0.8751 and an accuracy of 0.8713.
Conclusions and relevance: This study demonstrated the high efficacy of our classification model in distinguishing between glaucomatous and healthy discs. However, the model's accuracy slightly dropped when evaluated on unseen data, indicating potential inconsistencies among the datasets-the model needs to be refined and validated on larger, more diverse datasets to ensure reliability and generalisability. Despite this, our model can be utilised for screening glaucoma at the population level.
期刊介绍:
Eye seeks to provide the international practising ophthalmologist with high quality articles, of academic rigour, on the latest global clinical and laboratory based research. Its core aim is to advance the science and practice of ophthalmology with the latest clinical- and scientific-based research. Whilst principally aimed at the practising clinician, the journal contains material of interest to a wider readership including optometrists, orthoptists, other health care professionals and research workers in all aspects of the field of visual science worldwide. Eye is the official journal of The Royal College of Ophthalmologists.
Eye encourages the submission of original articles covering all aspects of ophthalmology including: external eye disease; oculo-plastic surgery; orbital and lacrimal disease; ocular surface and corneal disorders; paediatric ophthalmology and strabismus; glaucoma; medical and surgical retina; neuro-ophthalmology; cataract and refractive surgery; ocular oncology; ophthalmic pathology; ophthalmic genetics.