Gregor S. Reiter MD, PhD , Dmitrii Lachinov MSc , Wolf Bühl MD , Günther Weigert MD , Christoph Grechenig MD , Julia Mai MD , Hrvoje Bogunović PhD , Ursula Schmidt-Erfurth MD
{"title":"A Novel Management Challenge in Age-Related Macular Degeneration","authors":"Gregor S. Reiter MD, PhD , Dmitrii Lachinov MSc , Wolf Bühl MD , Günther Weigert MD , Christoph Grechenig MD , Julia Mai MD , Hrvoje Bogunović PhD , Ursula Schmidt-Erfurth MD","doi":"10.1016/j.oret.2024.10.029","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>The progression of geographic atrophy (GA) secondary to age-related macular degeneration is highly variable among individuals. Prediction of the progression is critical to identify patients who will benefit most from the first treatments currently approved. The aim of this study was to investigate the value and difference in predictive power between ophthalmologists and artificial intelligence (AI) in reliably assessing individual speed of GA progression.</div></div><div><h3>Design</h3><div>Prospective, expert and AI comparison study.</div></div><div><h3>Participants</h3><div>Eyes with natural progression of GA from a prospective study (NCT02503332).</div></div><div><h3>Methods</h3><div>Ophthalmologists predicted yearly growth speed of GA as well as selected the potentially faster-growing lesions from 2 eyes based on fundus autofluorescence (FAF), near-infrared reflectance (NIR), and OCT. A deep learning algorithm predicted progression solely on the baseline OCT (Spectralis, Heidelberg Engineering).</div></div><div><h3>Main Outcome Measures</h3><div>Accuracy, weighted κ, and concordance index (c-index) between the prediction made by ophthalmology specialists, ophthalmology residents, and the AI algorithm.</div></div><div><h3>Results</h3><div>A total of 134 eyes of 134 patients from a phase II clinical trial were included; among them, 53 were from the sham arm, and 81 were from untreated fellow eyes. Four ophthalmologists performed 2880 gradings. Human experts reached an accuracy of 0.37, 0.43, and 0.41 and a κ of 0.06, 0.16, and 0.18 on FAF, NIR + OCT, and FAF + NIR + OCT, respectively. On a pairwise comparison task, human experts achieved a c-index of 0.62, 0.59, and 0.60. Automated AI-based analysis reached an accuracy of 0.48 and κ of 0.23 on the first task, and c-index of 0.69 on the second task solely utilizing OCT imaging.</div></div><div><h3>Conclusions</h3><div>Prediction of individual progression will become an important task for patient counseling, most importantly with the treatments becoming available. Human gradings improved with the availability of OCT. However, automated AI performed better than ophthalmologists in several comparisons. Artificial intelligence–supported decisions improve clinical precision, access to timely care for the community, and socioeconomic feasibility in the management of the leading cause of irreversible vision loss.</div></div><div><h3>Financial Disclosure(s)</h3><div>The author(s) have no proprietary or commercial interest in any materials discussed in this article.</div></div>","PeriodicalId":19501,"journal":{"name":"Ophthalmology. Retina","volume":"9 5","pages":"Pages 421-430"},"PeriodicalIF":5.7000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ophthalmology. Retina","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2468653024005323","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
The progression of geographic atrophy (GA) secondary to age-related macular degeneration is highly variable among individuals. Prediction of the progression is critical to identify patients who will benefit most from the first treatments currently approved. The aim of this study was to investigate the value and difference in predictive power between ophthalmologists and artificial intelligence (AI) in reliably assessing individual speed of GA progression.
Design
Prospective, expert and AI comparison study.
Participants
Eyes with natural progression of GA from a prospective study (NCT02503332).
Methods
Ophthalmologists predicted yearly growth speed of GA as well as selected the potentially faster-growing lesions from 2 eyes based on fundus autofluorescence (FAF), near-infrared reflectance (NIR), and OCT. A deep learning algorithm predicted progression solely on the baseline OCT (Spectralis, Heidelberg Engineering).
Main Outcome Measures
Accuracy, weighted κ, and concordance index (c-index) between the prediction made by ophthalmology specialists, ophthalmology residents, and the AI algorithm.
Results
A total of 134 eyes of 134 patients from a phase II clinical trial were included; among them, 53 were from the sham arm, and 81 were from untreated fellow eyes. Four ophthalmologists performed 2880 gradings. Human experts reached an accuracy of 0.37, 0.43, and 0.41 and a κ of 0.06, 0.16, and 0.18 on FAF, NIR + OCT, and FAF + NIR + OCT, respectively. On a pairwise comparison task, human experts achieved a c-index of 0.62, 0.59, and 0.60. Automated AI-based analysis reached an accuracy of 0.48 and κ of 0.23 on the first task, and c-index of 0.69 on the second task solely utilizing OCT imaging.
Conclusions
Prediction of individual progression will become an important task for patient counseling, most importantly with the treatments becoming available. Human gradings improved with the availability of OCT. However, automated AI performed better than ophthalmologists in several comparisons. Artificial intelligence–supported decisions improve clinical precision, access to timely care for the community, and socioeconomic feasibility in the management of the leading cause of irreversible vision loss.
Financial Disclosure(s)
The author(s) have no proprietary or commercial interest in any materials discussed in this article.