Ayse Gungor,Raymond P Najjar,Steffen Hamann,Zhiqun Tang,Wolf A Lagrèze,Riccardo Sadun,Kanchalika Sathianvichitr,Marc J Dinkin,Cristiano Oliveira,Anfei Li,Federico Sadun,Andrew R Carey,Walid Bouthour,Mung Yan Lin,Jing-Liang Loo,Neil R Miller,Nancy J Newman,Valérie Biousse,Dan Milea,
{"title":"Deep Learning to Discriminate Arteritic From Nonarteritic Ischemic Optic Neuropathy on Color Images.","authors":"Ayse Gungor,Raymond P Najjar,Steffen Hamann,Zhiqun Tang,Wolf A Lagrèze,Riccardo Sadun,Kanchalika Sathianvichitr,Marc J Dinkin,Cristiano Oliveira,Anfei Li,Federico Sadun,Andrew R Carey,Walid Bouthour,Mung Yan Lin,Jing-Liang Loo,Neil R Miller,Nancy J Newman,Valérie Biousse,Dan Milea,","doi":"10.1001/jamaophthalmol.2024.4269","DOIUrl":null,"url":null,"abstract":"Importance\r\nPrompt and accurate diagnosis of arteritic anterior ischemic optic neuropathy (AAION) from giant cell arteritis and other systemic vasculitis can contribute to preventing irreversible vision loss from these conditions. Its clinical distinction from nonarteritic anterior ischemic optic neuropathy (NAION) can be challenging, especially when systemic symptoms are lacking or laboratory markers of the disease are not reliable.\r\n\r\nObjective\r\nTo develop, train, and test a deep learning system (DLS) to discriminate AAION from NAION on color fundus images during the acute phase.\r\n\r\nDesign, Setting, and Participants\r\nThis was an international study including color fundus images of 961 eyes of 802 patients with confirmed AAION and NAION. Training was performed using images from 21 expert neuro-ophthalmology centers in 16 countries, while external testing was performed in a cohort from 5 expert neuro-ophthalmology centers in the US and Europe. Data for training and external testing were collected from August 2018 to January 2023. A mix of deidentified images of 2 fields of view (optic disc centered and macula centered) were used. For training and internal validation, images were from 16 fundus camera models with fields of 30° to 55°. For external testing, images were from 5 fundus cameras with fields of 30° to 50°. Data were analyzed from January 2023 to January 2024.\r\n\r\nMain Outcomes and Measures\r\nThe performance of the DLS was measured using area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and accuracy.\r\n\r\nResults\r\nIn the training and validation sets, 374 (54.9%) of patients were female, 301 (44.2%) were male, and 6 (0.9%) were of unknown sex; the median (range) age was 66 (23-96) years. When tested on the external dataset including 121 patients (35 [28.9%] female, 44 [36.4%] male, and 42 [34.7%] of unknown sex; median [range] age, 69 [37-89] years), the DLS achieved an AUC of 0.97 (95% CI, 0.95-0.99), a sensitivity of 91.1% (95% CI, 85.2-96.9), a specificity of 93.4% (95% CI, 91.1-98.2), and an accuracy of 92.6% (95% CI, 90.5-96.6). The accuracy of the 2 experts for classification of the same dataset was 74.3% (95% CI, 66.7-81.9) and 81.6% (95% CI, 74.8-88.4), respectively.\r\n\r\nConclusions and Relevance\r\nA DLS showing disease-specific averaged class-activation maps had greater than 90% accuracy at discriminating between acute AAION from NAION on color fundus images, at the eye level, without any clinical or biomarker information. A DLS that identifies AAION could improve clinical decision-making, potentially reducing the risk of misdiagnosis and improving patient outcomes.","PeriodicalId":14518,"journal":{"name":"JAMA ophthalmology","volume":"14 1","pages":""},"PeriodicalIF":7.8000,"publicationDate":"2024-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JAMA ophthalmology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1001/jamaophthalmol.2024.4269","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Importance
Prompt and accurate diagnosis of arteritic anterior ischemic optic neuropathy (AAION) from giant cell arteritis and other systemic vasculitis can contribute to preventing irreversible vision loss from these conditions. Its clinical distinction from nonarteritic anterior ischemic optic neuropathy (NAION) can be challenging, especially when systemic symptoms are lacking or laboratory markers of the disease are not reliable.
Objective
To develop, train, and test a deep learning system (DLS) to discriminate AAION from NAION on color fundus images during the acute phase.
Design, Setting, and Participants
This was an international study including color fundus images of 961 eyes of 802 patients with confirmed AAION and NAION. Training was performed using images from 21 expert neuro-ophthalmology centers in 16 countries, while external testing was performed in a cohort from 5 expert neuro-ophthalmology centers in the US and Europe. Data for training and external testing were collected from August 2018 to January 2023. A mix of deidentified images of 2 fields of view (optic disc centered and macula centered) were used. For training and internal validation, images were from 16 fundus camera models with fields of 30° to 55°. For external testing, images were from 5 fundus cameras with fields of 30° to 50°. Data were analyzed from January 2023 to January 2024.
Main Outcomes and Measures
The performance of the DLS was measured using area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and accuracy.
Results
In the training and validation sets, 374 (54.9%) of patients were female, 301 (44.2%) were male, and 6 (0.9%) were of unknown sex; the median (range) age was 66 (23-96) years. When tested on the external dataset including 121 patients (35 [28.9%] female, 44 [36.4%] male, and 42 [34.7%] of unknown sex; median [range] age, 69 [37-89] years), the DLS achieved an AUC of 0.97 (95% CI, 0.95-0.99), a sensitivity of 91.1% (95% CI, 85.2-96.9), a specificity of 93.4% (95% CI, 91.1-98.2), and an accuracy of 92.6% (95% CI, 90.5-96.6). The accuracy of the 2 experts for classification of the same dataset was 74.3% (95% CI, 66.7-81.9) and 81.6% (95% CI, 74.8-88.4), respectively.
Conclusions and Relevance
A DLS showing disease-specific averaged class-activation maps had greater than 90% accuracy at discriminating between acute AAION from NAION on color fundus images, at the eye level, without any clinical or biomarker information. A DLS that identifies AAION could improve clinical decision-making, potentially reducing the risk of misdiagnosis and improving patient outcomes.
期刊介绍:
JAMA Ophthalmology, with a rich history of continuous publication since 1869, stands as a distinguished international, peer-reviewed journal dedicated to ophthalmology and visual science. In 2019, the journal proudly commemorated 150 years of uninterrupted service to the field. As a member of the esteemed JAMA Network, a consortium renowned for its peer-reviewed general medical and specialty publications, JAMA Ophthalmology upholds the highest standards of excellence in disseminating cutting-edge research and insights. Join us in celebrating our legacy and advancing the frontiers of ophthalmology and visual science.