Jing Shan MD, PhD , Zhixi Li MD , Ping Ma MD, PhD , Tin A. Tun MD , Sean Yonamine , Yangyan Wu MS , Mani Baskaran DO, PhD , Monisha E. Nongpiur MD, PhD , Dake Chen PhD , Tin Aung MMed, PhD , Shuning Li MD , Mingguang He MD, PhD , Yangfan Yang MD , Ying Han MD, PhD
{"title":"Deep Learning Classification of Angle Closure based on Anterior Segment OCT","authors":"Jing Shan MD, PhD , Zhixi Li MD , Ping Ma MD, PhD , Tin A. Tun MD , Sean Yonamine , Yangyan Wu MS , Mani Baskaran DO, PhD , Monisha E. Nongpiur MD, PhD , Dake Chen PhD , Tin Aung MMed, PhD , Shuning Li MD , Mingguang He MD, PhD , Yangfan Yang MD , Ying Han MD, PhD","doi":"10.1016/j.ogla.2023.06.011","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><p>To assess the performance and generalizability of a convolutional neural network (CNN) model for objective and high-throughput identification of primary angle-closure disease (PACD) as well as PACD stage differentiation on anterior segment swept-source OCT (AS-OCT).</p></div><div><h3>Design</h3><p>Cross-sectional.</p></div><div><h3>Participants</h3><p>Patients from 3 different eye centers across China and Singapore were recruited for this study. Eight hundred forty-one eyes from the 2 Chinese centers were divided into 170 control eyes, 488 PACS, and 183 PAC + PACG eyes. An additional 300 eyes were recruited from Singapore National Eye Center as a testing data set, divided into 100 control eyes, 100 PACS, and 100 PAC + PACG eyes.</p></div><div><h3>Methods</h3><p>Each participant underwent standardized ophthalmic examination and was classified by the presiding physician as either control, primary angle-closure suspect (PACS), primary angle closure (PAC), or primary angle-closure glaucoma (PACG). Deep Learning model was used to train 3 different CNN classifiers: classifier 1 aimed to separate control versus PACS versus PAC + PACG; classifier 2 aimed to separate control versus PACD; and classifier 3 aimed to separate PACS versus PAC + PACG. All classifiers were evaluated on independent validation sets from the same region, China and further tested using data from a different country, Singapore.</p></div><div><h3>Main Outcome Measures</h3><p>Area under receiver operator characteristic curve (AUC), precision, and recall.</p></div><div><h3>Results</h3><p>Classifier 1 achieved an AUC of 0.96 on validation set from the same region, but dropped to an AUC of 0.84 on test set from a different country. Classifier 2 achieved the most generalizable performance with an AUC of 0.96 on validation set and AUC of 0.95 on test set. Classifier 3 showed the poorest performance, with an AUC of 0.83 and 0.64 on test and validation data sets, respectively.</p></div><div><h3>Conclusions</h3><p>Convolutional neural network classifiers can effectively distinguish PACD from controls on AS-OCT with good generalizability across different patient cohorts. However, their performance is moderate when trying to distinguish PACS versus PAC + PACG.</p></div><div><h3>Financial Disclosures</h3><p>The authors have no proprietary or commercial interest in any materials discussed in this article.</p></div>","PeriodicalId":19519,"journal":{"name":"Ophthalmology. Glaucoma","volume":"7 1","pages":"Pages 8-15"},"PeriodicalIF":2.8000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ophthalmology. Glaucoma","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S258941962300128X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
To assess the performance and generalizability of a convolutional neural network (CNN) model for objective and high-throughput identification of primary angle-closure disease (PACD) as well as PACD stage differentiation on anterior segment swept-source OCT (AS-OCT).
Design
Cross-sectional.
Participants
Patients from 3 different eye centers across China and Singapore were recruited for this study. Eight hundred forty-one eyes from the 2 Chinese centers were divided into 170 control eyes, 488 PACS, and 183 PAC + PACG eyes. An additional 300 eyes were recruited from Singapore National Eye Center as a testing data set, divided into 100 control eyes, 100 PACS, and 100 PAC + PACG eyes.
Methods
Each participant underwent standardized ophthalmic examination and was classified by the presiding physician as either control, primary angle-closure suspect (PACS), primary angle closure (PAC), or primary angle-closure glaucoma (PACG). Deep Learning model was used to train 3 different CNN classifiers: classifier 1 aimed to separate control versus PACS versus PAC + PACG; classifier 2 aimed to separate control versus PACD; and classifier 3 aimed to separate PACS versus PAC + PACG. All classifiers were evaluated on independent validation sets from the same region, China and further tested using data from a different country, Singapore.
Main Outcome Measures
Area under receiver operator characteristic curve (AUC), precision, and recall.
Results
Classifier 1 achieved an AUC of 0.96 on validation set from the same region, but dropped to an AUC of 0.84 on test set from a different country. Classifier 2 achieved the most generalizable performance with an AUC of 0.96 on validation set and AUC of 0.95 on test set. Classifier 3 showed the poorest performance, with an AUC of 0.83 and 0.64 on test and validation data sets, respectively.
Conclusions
Convolutional neural network classifiers can effectively distinguish PACD from controls on AS-OCT with good generalizability across different patient cohorts. However, their performance is moderate when trying to distinguish PACS versus PAC + PACG.
Financial Disclosures
The authors have no proprietary or commercial interest in any materials discussed in this article.