Jad F Assaf, Hady Yazbeck, Prajna N Venkatesh, Lalitha Prajna, Rameshkumar Gunasekaran, Karpagam Rajarathinam, Thomas M Lietman, Jeremy D Keenan, J Peter Campbell, Xubo Song, Travis K Redd
{"title":"Automated Detection of Filamentous Fungal Keratitis on Whole Slide Images of Potassium Hydroxide Smears with Multiple Instance Learning.","authors":"Jad F Assaf, Hady Yazbeck, Prajna N Venkatesh, Lalitha Prajna, Rameshkumar Gunasekaran, Karpagam Rajarathinam, Thomas M Lietman, Jeremy D Keenan, J Peter Campbell, Xubo Song, Travis K Redd","doi":"10.1016/j.xops.2024.100653","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>The diagnosis of fungal keratitis using potassium hydroxide (KOH) smears of corneal scrapings enables initiation of the correct antimicrobial therapy at the point-of-care but requires time-consuming manual examination and expertise. This study evaluates the efficacy of a deep learning framework, dual stream multiple instance learning (DSMIL), in automating the analysis of whole slide imaging (WSI) of KOH smears for rapid and accurate detection of fungal infections.</p><p><strong>Design: </strong>Retrospective observational study.</p><p><strong>Participants: </strong>Corneal scrapings from 568 patients with suspected fungal keratitis; 51% contained filamentous fungi according to human expert interpretation.</p><p><strong>Methods: </strong>Dual stream multiple instance learning was employed to analyze WSI of KOH smears. Due to the extensive size of these images, often exceeding 100 000 pixels, conventional computer vision methods (e.g., convolutional neural networks) are not feasible. Dual stream multiple instance learning segments the WSI into patches for analysis, extracting relevant features from each patch and aggregating these to make a comprehensive slide-level diagnosis while generating heat maps to visualize areas contributing most to the prediction. Fivefold cross-validation was used for training and validation, with a hold-out test set comprising 15% of the total samples.</p><p><strong>Main outcome measures: </strong>Accuracy, sensitivity, specificity, area under the receiver operating characteristic curve (AUC), F1 score, positive predictive value (PPV), and negative predictive value (NPV) in distinguishing fungal from nonfungal slides.</p><p><strong>Results: </strong>Dual stream multiple instance learning demonstrated an overall AUC of 0.88 with an accuracy of 79% and an F1 score of 0.79 in distinguishing fungal from nonfungal slides, with sensitivity of 85%, specificity of 71%, PPV of 80%, and NPV of 79%. For \"consensus cases,\" where 2 human graders agreed on the slide interpretation, the model achieved an accuracy of 85% and an F1 score of 0.85. For \"discrepant cases,\" the accuracy was 71% with an F1 score of 0.71. The generated heatmaps highlighted regions corresponding to fungal elements. Code and models are open-sourced and available at https://github.com/Redd-Cornea-AI/KOH-Smear-DSMIL.</p><p><strong>Conclusions: </strong>The DSMIL framework shows significant promise in automating interpretation of KOH smears. Its capability to handle large, high-resolution WSI data and accurately detect fungal infections, while providing visual explanations through heatmaps, could enhance the scalability of KOH smear interpretation, ultimately reducing the global burden of blindness from infectious keratitis.</p><p><strong>Financial disclosures: </strong>Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.</p>","PeriodicalId":74363,"journal":{"name":"Ophthalmology science","volume":"5 2","pages":"100653"},"PeriodicalIF":3.2000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11731208/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ophthalmology science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1016/j.xops.2024.100653","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/3/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: The diagnosis of fungal keratitis using potassium hydroxide (KOH) smears of corneal scrapings enables initiation of the correct antimicrobial therapy at the point-of-care but requires time-consuming manual examination and expertise. This study evaluates the efficacy of a deep learning framework, dual stream multiple instance learning (DSMIL), in automating the analysis of whole slide imaging (WSI) of KOH smears for rapid and accurate detection of fungal infections.
Design: Retrospective observational study.
Participants: Corneal scrapings from 568 patients with suspected fungal keratitis; 51% contained filamentous fungi according to human expert interpretation.
Methods: Dual stream multiple instance learning was employed to analyze WSI of KOH smears. Due to the extensive size of these images, often exceeding 100 000 pixels, conventional computer vision methods (e.g., convolutional neural networks) are not feasible. Dual stream multiple instance learning segments the WSI into patches for analysis, extracting relevant features from each patch and aggregating these to make a comprehensive slide-level diagnosis while generating heat maps to visualize areas contributing most to the prediction. Fivefold cross-validation was used for training and validation, with a hold-out test set comprising 15% of the total samples.
Main outcome measures: Accuracy, sensitivity, specificity, area under the receiver operating characteristic curve (AUC), F1 score, positive predictive value (PPV), and negative predictive value (NPV) in distinguishing fungal from nonfungal slides.
Results: Dual stream multiple instance learning demonstrated an overall AUC of 0.88 with an accuracy of 79% and an F1 score of 0.79 in distinguishing fungal from nonfungal slides, with sensitivity of 85%, specificity of 71%, PPV of 80%, and NPV of 79%. For "consensus cases," where 2 human graders agreed on the slide interpretation, the model achieved an accuracy of 85% and an F1 score of 0.85. For "discrepant cases," the accuracy was 71% with an F1 score of 0.71. The generated heatmaps highlighted regions corresponding to fungal elements. Code and models are open-sourced and available at https://github.com/Redd-Cornea-AI/KOH-Smear-DSMIL.
Conclusions: The DSMIL framework shows significant promise in automating interpretation of KOH smears. Its capability to handle large, high-resolution WSI data and accurately detect fungal infections, while providing visual explanations through heatmaps, could enhance the scalability of KOH smear interpretation, ultimately reducing the global burden of blindness from infectious keratitis.
Financial disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.