Maziar Mirsalehi, Benjamin Fassbind, Andreas Streich, Achim Langenbucher
{"title":"利用卷积神经网络从用于角膜病识别的 Casia2 原始体积数据中预测外伤筛查指数","authors":"Maziar Mirsalehi, Benjamin Fassbind, Andreas Streich, Achim Langenbucher","doi":"10.1101/2024.09.13.24313607","DOIUrl":null,"url":null,"abstract":"Purpose\nPrediction of Ectasia Screening Index (ESI), an estimator provided by the Casia2 for identifying keratoconus, from raw Optical Coherence Tomography (OCT) data with Convolutional Neural Networks (CNN).\nMethods\nThree CNN architectures (ResNet18, DenseNet121 and EfficientNetB0) were employed to predict the ESI. Mean Absolute Error (MAE) was used as the performance metric for predicting the ESI by the adapted CNN models on the test set. Scans with an ESI value higher than a certain threshold were classified as Keratoconus, while the remaining scans were classified as Not Keratoconus. The models’ performance was evaluated using metrics such as accuracy, sensitivity, specificity, Positive Predictive Value (PPV) and F1 score on data collected from patients examined at the eye clinic of the Homburg University Hospital. The raw data from the Casia2 device, in 3dv format, was converted into 16 images per examination of one eye. For the training, validation and testing phases, 3689, 1050 and 1078 scans (3dv files) were selected, respectively. Results\nIn the prediction of the ESI, the MAE values for the adapted ResNet18, DenseNet121 and EfficientNetB0, rounded to two decimal places, were 7.15, 6.64 and 5.86, respectively. In the classification task, the three networks yielded an accuracy of 94.80%, 95.27% and 95.83%, respectively; a sensitivity of 92.07%, 94.64% and 94.17%, respectively; a specificity of 96.61%, 95.69% and 96.92%, respectively; a PPV of 94.72%, 93.55% and 95.28%, respectively; and a F1 score of 93.38%, 94.09% and 94.72%, respectively.\nConclusions\nOur results show that the prediction of keratokonus based on the ESI values estimated from raw data outperforms previous approaches using processed data. Adapted EfficientNetB0 outperformed both the other adapted models and those in state-of-the-art studies, with the highest accuracy and F1 score.","PeriodicalId":501390,"journal":{"name":"medRxiv - Ophthalmology","volume":"30 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Prediction of the ectasia screening index from raw Casia2 volume data for keratoconus identification by using convolutional neural networks\",\"authors\":\"Maziar Mirsalehi, Benjamin Fassbind, Andreas Streich, Achim Langenbucher\",\"doi\":\"10.1101/2024.09.13.24313607\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Purpose\\nPrediction of Ectasia Screening Index (ESI), an estimator provided by the Casia2 for identifying keratoconus, from raw Optical Coherence Tomography (OCT) data with Convolutional Neural Networks (CNN).\\nMethods\\nThree CNN architectures (ResNet18, DenseNet121 and EfficientNetB0) were employed to predict the ESI. Mean Absolute Error (MAE) was used as the performance metric for predicting the ESI by the adapted CNN models on the test set. Scans with an ESI value higher than a certain threshold were classified as Keratoconus, while the remaining scans were classified as Not Keratoconus. The models’ performance was evaluated using metrics such as accuracy, sensitivity, specificity, Positive Predictive Value (PPV) and F1 score on data collected from patients examined at the eye clinic of the Homburg University Hospital. The raw data from the Casia2 device, in 3dv format, was converted into 16 images per examination of one eye. For the training, validation and testing phases, 3689, 1050 and 1078 scans (3dv files) were selected, respectively. Results\\nIn the prediction of the ESI, the MAE values for the adapted ResNet18, DenseNet121 and EfficientNetB0, rounded to two decimal places, were 7.15, 6.64 and 5.86, respectively. In the classification task, the three networks yielded an accuracy of 94.80%, 95.27% and 95.83%, respectively; a sensitivity of 92.07%, 94.64% and 94.17%, respectively; a specificity of 96.61%, 95.69% and 96.92%, respectively; a PPV of 94.72%, 93.55% and 95.28%, respectively; and a F1 score of 93.38%, 94.09% and 94.72%, respectively.\\nConclusions\\nOur results show that the prediction of keratokonus based on the ESI values estimated from raw data outperforms previous approaches using processed data. Adapted EfficientNetB0 outperformed both the other adapted models and those in state-of-the-art studies, with the highest accuracy and F1 score.\",\"PeriodicalId\":501390,\"journal\":{\"name\":\"medRxiv - Ophthalmology\",\"volume\":\"30 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"medRxiv - Ophthalmology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1101/2024.09.13.24313607\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Ophthalmology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.09.13.24313607","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
目的利用卷积神经网络(CNN)从原始光学相干断层扫描(OCT)数据中预测外生殖器筛查指数(ESI),ESI 是 Casia2 提供的用于识别角膜病的估计值。采用平均绝对误差(MAE)作为测试集上经过调整的 CNN 模型预测 ESI 的性能指标。ESI值高于一定阈值的扫描被归类为角膜病,其余扫描则被归类为非角膜病。对模型的性能评估采用了准确度、灵敏度、特异性、正预测值(PPV)和 F1 分数等指标,数据收集自在霍姆堡大学医院眼科诊所接受检查的患者。Casia2 设备提供的 3dv 格式原始数据在每次检查中被转换成 16 幅单眼图像。在训练、验证和测试阶段,分别选择了 3689、1050 和 1078 个扫描(3dv 文件)。结果在预测 ESI 时,经过调整的 ResNet18、DenseNet121 和 EfficientNetB0 的 MAE 值(四舍五入到小数点后两位)分别为 7.15、6.64 和 5.86。在分类任务中,三个网络的准确率分别为 94.80%、95.27% 和 95.83%;灵敏度分别为 92.07%、94.64% 和 94.17%;特异性分别为 96.61%、95.69% 和 96.92%;PPV 分别为 94.72%、93.结论我们的结果表明,基于原始数据估算的 ESI 值预测角膜病的效果优于之前使用处理数据的方法。改编后的 EfficientNetB0 在准确率和 F1 分数方面均优于其他改编模型和最新研究中的模型。
Prediction of the ectasia screening index from raw Casia2 volume data for keratoconus identification by using convolutional neural networks
Purpose
Prediction of Ectasia Screening Index (ESI), an estimator provided by the Casia2 for identifying keratoconus, from raw Optical Coherence Tomography (OCT) data with Convolutional Neural Networks (CNN).
Methods
Three CNN architectures (ResNet18, DenseNet121 and EfficientNetB0) were employed to predict the ESI. Mean Absolute Error (MAE) was used as the performance metric for predicting the ESI by the adapted CNN models on the test set. Scans with an ESI value higher than a certain threshold were classified as Keratoconus, while the remaining scans were classified as Not Keratoconus. The models’ performance was evaluated using metrics such as accuracy, sensitivity, specificity, Positive Predictive Value (PPV) and F1 score on data collected from patients examined at the eye clinic of the Homburg University Hospital. The raw data from the Casia2 device, in 3dv format, was converted into 16 images per examination of one eye. For the training, validation and testing phases, 3689, 1050 and 1078 scans (3dv files) were selected, respectively. Results
In the prediction of the ESI, the MAE values for the adapted ResNet18, DenseNet121 and EfficientNetB0, rounded to two decimal places, were 7.15, 6.64 and 5.86, respectively. In the classification task, the three networks yielded an accuracy of 94.80%, 95.27% and 95.83%, respectively; a sensitivity of 92.07%, 94.64% and 94.17%, respectively; a specificity of 96.61%, 95.69% and 96.92%, respectively; a PPV of 94.72%, 93.55% and 95.28%, respectively; and a F1 score of 93.38%, 94.09% and 94.72%, respectively.
Conclusions
Our results show that the prediction of keratokonus based on the ESI values estimated from raw data outperforms previous approaches using processed data. Adapted EfficientNetB0 outperformed both the other adapted models and those in state-of-the-art studies, with the highest accuracy and F1 score.