Alex T Pham, Chris Bradley, Kaihua Hou, Patrick Herbert, Mathias Unberath, Pradeep Y Ramulu, Jithin Yohannan
{"title":"利用光学相干断层扫描得出的视野估计值检测青光眼恶化。","authors":"Alex T Pham, Chris Bradley, Kaihua Hou, Patrick Herbert, Mathias Unberath, Pradeep Y Ramulu, Jithin Yohannan","doi":"10.1101/2024.10.17.24315710","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Multiple studies have attempted to generate visual field (VF) mean deviation (MD) estimates using cross-sectional optical coherence tomography (OCT) data. However, whether such models offer any value in detecting longitudinal VF progression is unclear. We address this by developing a machine learning (ML) model to convert OCT data to MD and assessing its ability to detect longitudinal worsening.</p><p><strong>Design: </strong>Retrospective, longitudinal study.</p><p><strong>Participants: </strong>A model dataset of 70,575 paired OCT/VFs to train an ML model converting OCT to VF-MD. A separate progression dataset of 4,044 eyes with ≥ 5 paired OCT/VFs to assess the ability of OCT-derived MD to detect worsening. Progression dataset eyes had two additional unpaired VFs (≥ 7 total) to establish a \"ground truth\" rate of progression defined by MD slope.</p><p><strong>Methods: </strong>We trained an ML model using paired VF/OCT data to estimate MD measurements for each OCT scan (OCT-MD). We used this ML model to generate longitudinal OCT-MD estimates for progression dataset eyes. We calculated MD slopes after substituting/supplementing VF-MD with OCT-MD and measured the ability to detect progression. We labeled true progressors using a ground truth MD slope <0.5 dB/year calculated from ≥ 7 VF-MD measurements. We compared the area under the curve (AUC) of MD slopes calculated using both VF-MD (with <7 measurements) and OCT-MD. Because we found OCT-MD substitution had a statistically inferior AUC to VF-MD, we simulated the effect of reducing OCT-MD mean absolute error (MAE) on the ability to detect worsening.</p><p><strong>Main outcome measures: </strong>AUC.</p><p><strong>Results: </strong>OCT-MD estimates had an MAE of 1.62 dB. AUC of MD slopes with partial OCT-MD substitution was significantly worse than the VF-MD slope. Supplementing VF-MD with OCT-MD also did not improve AUC, regardless of MAE. OCT-MD estimates needed an MAE ≤ 1.00 dB before AUC was statistically similar to VF-MD alone.</p><p><strong>Conclusion: </strong>ML models converting OCT data to VF-MD with error levels lower than published in prior work (MAE: 1.62 dB) were inferior to VF-MD data for detecting trend-based VF progression. Models converting OCT data to VF-MD must achieve better prediction errors (MAE ≤ 1 dB) to be clinically valuable at detecting VF worsening.</p>","PeriodicalId":94281,"journal":{"name":"medRxiv : the preprint server for health sciences","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11527071/pdf/","citationCount":"0","resultStr":"{\"title\":\"Detecting Glaucoma Worsening Using Optical Coherence Tomography Derived Visual Field Estimates.\",\"authors\":\"Alex T Pham, Chris Bradley, Kaihua Hou, Patrick Herbert, Mathias Unberath, Pradeep Y Ramulu, Jithin Yohannan\",\"doi\":\"10.1101/2024.10.17.24315710\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>Multiple studies have attempted to generate visual field (VF) mean deviation (MD) estimates using cross-sectional optical coherence tomography (OCT) data. However, whether such models offer any value in detecting longitudinal VF progression is unclear. We address this by developing a machine learning (ML) model to convert OCT data to MD and assessing its ability to detect longitudinal worsening.</p><p><strong>Design: </strong>Retrospective, longitudinal study.</p><p><strong>Participants: </strong>A model dataset of 70,575 paired OCT/VFs to train an ML model converting OCT to VF-MD. A separate progression dataset of 4,044 eyes with ≥ 5 paired OCT/VFs to assess the ability of OCT-derived MD to detect worsening. Progression dataset eyes had two additional unpaired VFs (≥ 7 total) to establish a \\\"ground truth\\\" rate of progression defined by MD slope.</p><p><strong>Methods: </strong>We trained an ML model using paired VF/OCT data to estimate MD measurements for each OCT scan (OCT-MD). We used this ML model to generate longitudinal OCT-MD estimates for progression dataset eyes. We calculated MD slopes after substituting/supplementing VF-MD with OCT-MD and measured the ability to detect progression. We labeled true progressors using a ground truth MD slope <0.5 dB/year calculated from ≥ 7 VF-MD measurements. We compared the area under the curve (AUC) of MD slopes calculated using both VF-MD (with <7 measurements) and OCT-MD. Because we found OCT-MD substitution had a statistically inferior AUC to VF-MD, we simulated the effect of reducing OCT-MD mean absolute error (MAE) on the ability to detect worsening.</p><p><strong>Main outcome measures: </strong>AUC.</p><p><strong>Results: </strong>OCT-MD estimates had an MAE of 1.62 dB. AUC of MD slopes with partial OCT-MD substitution was significantly worse than the VF-MD slope. Supplementing VF-MD with OCT-MD also did not improve AUC, regardless of MAE. OCT-MD estimates needed an MAE ≤ 1.00 dB before AUC was statistically similar to VF-MD alone.</p><p><strong>Conclusion: </strong>ML models converting OCT data to VF-MD with error levels lower than published in prior work (MAE: 1.62 dB) were inferior to VF-MD data for detecting trend-based VF progression. Models converting OCT data to VF-MD must achieve better prediction errors (MAE ≤ 1 dB) to be clinically valuable at detecting VF worsening.</p>\",\"PeriodicalId\":94281,\"journal\":{\"name\":\"medRxiv : the preprint server for health sciences\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11527071/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"medRxiv : the preprint server for health sciences\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1101/2024.10.17.24315710\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv : the preprint server for health sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.10.17.24315710","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
目的:多项研究试图利用横断面光学相干断层扫描(OCT)数据生成视野(VF)平均偏差(MD)估计值。然而,此类模型在检测纵向 VF 进展方面是否具有价值尚不清楚。为了解决这个问题,我们开发了一种机器学习(ML)模型,将 OCT 数据转换为 MD,并评估其检测纵向恶化的能力:设计:回顾性纵向研究:一个包含 70,575 个成对 OCT/VF 的模型数据集,用于训练将 OCT 转换为 VF-MD 的 ML 模型。一个单独的进展数据集,包含 4,044 只配对 OCT/VF ≥ 5 次的眼睛,用于评估 OCT 导出 MD 检测恶化的能力。进展数据集的眼睛有两个额外的非配对 VF(总共≥ 7 个),以建立由 MD 斜率定义的 "基本真实 "进展率:我们使用配对 VF/OCT 数据训练了一个 ML 模型,以估算每次 OCT 扫描的 MD 测量值(OCT-MD)。我们使用该 ML 模型为进展数据集眼睛生成纵向 OCT-MD 估计值。我们计算了用 OCT-MD 替代/补充 VF-MD 后的 MD 斜率,并测量了检测进展的能力。我们使用基本真实的MD斜率来标记真正的进展者:AUC.结果:OCT-MD 估计值的 MAE 为 1.62 dB。用部分 OCT-MD 替代的 MD 斜率的 AUC 明显低于 VF-MD 斜率。无论 MAE 如何,用 OCT-MD 补充 VF-MD 也不能提高 AUC。OCT-MD估计值需要MAE≤1.00 dB,AUC才会在统计学上与单独的VF-MD相似:结论:将 OCT 数据转换为 VF-MD 的 ML 模型的误差水平低于之前发表的研究成果(MAE:1.62 dB),但在检测基于趋势的 VF 进展方面不如 VF-MD 数据。将 OCT 数据转换为 VF-MD 的模型必须达到更好的预测误差(MAE ≤ 1 dB),才能在检测 VF 恶化方面具有临床价值。
Detecting Glaucoma Worsening Using Optical Coherence Tomography Derived Visual Field Estimates.
Objective: Multiple studies have attempted to generate visual field (VF) mean deviation (MD) estimates using cross-sectional optical coherence tomography (OCT) data. However, whether such models offer any value in detecting longitudinal VF progression is unclear. We address this by developing a machine learning (ML) model to convert OCT data to MD and assessing its ability to detect longitudinal worsening.
Design: Retrospective, longitudinal study.
Participants: A model dataset of 70,575 paired OCT/VFs to train an ML model converting OCT to VF-MD. A separate progression dataset of 4,044 eyes with ≥ 5 paired OCT/VFs to assess the ability of OCT-derived MD to detect worsening. Progression dataset eyes had two additional unpaired VFs (≥ 7 total) to establish a "ground truth" rate of progression defined by MD slope.
Methods: We trained an ML model using paired VF/OCT data to estimate MD measurements for each OCT scan (OCT-MD). We used this ML model to generate longitudinal OCT-MD estimates for progression dataset eyes. We calculated MD slopes after substituting/supplementing VF-MD with OCT-MD and measured the ability to detect progression. We labeled true progressors using a ground truth MD slope <0.5 dB/year calculated from ≥ 7 VF-MD measurements. We compared the area under the curve (AUC) of MD slopes calculated using both VF-MD (with <7 measurements) and OCT-MD. Because we found OCT-MD substitution had a statistically inferior AUC to VF-MD, we simulated the effect of reducing OCT-MD mean absolute error (MAE) on the ability to detect worsening.
Main outcome measures: AUC.
Results: OCT-MD estimates had an MAE of 1.62 dB. AUC of MD slopes with partial OCT-MD substitution was significantly worse than the VF-MD slope. Supplementing VF-MD with OCT-MD also did not improve AUC, regardless of MAE. OCT-MD estimates needed an MAE ≤ 1.00 dB before AUC was statistically similar to VF-MD alone.
Conclusion: ML models converting OCT data to VF-MD with error levels lower than published in prior work (MAE: 1.62 dB) were inferior to VF-MD data for detecting trend-based VF progression. Models converting OCT data to VF-MD must achieve better prediction errors (MAE ≤ 1 dB) to be clinically valuable at detecting VF worsening.