Yun Ming Wong , Ping Lin Yeap , Ashley Li Kuan Ong , Jeffrey Kit Loong Tuan , Wen Siang Lew , James Cheow Lei Lee , Hong Qi Tan
{"title":"用于验证可变形图像配准的 Dice 相似性系数的机器学习预测","authors":"Yun Ming Wong , Ping Lin Yeap , Ashley Li Kuan Ong , Jeffrey Kit Loong Tuan , Wen Siang Lew , James Cheow Lei Lee , Hong Qi Tan","doi":"10.1016/j.ibmed.2024.100163","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><p>Deformable image registration (DIR) plays a vital role in adaptive radiotherapy (ART). For the clinical implementation of DIR, evaluation of deformation accuracy is a critical step. While contour-based metrics, for example Dice similarity coefficient (DSC), are widely implemented for DIR validation, they require delineation of contours which is time-consuming and would cause hold-ups in an ART workflow. Therefore, this work aims to accomplish the prediction of DSC using various metrics based on deformation vector field (DVF) by applying machine learning (ML), in order to provide an efficient means of DIR validation with minimised human intervention.</p></div><div><h3>Methods</h3><p>Planning CT image was deformed to the cone-beam CT images for 20 prostate cancer patients. Various DVF-based metrics and DSC were calculated, and the former was used as input features to predict the latter using three ML models, namely linear regression (LR), Nu Support Vector Regression (NuSVR) and Random Forest Regressor (RFR). Four datasets were used for analysis: 1) prostate, 2) bladder, 3) rectum and 4) all the organs combined. Average mean absolute error (MAE) was computed to evaluate the model performance. The classification performance of the best-performing model was further evaluated, and the prediction interval and feature importance were calculated.</p></div><div><h3>Results</h3><p>Overall, RFR achieved the lowest average MAE, ranging between 0.045 and 0.069 for the four datasets, while LR and NuSVR had slightly poorer performances. Analysis on the results of best-performing model showed that sensitivity and specificity of 0.86 and 0.51, respectively, were obtained when a prediction threshold of 0.85 was used to classify the fourth dataset. Jacobian determinant was found to be a significant contributor to the predictions of all four datasets using this model.</p></div><div><h3>Conclusion</h3><p>This study demonstrated the potential of several ML models, especially RFR, to be applied for prediction of DSC to speed up the DIR validation process.</p></div>","PeriodicalId":73399,"journal":{"name":"Intelligence-based medicine","volume":"10 ","pages":"Article 100163"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666521224000309/pdfft?md5=92ebfdf38ebfa5ad2817955b2f352129&pid=1-s2.0-S2666521224000309-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Machine learning prediction of Dice similarity coefficient for validation of deformable image registration\",\"authors\":\"Yun Ming Wong , Ping Lin Yeap , Ashley Li Kuan Ong , Jeffrey Kit Loong Tuan , Wen Siang Lew , James Cheow Lei Lee , Hong Qi Tan\",\"doi\":\"10.1016/j.ibmed.2024.100163\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Introduction</h3><p>Deformable image registration (DIR) plays a vital role in adaptive radiotherapy (ART). For the clinical implementation of DIR, evaluation of deformation accuracy is a critical step. While contour-based metrics, for example Dice similarity coefficient (DSC), are widely implemented for DIR validation, they require delineation of contours which is time-consuming and would cause hold-ups in an ART workflow. Therefore, this work aims to accomplish the prediction of DSC using various metrics based on deformation vector field (DVF) by applying machine learning (ML), in order to provide an efficient means of DIR validation with minimised human intervention.</p></div><div><h3>Methods</h3><p>Planning CT image was deformed to the cone-beam CT images for 20 prostate cancer patients. Various DVF-based metrics and DSC were calculated, and the former was used as input features to predict the latter using three ML models, namely linear regression (LR), Nu Support Vector Regression (NuSVR) and Random Forest Regressor (RFR). Four datasets were used for analysis: 1) prostate, 2) bladder, 3) rectum and 4) all the organs combined. Average mean absolute error (MAE) was computed to evaluate the model performance. The classification performance of the best-performing model was further evaluated, and the prediction interval and feature importance were calculated.</p></div><div><h3>Results</h3><p>Overall, RFR achieved the lowest average MAE, ranging between 0.045 and 0.069 for the four datasets, while LR and NuSVR had slightly poorer performances. Analysis on the results of best-performing model showed that sensitivity and specificity of 0.86 and 0.51, respectively, were obtained when a prediction threshold of 0.85 was used to classify the fourth dataset. Jacobian determinant was found to be a significant contributor to the predictions of all four datasets using this model.</p></div><div><h3>Conclusion</h3><p>This study demonstrated the potential of several ML models, especially RFR, to be applied for prediction of DSC to speed up the DIR validation process.</p></div>\",\"PeriodicalId\":73399,\"journal\":{\"name\":\"Intelligence-based medicine\",\"volume\":\"10 \",\"pages\":\"Article 100163\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2666521224000309/pdfft?md5=92ebfdf38ebfa5ad2817955b2f352129&pid=1-s2.0-S2666521224000309-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligence-based medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666521224000309\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligence-based medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666521224000309","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
导言可变形图像配准(DIR)在自适应放射治疗(ART)中发挥着重要作用。对于 DIR 的临床应用来说,评估变形精度是一个关键步骤。虽然基于轮廓的指标(如 Dice 相似度系数 (DSC))被广泛用于 DIR 验证,但它们需要划定轮廓,而划定轮廓非常耗时,会导致 ART 工作流程停滞。因此,这项工作旨在通过应用机器学习(ML),使用基于形变矢量场(DVF)的各种指标来完成 DSC 的预测,从而提供一种有效的 DIR 验证方法,最大限度地减少人为干预。计算各种基于 DVF 的指标和 DSC,并使用三种 ML 模型(即线性回归 (LR)、Nu 支持向量回归 (NuSVR) 和随机森林回归器 (RFR))将前者作为输入特征来预测后者。分析使用了四个数据集:1)前列腺;2)膀胱;3)直肠;4)所有器官组合。计算平均绝对误差(MAE)来评估模型性能。结果总体而言,RFR 的平均绝对误差最小,四个数据集的平均绝对误差在 0.045 到 0.069 之间,而 LR 和 NuSVR 的表现稍差。对表现最佳模型结果的分析表明,当使用 0.85 的预测阈值对第四个数据集进行分类时,灵敏度和特异度分别为 0.86 和 0.51。结论这项研究证明了几种 ML 模型(尤其是 RFR)在预测 DSC 方面的应用潜力,从而加快了 DIR 验证过程。
Machine learning prediction of Dice similarity coefficient for validation of deformable image registration
Introduction
Deformable image registration (DIR) plays a vital role in adaptive radiotherapy (ART). For the clinical implementation of DIR, evaluation of deformation accuracy is a critical step. While contour-based metrics, for example Dice similarity coefficient (DSC), are widely implemented for DIR validation, they require delineation of contours which is time-consuming and would cause hold-ups in an ART workflow. Therefore, this work aims to accomplish the prediction of DSC using various metrics based on deformation vector field (DVF) by applying machine learning (ML), in order to provide an efficient means of DIR validation with minimised human intervention.
Methods
Planning CT image was deformed to the cone-beam CT images for 20 prostate cancer patients. Various DVF-based metrics and DSC were calculated, and the former was used as input features to predict the latter using three ML models, namely linear regression (LR), Nu Support Vector Regression (NuSVR) and Random Forest Regressor (RFR). Four datasets were used for analysis: 1) prostate, 2) bladder, 3) rectum and 4) all the organs combined. Average mean absolute error (MAE) was computed to evaluate the model performance. The classification performance of the best-performing model was further evaluated, and the prediction interval and feature importance were calculated.
Results
Overall, RFR achieved the lowest average MAE, ranging between 0.045 and 0.069 for the four datasets, while LR and NuSVR had slightly poorer performances. Analysis on the results of best-performing model showed that sensitivity and specificity of 0.86 and 0.51, respectively, were obtained when a prediction threshold of 0.85 was used to classify the fourth dataset. Jacobian determinant was found to be a significant contributor to the predictions of all four datasets using this model.
Conclusion
This study demonstrated the potential of several ML models, especially RFR, to be applied for prediction of DSC to speed up the DIR validation process.