Yun Ming Wong , Ping Lin Yeap , Ashley Li Kuan Ong , Jeffrey Kit Loong Tuan , Wen Siang Lew , James Cheow Lei Lee , Hong Qi Tan
{"title":"Machine learning prediction of Dice similarity coefficient for validation of deformable image registration","authors":"Yun Ming Wong , Ping Lin Yeap , Ashley Li Kuan Ong , Jeffrey Kit Loong Tuan , Wen Siang Lew , James Cheow Lei Lee , Hong Qi Tan","doi":"10.1016/j.ibmed.2024.100163","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><p>Deformable image registration (DIR) plays a vital role in adaptive radiotherapy (ART). For the clinical implementation of DIR, evaluation of deformation accuracy is a critical step. While contour-based metrics, for example Dice similarity coefficient (DSC), are widely implemented for DIR validation, they require delineation of contours which is time-consuming and would cause hold-ups in an ART workflow. Therefore, this work aims to accomplish the prediction of DSC using various metrics based on deformation vector field (DVF) by applying machine learning (ML), in order to provide an efficient means of DIR validation with minimised human intervention.</p></div><div><h3>Methods</h3><p>Planning CT image was deformed to the cone-beam CT images for 20 prostate cancer patients. Various DVF-based metrics and DSC were calculated, and the former was used as input features to predict the latter using three ML models, namely linear regression (LR), Nu Support Vector Regression (NuSVR) and Random Forest Regressor (RFR). Four datasets were used for analysis: 1) prostate, 2) bladder, 3) rectum and 4) all the organs combined. Average mean absolute error (MAE) was computed to evaluate the model performance. The classification performance of the best-performing model was further evaluated, and the prediction interval and feature importance were calculated.</p></div><div><h3>Results</h3><p>Overall, RFR achieved the lowest average MAE, ranging between 0.045 and 0.069 for the four datasets, while LR and NuSVR had slightly poorer performances. Analysis on the results of best-performing model showed that sensitivity and specificity of 0.86 and 0.51, respectively, were obtained when a prediction threshold of 0.85 was used to classify the fourth dataset. Jacobian determinant was found to be a significant contributor to the predictions of all four datasets using this model.</p></div><div><h3>Conclusion</h3><p>This study demonstrated the potential of several ML models, especially RFR, to be applied for prediction of DSC to speed up the DIR validation process.</p></div>","PeriodicalId":73399,"journal":{"name":"Intelligence-based medicine","volume":"10 ","pages":"Article 100163"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666521224000309/pdfft?md5=92ebfdf38ebfa5ad2817955b2f352129&pid=1-s2.0-S2666521224000309-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligence-based medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666521224000309","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction
Deformable image registration (DIR) plays a vital role in adaptive radiotherapy (ART). For the clinical implementation of DIR, evaluation of deformation accuracy is a critical step. While contour-based metrics, for example Dice similarity coefficient (DSC), are widely implemented for DIR validation, they require delineation of contours which is time-consuming and would cause hold-ups in an ART workflow. Therefore, this work aims to accomplish the prediction of DSC using various metrics based on deformation vector field (DVF) by applying machine learning (ML), in order to provide an efficient means of DIR validation with minimised human intervention.
Methods
Planning CT image was deformed to the cone-beam CT images for 20 prostate cancer patients. Various DVF-based metrics and DSC were calculated, and the former was used as input features to predict the latter using three ML models, namely linear regression (LR), Nu Support Vector Regression (NuSVR) and Random Forest Regressor (RFR). Four datasets were used for analysis: 1) prostate, 2) bladder, 3) rectum and 4) all the organs combined. Average mean absolute error (MAE) was computed to evaluate the model performance. The classification performance of the best-performing model was further evaluated, and the prediction interval and feature importance were calculated.
Results
Overall, RFR achieved the lowest average MAE, ranging between 0.045 and 0.069 for the four datasets, while LR and NuSVR had slightly poorer performances. Analysis on the results of best-performing model showed that sensitivity and specificity of 0.86 and 0.51, respectively, were obtained when a prediction threshold of 0.85 was used to classify the fourth dataset. Jacobian determinant was found to be a significant contributor to the predictions of all four datasets using this model.
Conclusion
This study demonstrated the potential of several ML models, especially RFR, to be applied for prediction of DSC to speed up the DIR validation process.