Ibrahim Mohammadzadeh , Behnaz Niroomand , Bardia Hajikarimloo , Mohammad Amin Habibi , Ali Mortezaei , Jina Behjati , Abdulrahman Albakr , Hamid Borghei-Razavi
{"title":"我们能否依赖机器学习算法作为高级别神经胶质瘤复发的可靠预测指标?系统回顾和荟萃分析。","authors":"Ibrahim Mohammadzadeh , Behnaz Niroomand , Bardia Hajikarimloo , Mohammad Amin Habibi , Ali Mortezaei , Jina Behjati , Abdulrahman Albakr , Hamid Borghei-Razavi","doi":"10.1016/j.clineuro.2025.108762","DOIUrl":null,"url":null,"abstract":"<div><div>Early prediction of recurrence in high-grade glioma (HGG) is critical due to its aggressive nature and poor prognosis. Distinguishing true recurrence from treatment-related changes, such as radionecrosis, is a major diagnostic challenge. Machine learning (ML) offers a novel approach, leveraging advanced algorithms to analyze complex imaging data with high precision. A comprehensive search of PubMed, Embase, Scopus, Web of Science, and Google Scholar identified eligible studies. The sensitivity, specificity, accuracy, precision, F1 score, and the (area under the curve) AUC items were extracted from the included studies. After screening 1077 records, seven studies met the eligibility criteria for the systematic review, of which five were included in the meta-analysis. ML algorithm, particularly Support Vector Machines (SVM), demonstrated promising performance. A meta-analysis of five studies revealed a pooled sensitivity of 0.95 (95% CI: 0.84–0.99) and specificity of 0.80 (95% CI: 0.69–0.88). Additionally, the positive diagnostic likelihood ratio (DLR) was 4.75 (95% CI: 2.91–7.76), the negative DLR was 0.06 (95% CI: 0.02–0.21), and the diagnostic odds ratio was 80.97 (95% CI: 17.5–374.61). The diagnostic score was calculated as 4.39 (95% CI: 2.86–5.93), and the AUC was 0.86 (95% CI: 0.83–0.89). Subgroup analyses showed SVM-based models with higher sensitivity (0.98 vs. 0.87) and specificity (0.82 vs. 0.77) than non-SVM (p = 0.13). Comparing glioblastoma and Grade 3 tumors, sensitivities were 94 % vs. 97 %, and specificities were 79 % vs. 83 %, with no significant heterogeneity. These findings suggest that ML models, particularly SVM, offer promising diagnostic performance in distinguishing true tumor recurrence from treatment-related changes.</div></div>","PeriodicalId":10385,"journal":{"name":"Clinical Neurology and Neurosurgery","volume":"249 ","pages":"Article 108762"},"PeriodicalIF":1.6000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Can we rely on machine learning algorithms as a trustworthy predictor for recurrence in high-grade glioma? A systematic review and meta-analysis\",\"authors\":\"Ibrahim Mohammadzadeh , Behnaz Niroomand , Bardia Hajikarimloo , Mohammad Amin Habibi , Ali Mortezaei , Jina Behjati , Abdulrahman Albakr , Hamid Borghei-Razavi\",\"doi\":\"10.1016/j.clineuro.2025.108762\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Early prediction of recurrence in high-grade glioma (HGG) is critical due to its aggressive nature and poor prognosis. Distinguishing true recurrence from treatment-related changes, such as radionecrosis, is a major diagnostic challenge. Machine learning (ML) offers a novel approach, leveraging advanced algorithms to analyze complex imaging data with high precision. A comprehensive search of PubMed, Embase, Scopus, Web of Science, and Google Scholar identified eligible studies. The sensitivity, specificity, accuracy, precision, F1 score, and the (area under the curve) AUC items were extracted from the included studies. After screening 1077 records, seven studies met the eligibility criteria for the systematic review, of which five were included in the meta-analysis. ML algorithm, particularly Support Vector Machines (SVM), demonstrated promising performance. A meta-analysis of five studies revealed a pooled sensitivity of 0.95 (95% CI: 0.84–0.99) and specificity of 0.80 (95% CI: 0.69–0.88). Additionally, the positive diagnostic likelihood ratio (DLR) was 4.75 (95% CI: 2.91–7.76), the negative DLR was 0.06 (95% CI: 0.02–0.21), and the diagnostic odds ratio was 80.97 (95% CI: 17.5–374.61). The diagnostic score was calculated as 4.39 (95% CI: 2.86–5.93), and the AUC was 0.86 (95% CI: 0.83–0.89). Subgroup analyses showed SVM-based models with higher sensitivity (0.98 vs. 0.87) and specificity (0.82 vs. 0.77) than non-SVM (p = 0.13). Comparing glioblastoma and Grade 3 tumors, sensitivities were 94 % vs. 97 %, and specificities were 79 % vs. 83 %, with no significant heterogeneity. These findings suggest that ML models, particularly SVM, offer promising diagnostic performance in distinguishing true tumor recurrence from treatment-related changes.</div></div>\",\"PeriodicalId\":10385,\"journal\":{\"name\":\"Clinical Neurology and Neurosurgery\",\"volume\":\"249 \",\"pages\":\"Article 108762\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Clinical Neurology and Neurosurgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0303846725000459\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/25 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Neurology and Neurosurgery","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0303846725000459","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/25 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
摘要
由于高级别胶质瘤的侵袭性和预后差,早期预测其复发是至关重要的。区分真正的复发与治疗相关的改变,如放射性坏死,是一个主要的诊断挑战。机器学习(ML)提供了一种新颖的方法,利用先进的算法来高精度地分析复杂的成像数据。对PubMed、Embase、Scopus、Web of Science和b谷歌Scholar进行了全面的搜索,确定了符合条件的研究。从纳入的研究中提取灵敏度、特异度、准确度、精密度、F1评分和(曲线下面积)AUC项目。在筛选1077项记录后,有7项研究符合系统评价的资格标准,其中5项纳入meta分析。机器学习算法,特别是支持向量机(SVM),表现出了良好的性能。五项研究的荟萃分析显示,总敏感性为0.95 (95% CI: 0.84-0.99),特异性为0.80 (95% CI: 0.69-0.88)。此外,阳性诊断似然比(DLR)为4.75 (95% CI: 2.91 ~ 7.76),阴性诊断似然比为0.06 (95% CI: 0.02 ~ 0.21),诊断优势比为80.97 (95% CI: 17.5 ~ 374.61)。计算诊断评分为4.39 (95% CI: 2.86 ~ 5.93), AUC为0.86 (95% CI: 0.83 ~ 0.89)。亚组分析显示,基于svm的模型灵敏度(0.98 vs. 0.87)和特异性(0.82 vs. 0.77)高于非svm (p = 0.13)。将胶质母细胞瘤和3级肿瘤进行比较,敏感性为94 % vs. 97 %,特异性为79 % vs. 83 %,无显著异质性。这些发现表明,ML模型,特别是SVM,在区分真正的肿瘤复发和治疗相关的变化方面提供了有希望的诊断性能。
Can we rely on machine learning algorithms as a trustworthy predictor for recurrence in high-grade glioma? A systematic review and meta-analysis
Early prediction of recurrence in high-grade glioma (HGG) is critical due to its aggressive nature and poor prognosis. Distinguishing true recurrence from treatment-related changes, such as radionecrosis, is a major diagnostic challenge. Machine learning (ML) offers a novel approach, leveraging advanced algorithms to analyze complex imaging data with high precision. A comprehensive search of PubMed, Embase, Scopus, Web of Science, and Google Scholar identified eligible studies. The sensitivity, specificity, accuracy, precision, F1 score, and the (area under the curve) AUC items were extracted from the included studies. After screening 1077 records, seven studies met the eligibility criteria for the systematic review, of which five were included in the meta-analysis. ML algorithm, particularly Support Vector Machines (SVM), demonstrated promising performance. A meta-analysis of five studies revealed a pooled sensitivity of 0.95 (95% CI: 0.84–0.99) and specificity of 0.80 (95% CI: 0.69–0.88). Additionally, the positive diagnostic likelihood ratio (DLR) was 4.75 (95% CI: 2.91–7.76), the negative DLR was 0.06 (95% CI: 0.02–0.21), and the diagnostic odds ratio was 80.97 (95% CI: 17.5–374.61). The diagnostic score was calculated as 4.39 (95% CI: 2.86–5.93), and the AUC was 0.86 (95% CI: 0.83–0.89). Subgroup analyses showed SVM-based models with higher sensitivity (0.98 vs. 0.87) and specificity (0.82 vs. 0.77) than non-SVM (p = 0.13). Comparing glioblastoma and Grade 3 tumors, sensitivities were 94 % vs. 97 %, and specificities were 79 % vs. 83 %, with no significant heterogeneity. These findings suggest that ML models, particularly SVM, offer promising diagnostic performance in distinguishing true tumor recurrence from treatment-related changes.
期刊介绍:
Clinical Neurology and Neurosurgery is devoted to publishing papers and reports on the clinical aspects of neurology and neurosurgery. It is an international forum for papers of high scientific standard that are of interest to Neurologists and Neurosurgeons world-wide.