Chia-Chun Chiang, Todd J Schwedt, Gina Dumkrieger, Liguo Wang, Chieh-Ju Chao, Heather A Ouellette, Imon Banerjee, Yi-Chieh Chen, Brandon M Jones, Krista M Burke, Han Wang, Ann M Murray, Monique M Montenegro, Jennifer I Stern, Mark Whealy, Narayan Kissoon, Fred M Cutrer
{"title":"推进偏头痛的精准治疗:利用基于患者和偏头痛特征的机器学习模型预测对预防性药物的反应。","authors":"Chia-Chun Chiang, Todd J Schwedt, Gina Dumkrieger, Liguo Wang, Chieh-Ju Chao, Heather A Ouellette, Imon Banerjee, Yi-Chieh Chen, Brandon M Jones, Krista M Burke, Han Wang, Ann M Murray, Monique M Montenegro, Jennifer I Stern, Mark Whealy, Narayan Kissoon, Fred M Cutrer","doi":"10.1111/head.14806","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To develop machine learning models using patient and migraine features that can predict treatment responses to commonly used migraine preventive medications.</p><p><strong>Background: </strong>Currently, there is no accurate way to predict response to migraine preventive medications, and the standard trial-and-error approach is inefficient.</p><p><strong>Methods: </strong>In this cohort study, we analyzed data from the Mayo Clinic Headache database prospectively collected from 2001 to December 2023. Adult patients with migraine completed questionnaires during their initial headache consultation to record detailed clinical features and then at each follow-up to track preventive medication changes and monthly headache days. We included patients treated with at least one of the following migraine preventive medications: topiramate, beta-blockers (propranolol, metoprolol, atenolol, nadolol, timolol), tricyclic antidepressants (amitriptyline, nortriptyline), verapamil, gabapentin, onabotulinumtoxinA, and calcitonin gene-related peptide (CGRP) monoclonal antibodies (mAbs) (erenumab, fremanezumab, galcanezumab, eptinezumab). We pre-trained a deep neural network, \"TabNet,\" using 145 variables, then employed TabNet-embedded data to construct prediction models for each medication to predict binary outcomes (responder vs. non-responder). A treatment responder was defined as having at least a 30% reduction in monthly headache days from baseline. All model performances were evaluated, and metrics were reported in the held-out test set (train 85%, test 15%). SHapley Additive exPlanations (SHAP) were conducted to determine variable importance.</p><p><strong>Results: </strong>Our final analysis included 4260 patients. The responder rate for each medication ranged from 28.7% to 34.9%, and the mean time to treatment outcome for each medication ranged from 151.3 to 209.5 days. The CGRP mAb prediction model achieved a high area under the receiver operating characteristics curve (AUC) of 0.825 (95% confidence interval [CI] 0.726, 0.920) and an accuracy of 0.80 (95% CI 0.70, 0.88). The AUCs of prediction models for beta-blockers, tricyclic antidepressants, topiramate, verapamil, gabapentin, and onabotulinumtoxinA were: 0.664 (95% CI 0.579, 0.745), 0.611 (95% CI 0.562, 0.682), 0.605 (95% CI 0.520, 0.688), 0.673 (95% CI 0.569, 0.724), 0.628 (0.533, 0.661), and 0.581 (95% CI 0.550, 0.632), respectively. Baseline monthly headache days, age, body mass index (BMI), duration of migraine attacks, responses to previous medication trials, cranial autonomic symptoms, family history of headache, and migraine attack triggers were among the most important variables across all models. A variable could have different contributions; for example, lower BMI predicts responsiveness to CGRP mAbs and beta-blockers, while higher BMI predicts responsiveness to onabotulinumtoxinA, topiramate, and gabapentin.</p><p><strong>Conclusion: </strong>We developed an accurate prediction model for CGRP mAbs treatment response, leveraging detailed migraine features gathered from a headache questionnaire before starting treatment. Employing the same methods, the model performances for other medications were less impressive, though similar to the machine learning models reported in the literature for other diseases. This may be due to CGRP mAbs being migraine-specific. Incorporating medical comorbidities, genomic, and imaging factors might enhance the model performance. We demonstrated that migraine characteristics are important in predicting treatment responses and identified the most crucial predictors for each of the seven types of preventive medications. Our results suggest that precision migraine treatment is feasible.</p>","PeriodicalId":12844,"journal":{"name":"Headache","volume":" ","pages":"1094-1108"},"PeriodicalIF":5.4000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Advancing toward precision migraine treatment: Predicting responses to preventive medications with machine learning models based on patient and migraine features.\",\"authors\":\"Chia-Chun Chiang, Todd J Schwedt, Gina Dumkrieger, Liguo Wang, Chieh-Ju Chao, Heather A Ouellette, Imon Banerjee, Yi-Chieh Chen, Brandon M Jones, Krista M Burke, Han Wang, Ann M Murray, Monique M Montenegro, Jennifer I Stern, Mark Whealy, Narayan Kissoon, Fred M Cutrer\",\"doi\":\"10.1111/head.14806\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>To develop machine learning models using patient and migraine features that can predict treatment responses to commonly used migraine preventive medications.</p><p><strong>Background: </strong>Currently, there is no accurate way to predict response to migraine preventive medications, and the standard trial-and-error approach is inefficient.</p><p><strong>Methods: </strong>In this cohort study, we analyzed data from the Mayo Clinic Headache database prospectively collected from 2001 to December 2023. Adult patients with migraine completed questionnaires during their initial headache consultation to record detailed clinical features and then at each follow-up to track preventive medication changes and monthly headache days. We included patients treated with at least one of the following migraine preventive medications: topiramate, beta-blockers (propranolol, metoprolol, atenolol, nadolol, timolol), tricyclic antidepressants (amitriptyline, nortriptyline), verapamil, gabapentin, onabotulinumtoxinA, and calcitonin gene-related peptide (CGRP) monoclonal antibodies (mAbs) (erenumab, fremanezumab, galcanezumab, eptinezumab). We pre-trained a deep neural network, \\\"TabNet,\\\" using 145 variables, then employed TabNet-embedded data to construct prediction models for each medication to predict binary outcomes (responder vs. non-responder). A treatment responder was defined as having at least a 30% reduction in monthly headache days from baseline. All model performances were evaluated, and metrics were reported in the held-out test set (train 85%, test 15%). SHapley Additive exPlanations (SHAP) were conducted to determine variable importance.</p><p><strong>Results: </strong>Our final analysis included 4260 patients. The responder rate for each medication ranged from 28.7% to 34.9%, and the mean time to treatment outcome for each medication ranged from 151.3 to 209.5 days. The CGRP mAb prediction model achieved a high area under the receiver operating characteristics curve (AUC) of 0.825 (95% confidence interval [CI] 0.726, 0.920) and an accuracy of 0.80 (95% CI 0.70, 0.88). The AUCs of prediction models for beta-blockers, tricyclic antidepressants, topiramate, verapamil, gabapentin, and onabotulinumtoxinA were: 0.664 (95% CI 0.579, 0.745), 0.611 (95% CI 0.562, 0.682), 0.605 (95% CI 0.520, 0.688), 0.673 (95% CI 0.569, 0.724), 0.628 (0.533, 0.661), and 0.581 (95% CI 0.550, 0.632), respectively. Baseline monthly headache days, age, body mass index (BMI), duration of migraine attacks, responses to previous medication trials, cranial autonomic symptoms, family history of headache, and migraine attack triggers were among the most important variables across all models. A variable could have different contributions; for example, lower BMI predicts responsiveness to CGRP mAbs and beta-blockers, while higher BMI predicts responsiveness to onabotulinumtoxinA, topiramate, and gabapentin.</p><p><strong>Conclusion: </strong>We developed an accurate prediction model for CGRP mAbs treatment response, leveraging detailed migraine features gathered from a headache questionnaire before starting treatment. Employing the same methods, the model performances for other medications were less impressive, though similar to the machine learning models reported in the literature for other diseases. This may be due to CGRP mAbs being migraine-specific. Incorporating medical comorbidities, genomic, and imaging factors might enhance the model performance. We demonstrated that migraine characteristics are important in predicting treatment responses and identified the most crucial predictors for each of the seven types of preventive medications. Our results suggest that precision migraine treatment is feasible.</p>\",\"PeriodicalId\":12844,\"journal\":{\"name\":\"Headache\",\"volume\":\" \",\"pages\":\"1094-1108\"},\"PeriodicalIF\":5.4000,\"publicationDate\":\"2024-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Headache\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/head.14806\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/8/23 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Headache","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/head.14806","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/8/23 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
摘要
目的:利用患者和偏头痛特征开发机器学习模型,以预测常用偏头痛预防药物的治疗反应:利用患者和偏头痛特征开发机器学习模型,以预测常用偏头痛预防药物的治疗反应:背景:目前,还没有准确预测偏头痛预防药物反应的方法,标准的试错法效率低下:在这项队列研究中,我们分析了梅奥诊所头痛数据库从 2001 年至 2023 年 12 月期间收集的前瞻性数据。成年偏头痛患者在初次头痛就诊时填写调查问卷,记录详细的临床特征,然后在每次随访时跟踪预防性药物的更换情况和每月头痛天数。我们纳入了至少接受过以下一种偏头痛预防药物治疗的患者:托吡酯、β-受体阻滞剂(普萘洛尔、美托洛尔、阿替洛尔、纳多洛尔、噻吗洛尔)、三环类抗抑郁药(阿米替林、去甲替林)、维拉帕米、加巴喷丁、奥那布林妥昔单抗(onabotulinumtoxinA)和降钙素基因相关肽(CGRP)单克隆抗体(mAbs)(erenumab、fremanezumab、galcanezumab、eptinezumab)。我们使用 145 个变量预先训练了一个深度神经网络 "TabNet",然后利用 TabNet 嵌入的数据为每种药物构建预测模型,以预测二元结果(应答者与非应答者)。治疗应答者的定义是每月头痛天数比基线至少减少 30%。对所有模型的性能进行了评估,并在保留的测试集中报告了指标(训练占 85%,测试占 15%)。为了确定变量的重要性,我们进行了SHAPLEY Additive exPlanations(SHAP)分析:我们的最终分析包括 4260 名患者。每种药物的应答率从 28.7% 到 34.9% 不等,每种药物治疗结果的平均时间从 151.3 天到 209.5 天不等。CGRP mAb预测模型的接收者操作特征曲线下面积(AUC)高达0.825(95%置信区间[CI] 0.726,0.920),准确率为0.80(95% CI 0.70,0.88)。β-受体阻滞剂、三环类抗抑郁药、托吡酯、维拉帕米、加巴喷丁和阿糖胞苷的预测模型的 AUC 值分别为分别为 0.664(95% CI 0.579,0.745)、0.611(95% CI 0.562,0.682)、0.605(95% CI 0.520,0.688)、0.673(95% CI 0.569,0.724)、0.628(0.533,0.661)和 0.581(95% CI 0.550,0.632)。在所有模型中,每月头痛天数基线、年龄、体重指数(BMI)、偏头痛发作持续时间、对之前药物试验的反应、头颅自主神经症状、头痛家族史和偏头痛发作诱因是最重要的变量。一个变量可能有不同的贡献;例如,较低的体重指数可预测对CGRP mAbs和β-受体阻滞剂的反应,而较高的体重指数可预测对onabotulinumtoxinA、托吡酯和加巴喷丁的反应:我们利用开始治疗前从头痛问卷中收集到的偏头痛详细特征,开发出了一个准确的 CGRP mAbs 治疗反应预测模型。采用同样的方法,模型对其他药物的预测结果虽然与文献中报道的机器学习模型对其他疾病的预测结果相似,但却不尽如人意。这可能是由于CGRP mAbs具有偏头痛特异性。将并发症、基因组和影像学因素纳入模型可能会提高模型性能。我们证明了偏头痛特征在预测治疗反应方面的重要性,并确定了七种预防性药物中最关键的预测因素。我们的研究结果表明,偏头痛的精准治疗是可行的。
Advancing toward precision migraine treatment: Predicting responses to preventive medications with machine learning models based on patient and migraine features.
Objective: To develop machine learning models using patient and migraine features that can predict treatment responses to commonly used migraine preventive medications.
Background: Currently, there is no accurate way to predict response to migraine preventive medications, and the standard trial-and-error approach is inefficient.
Methods: In this cohort study, we analyzed data from the Mayo Clinic Headache database prospectively collected from 2001 to December 2023. Adult patients with migraine completed questionnaires during their initial headache consultation to record detailed clinical features and then at each follow-up to track preventive medication changes and monthly headache days. We included patients treated with at least one of the following migraine preventive medications: topiramate, beta-blockers (propranolol, metoprolol, atenolol, nadolol, timolol), tricyclic antidepressants (amitriptyline, nortriptyline), verapamil, gabapentin, onabotulinumtoxinA, and calcitonin gene-related peptide (CGRP) monoclonal antibodies (mAbs) (erenumab, fremanezumab, galcanezumab, eptinezumab). We pre-trained a deep neural network, "TabNet," using 145 variables, then employed TabNet-embedded data to construct prediction models for each medication to predict binary outcomes (responder vs. non-responder). A treatment responder was defined as having at least a 30% reduction in monthly headache days from baseline. All model performances were evaluated, and metrics were reported in the held-out test set (train 85%, test 15%). SHapley Additive exPlanations (SHAP) were conducted to determine variable importance.
Results: Our final analysis included 4260 patients. The responder rate for each medication ranged from 28.7% to 34.9%, and the mean time to treatment outcome for each medication ranged from 151.3 to 209.5 days. The CGRP mAb prediction model achieved a high area under the receiver operating characteristics curve (AUC) of 0.825 (95% confidence interval [CI] 0.726, 0.920) and an accuracy of 0.80 (95% CI 0.70, 0.88). The AUCs of prediction models for beta-blockers, tricyclic antidepressants, topiramate, verapamil, gabapentin, and onabotulinumtoxinA were: 0.664 (95% CI 0.579, 0.745), 0.611 (95% CI 0.562, 0.682), 0.605 (95% CI 0.520, 0.688), 0.673 (95% CI 0.569, 0.724), 0.628 (0.533, 0.661), and 0.581 (95% CI 0.550, 0.632), respectively. Baseline monthly headache days, age, body mass index (BMI), duration of migraine attacks, responses to previous medication trials, cranial autonomic symptoms, family history of headache, and migraine attack triggers were among the most important variables across all models. A variable could have different contributions; for example, lower BMI predicts responsiveness to CGRP mAbs and beta-blockers, while higher BMI predicts responsiveness to onabotulinumtoxinA, topiramate, and gabapentin.
Conclusion: We developed an accurate prediction model for CGRP mAbs treatment response, leveraging detailed migraine features gathered from a headache questionnaire before starting treatment. Employing the same methods, the model performances for other medications were less impressive, though similar to the machine learning models reported in the literature for other diseases. This may be due to CGRP mAbs being migraine-specific. Incorporating medical comorbidities, genomic, and imaging factors might enhance the model performance. We demonstrated that migraine characteristics are important in predicting treatment responses and identified the most crucial predictors for each of the seven types of preventive medications. Our results suggest that precision migraine treatment is feasible.
期刊介绍:
Headache publishes original articles on all aspects of head and face pain including communications on clinical and basic research, diagnosis and management, epidemiology, genetics, and pathophysiology of primary and secondary headaches, cranial neuralgias, and pains referred to the head and face. Monthly issues feature case reports, short communications, review articles, letters to the editor, and news items regarding AHS plus medicolegal and socioeconomic aspects of head pain. This is the official journal of the American Headache Society.