Sergey D Goryachev, Cenk Yildirim, Clark DuMontier, Jennifer La, Mayuri Dharne, J Michael Gaziano, Mary T Brophy, Nikhil C Munshi, Jane A Driver, Nhan V Do, Nathanael R Fillmore
Purpose: Stage in multiple myeloma (MM) is an essential measure of disease risk, but its measurement in large databases is often lacking. We aimed to develop and validate a natural language processing (NLP) algorithm to extract oncologists' documentation of stage in the national Veterans Affairs (VA) Healthcare System.
Methods: Using nationwide electronic health record (EHR) and cancer registry data from the VA Corporate Data Warehouse, we developed and validated a rule-based NLP algorithm to extract oncologist-determined MM stage. To that end, a clinician annotated MM stage within over 5,000 short snippets of clinical notes, and annotated MM stage at MM treatment initiation for 200 patients. These were allocated into snippet- and patient-level development and validation sets. We developed MM stage extraction and roll-up algorithms within the development sets. After the algorithms were finalized, we validated them using standard measures in held-out validation sets.
Results: We developed algorithms for three different MM staging systems that have been in widespread use (Revised International Staging System [R-ISS], International Staging System [ISS], and Durie-Salmon [DS]) and for stage reported without a clearly defined system. Precision and recall were uniformly high for MM stage at the snippet level, ranging from 0.92 to 0.99 for the different MM staging systems. Performance in identifying for MM stage at treatment initiation at the patient level was also excellent, with precision of 0.92, 0.96, 0.90, and 0.86 and recall of 0.99, 0.98, 0.94, and 0.92 for R-ISS, ISS, DS, and unclear stage, respectively.
Conclusion: Our MM stage extraction algorithm uses rule-based NLP and data aggregation to accurately measure MM stage documented in oncology notes and pathology reports in VA's national EHR system. It may be adapted to other systems where MM stage is recorded in clinical notes.
目的:多发性骨髓瘤(MM)的分期是衡量疾病风险的一个重要指标,但在大型数据库中往往缺乏对分期的测量。我们旨在开发并验证一种自然语言处理(NLP)算法,以提取全国退伍军人事务(VA)医疗保健系统中肿瘤学家对分期的记录:利用退伍军人事务部企业数据仓库(VA Corporate Data Warehouse)中的全国电子健康记录(EHR)和癌症登记数据,我们开发并验证了一种基于规则的 NLP 算法,用于提取肿瘤学家确定的 MM 分期。为此,一名临床医生在 5000 多份简短的临床笔记片段中注释了 MM 分期,并在 200 名患者开始 MM 治疗时注释了 MM 分期。这些数据被分配到片段级和患者级的开发集和验证集。我们在开发集内开发了 MM 阶段提取和卷积算法。算法确定后,我们在保留的验证集中使用标准测量方法对其进行了验证:我们为三种广泛使用的不同 MM 分期系统(修订版国际分期系统 [R-ISS]、国际分期系统 [ISS] 和 Durie-Salmon [DS])以及没有明确定义系统的分期报告开发了算法。在片段水平上,MM 分期的精确度和召回率都很高,不同 MM 分期系统的精确度和召回率从 0.92 到 0.99 不等。在患者层面识别开始治疗时的 MM 分期也非常出色,R-ISS、ISS、DS 和不明确分期的精确度分别为 0.92、0.96、0.90 和 0.86,召回率分别为 0.99、0.98、0.94 和 0.92:我们的MM分期提取算法使用基于规则的NLP和数据聚合来准确测量退伍军人事务部国家电子病历系统中肿瘤笔记和病理报告中记录的MM分期。该算法可适用于在临床笔记中记录 MM 分期的其他系统。
{"title":"Natural Language Processing Algorithm to Extract Multiple Myeloma Stage From Oncology Notes in the Veterans Affairs Healthcare System.","authors":"Sergey D Goryachev, Cenk Yildirim, Clark DuMontier, Jennifer La, Mayuri Dharne, J Michael Gaziano, Mary T Brophy, Nikhil C Munshi, Jane A Driver, Nhan V Do, Nathanael R Fillmore","doi":"10.1200/CCI.23.00197","DOIUrl":"10.1200/CCI.23.00197","url":null,"abstract":"<p><strong>Purpose: </strong>Stage in multiple myeloma (MM) is an essential measure of disease risk, but its measurement in large databases is often lacking. We aimed to develop and validate a natural language processing (NLP) algorithm to extract oncologists' documentation of stage in the national Veterans Affairs (VA) Healthcare System.</p><p><strong>Methods: </strong>Using nationwide electronic health record (EHR) and cancer registry data from the VA Corporate Data Warehouse, we developed and validated a rule-based NLP algorithm to extract oncologist-determined MM stage. To that end, a clinician annotated MM stage within over 5,000 short snippets of clinical notes, and annotated MM stage at MM treatment initiation for 200 patients. These were allocated into snippet- and patient-level development and validation sets. We developed MM stage extraction and roll-up algorithms within the development sets. After the algorithms were finalized, we validated them using standard measures in held-out validation sets.</p><p><strong>Results: </strong>We developed algorithms for three different MM staging systems that have been in widespread use (Revised International Staging System [R-ISS], International Staging System [ISS], and Durie-Salmon [DS]) and for stage reported without a clearly defined system. Precision and recall were uniformly high for MM stage at the snippet level, ranging from 0.92 to 0.99 for the different MM staging systems. Performance in identifying for MM stage at treatment initiation at the patient level was also excellent, with precision of 0.92, 0.96, 0.90, and 0.86 and recall of 0.99, 0.98, 0.94, and 0.92 for R-ISS, ISS, DS, and unclear stage, respectively.</p><p><strong>Conclusion: </strong>Our MM stage extraction algorithm uses rule-based NLP and data aggregation to accurately measure MM stage documented in oncology notes and pathology reports in VA's national EHR system. It may be adapted to other systems where MM stage is recorded in clinical notes.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300197"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11371094/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141749645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kathi Mooney, Susan L Beck, Christina Wilson, Lorinda Coombs, Meagan Whisenant, Ann Marie Moraitis, Elizabeth A Sloss, Natalya Alekhina, Jennifer Lloyd, Mary Steinbach, Bridget Nicholson, Eli Iacob, Gary Donaldson
Purpose: People with cancer experience poorly controlled symptoms that persist between treatment visits. Automated digital technology can remotely monitor and facilitate symptom management at home. Essential to digital interventions is patient engagement, user satisfaction, and intervention benefits that are distributed across patient populations so as not to perpetuate inequities. We evaluated Symptom Care at Home (SCH), an automated digital platform, to determine patient engagement, satisfaction, and whether intervention subgroups gained similar symptom reduction benefits.
Methods: 358 patients with cancer receiving a course of chemotherapy were randomly assigned to SCH or usual care (UC). Both groups reported daily on 11 symptoms and completed the SF36 (Short Form Health Survey) monthly. SCH participants received immediate automated self-care coaching on reported symptoms. As needed, nurse practitioners followed up for poorly controlled symptoms.
Results: The average participant was White (83%), female (75%), and urban-dwelling (78.6%). Daily call adherence was 90% of expected days. Participants reported high user satisfaction. SCH participants had lower symptom burden than UC in all subgroups: age, sex, race, income, residence type, diagnosis, and stage (all P < .001 effect size 0.33-0.65), except for stages I and II cancers. Non-White and lower-income SCH participants gained a higher magnitude of symptom reduction than White participants and higher-income participants. Additionally, SCH men gained higher SF36 mental health (MH) benefit. There were no differences on other SF36 indices.
Conclusion: Participants were highly satisfied and consistently engaged the SCH platform. SCH men gained large MH improvements, perhaps from increased comfort in sharing concerns through automated interactions. Although all intervention subgroups benefited, non-White participants and those with lower income gained higher symptom reduction benefit, suggesting that systematic care through digital tools can overcome existing disparities in symptom care outcomes.
目的:癌症患者的症状控制不佳,在两次治疗之间持续存在。自动化数字技术可以远程监控并促进在家进行症状管理。数字干预的关键在于患者的参与度、用户满意度以及在不同患者群体中的干预效果,从而避免不公平现象的长期存在。我们对自动数字平台 "居家症状护理"(SCH)进行了评估,以确定患者的参与度、满意度以及干预亚组是否获得了类似的症状缓解效果。方法:358 名接受化疗的癌症患者被随机分配到 SCH 或常规护理(UC)组。两组患者每天报告 11 种症状,每月填写 SF36(简表健康调查)。SCH组的参与者会立即接受有关所报告症状的自动自我护理指导。必要时,执业护士会对控制不佳的症状进行跟踪:参与者平均为白人(83%)、女性(75%)和城市居民(78.6%)。每天坚持呼叫的比例为预期天数的 90%。参与者表示用户满意度很高。在年龄、性别、种族、收入、居住地类型、诊断和分期等所有分组中,SCH 参与者的症状负担均低于 UC 参与者(所有 P < .001 的效应大小为 0.33-0.65),但 I 期和 II 期癌症除外。与白人和高收入人群相比,非白人和低收入人群的症状减轻程度更高。此外,SCH 男性获得的 SF36 心理健康(MH)益处更高。其他 SF36 指数没有差异:结论:参与者对 SCH 平台非常满意,并持续参与其中。SCH男性在心理健康方面获得了很大改善,这可能是由于他们通过自动互动分享了更多的担忧。尽管所有干预亚组都从中受益,但非白人参与者和收入较低者在症状减轻方面获益更大,这表明通过数字工具进行系统护理可以克服症状护理结果方面的现有差异。
{"title":"Assessing Patient Perspectives and the Health Equity of a Digital Cancer Symptom Remote Monitoring and Management System.","authors":"Kathi Mooney, Susan L Beck, Christina Wilson, Lorinda Coombs, Meagan Whisenant, Ann Marie Moraitis, Elizabeth A Sloss, Natalya Alekhina, Jennifer Lloyd, Mary Steinbach, Bridget Nicholson, Eli Iacob, Gary Donaldson","doi":"10.1200/CCI.23.00243","DOIUrl":"10.1200/CCI.23.00243","url":null,"abstract":"<p><strong>Purpose: </strong>People with cancer experience poorly controlled symptoms that persist between treatment visits. Automated digital technology can remotely monitor and facilitate symptom management at home. Essential to digital interventions is patient engagement, user satisfaction, and intervention benefits that are distributed across patient populations so as not to perpetuate inequities. We evaluated Symptom Care at Home (SCH), an automated digital platform, to determine patient engagement, satisfaction, and whether intervention subgroups gained similar symptom reduction benefits.</p><p><strong>Methods: </strong>358 patients with cancer receiving a course of chemotherapy were randomly assigned to SCH or usual care (UC). Both groups reported daily on 11 symptoms and completed the SF36 (Short Form Health Survey) monthly. SCH participants received immediate automated self-care coaching on reported symptoms. As needed, nurse practitioners followed up for poorly controlled symptoms.</p><p><strong>Results: </strong>The average participant was White (83%), female (75%), and urban-dwelling (78.6%). Daily call adherence was 90% of expected days. Participants reported high user satisfaction. SCH participants had lower symptom burden than UC in all subgroups: age, sex, race, income, residence type, diagnosis, and stage (all <i>P</i> < .001 effect size 0.33-0.65), except for stages I and II cancers. Non-White and lower-income SCH participants gained a higher magnitude of symptom reduction than White participants and higher-income participants. Additionally, SCH men gained higher SF36 mental health (MH) benefit. There were no differences on other SF36 indices.</p><p><strong>Conclusion: </strong>Participants were highly satisfied and consistently engaged the SCH platform. SCH men gained large MH improvements, perhaps from increased comfort in sharing concerns through automated interactions. Although all intervention subgroups benefited, non-White participants and those with lower income gained higher symptom reduction benefit, suggesting that systematic care through digital tools can overcome existing disparities in symptom care outcomes.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300243"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141753365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Purpose: Early prediction of response to immunotherapy may help guide patient management by identifying resistance to treatment and allowing adaptation of therapies. This analysis evaluated a mathematical model of response to immunotherapy that provides patient-specific prediction of outcome using the initial change in tumor size/burden from baseline to the first follow-up visit on standard imaging scans.
Methods: We applied the model to 600 patients with advanced solid tumors who received durvalumab in Study 1108, a phase I/II trial, and compared outcome prediction performance versus size-based criteria with RECIST version 1.1 best overall response (BOR), baseline circulating tumor (ct)DNA level, and other clinical/pathologic predictors of immunotherapy response.
Results: In multiple solid tumors, the mathematical parameter representing net tumor growth rate at the first on-treatment computed tomography (CT) scan assessed around 6 weeks after starting durvalumab (α1) had a concordance index to predict overall survival (OS) of 0.66-0.77 on multivariate analyses. This measurement of early tumor dynamics significantly improved multivariate OS models that included standard RECIST v1.1 criteria, baseline ctDNA levels, and other clinical/pathologic factors in predicting OS. Furthermore, α1 was assessed consistently at the first on-treatment CT scan, whereas all traditional RECIST BOR groups were confirmed only after this time.
Conclusion: These results support further exploring α1 as an integral biomarker of response to immunotherapy. This biomarker may be predictive of further benefit and can be assessed before RECIST response groups can be assigned, potentially providing an opportunity to personalize oncologic management.
目的:对免疫疗法反应的早期预测有助于识别治疗耐药性并调整疗法,从而为患者管理提供指导。这项分析评估了一个免疫疗法反应数学模型,该模型利用标准成像扫描显示的肿瘤大小/负担从基线到首次随访的初始变化,提供针对患者的疗效预测:我们将该模型应用于600名在I/II期试验1108研究中接受了durvalumab治疗的晚期实体瘤患者,并比较了该模型与基于肿瘤大小的标准、RECIST 1.1版最佳总体反应(BOR)、基线循环肿瘤(ct)DNA水平以及其他免疫疗法反应的临床/病理预测指标之间的结果预测性能:在多种实体瘤中,在开始使用度伐卢单抗后6周左右进行首次治疗计算机断层扫描(CT)评估时,代表肿瘤净生长率的数学参数(α1)在多变量分析中预测总生存期(OS)的一致性指数为0.66-0.77。这种早期肿瘤动态测量方法显著改善了预测 OS 的多变量 OS 模型,这些模型包括标准 RECIST v1.1 标准、基线 ctDNA 水平和其他临床/病理因素。此外,α1在首次治疗CT扫描时就得到了一致的评估,而所有传统的RECIST BOR组别都是在这一时间之后才得到确认:这些结果支持进一步探索将α1作为免疫疗法反应的综合生物标志物。结论:这些结果支持进一步探索将α1作为免疫疗法反应的综合生物标志物,该生物标志物可预测进一步的获益,并可在分配RECIST反应组别之前进行评估,从而有可能为个性化肿瘤治疗提供机会。
{"title":"Clinical Validation of Mathematically Derived Early Tumor Dynamics for Solid Tumors in Response to Durvalumab.","authors":"Qin Li, Vittorio Cristini, Ashok Gupta, Ikbel Achour, J Carl Barrett, Eugene J Koay","doi":"10.1200/CCI.23.00254","DOIUrl":"10.1200/CCI.23.00254","url":null,"abstract":"<p><strong>Purpose: </strong>Early prediction of response to immunotherapy may help guide patient management by identifying resistance to treatment and allowing adaptation of therapies. This analysis evaluated a mathematical model of response to immunotherapy that provides patient-specific prediction of outcome using the initial change in tumor size/burden from baseline to the first follow-up visit on standard imaging scans.</p><p><strong>Methods: </strong>We applied the model to 600 patients with advanced solid tumors who received durvalumab in Study 1108, a phase I/II trial, and compared outcome prediction performance versus size-based criteria with RECIST version 1.1 best overall response (BOR), baseline circulating tumor (ct)DNA level, and other clinical/pathologic predictors of immunotherapy response.</p><p><strong>Results: </strong>In multiple solid tumors, the mathematical parameter representing net tumor growth rate at the first on-treatment computed tomography (CT) scan assessed around 6 weeks after starting durvalumab (<i>α</i><sub>1</sub>) had a concordance index to predict overall survival (OS) of 0.66-0.77 on multivariate analyses. This measurement of early tumor dynamics significantly improved multivariate OS models that included standard RECIST v1.1 criteria, baseline ctDNA levels, and other clinical/pathologic factors in predicting OS. Furthermore, <i>α</i><sub>1</sub> was assessed consistently at the first on-treatment CT scan, whereas all traditional RECIST BOR groups were confirmed only after this time.</p><p><strong>Conclusion: </strong>These results support further exploring <i>α</i><sub>1</sub> as an integral biomarker of response to immunotherapy. This biomarker may be predictive of further benefit and can be assessed before RECIST response groups can be assigned, potentially providing an opportunity to personalize oncologic management.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300254"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141602106","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Cândida Cardoso, Daniel Pestana, Sreemol Gokuladhas, Ana D Marreiros, Justin M O'Sullivan, Alexandra Binnie, Mónica TFernandes, Pedro Castelo-Branco
Purpose: AML is a hematologic cancer that is clinically heterogeneous, with a wide range of clinical outcomes. DNA methylation changes are a hallmark of AML but are not routinely used as a criterion for risk stratification. The aim of this study was to explore DNA methylation markers that could risk stratify patients with cytogenetically normal AML (CN-AML), currently classified as intermediate-risk.
Materials and methods: DNA methylation profiles in whole blood samples from 77 patients with CN-AML in The Cancer Genome Atlas (LAML cohort) were analyzed. Individual 5'-cytosine-phosphate-guanine-3' (CpG) sites were assessed for their ability to predict overall survival. The output was validated using DNA methylation profiles from bone marrow samples of 79 patients with CN-AML in a separate data set from the Gene Expression Omnibus.
Results: In the training set, using DNA methylation data derived from the 450K array, we identified 2,549 CpG sites that could potentially distinguish patients with CN-AML with an adverse prognosis (intermediate-poor) from those with a more favorable prognosis (intermediate-favorable) independent of age. Of these, 25 CpGs showed consistent prognostic potential across both the 450K and 27K array platforms. In a separate validation data set, nine of these 25 CpGs exhibited statistically significant differences in 2-year survival. These nine validated CpGs formed the basis for a combined prognostic biomarker panel, which includes an 8-CpG Somatic Panel and the methylation status of cg23947872. This panel displayed strong predictive ability for 2-year survival, 2-year progression-free survival, and complete remission in the validation cohort.
Conclusion: This study highlights DNA methylation profiling as a promising approach to enhance risk stratification in patients with CN-AML, potentially offering a pathway to more personalized treatment strategies.
{"title":"Identification of Novel DNA Methylation Prognostic Biomarkers for AML With Normal Cytogenetics.","authors":"Cândida Cardoso, Daniel Pestana, Sreemol Gokuladhas, Ana D Marreiros, Justin M O'Sullivan, Alexandra Binnie, Mónica TFernandes, Pedro Castelo-Branco","doi":"10.1200/CCI.23.00265","DOIUrl":"10.1200/CCI.23.00265","url":null,"abstract":"<p><strong>Purpose: </strong>AML is a hematologic cancer that is clinically heterogeneous, with a wide range of clinical outcomes. DNA methylation changes are a hallmark of AML but are not routinely used as a criterion for risk stratification. The aim of this study was to explore DNA methylation markers that could risk stratify patients with cytogenetically normal AML (CN-AML), currently classified as intermediate-risk.</p><p><strong>Materials and methods: </strong>DNA methylation profiles in whole blood samples from 77 patients with CN-AML in The Cancer Genome Atlas (LAML cohort) were analyzed. Individual 5'-cytosine-phosphate-guanine-3' (CpG) sites were assessed for their ability to predict overall survival. The output was validated using DNA methylation profiles from bone marrow samples of 79 patients with CN-AML in a separate data set from the Gene Expression Omnibus.</p><p><strong>Results: </strong>In the training set, using DNA methylation data derived from the 450K array, we identified 2,549 CpG sites that could potentially distinguish patients with CN-AML with an adverse prognosis (<i>intermediate-poor</i>) from those with a more favorable prognosis (<i>intermediate-favorable</i>) independent of age. Of these, 25 CpGs showed consistent prognostic potential across both the 450K and 27K array platforms. In a separate validation data set, nine of these 25 CpGs exhibited statistically significant differences in 2-year survival. These nine validated CpGs formed the basis for a combined prognostic biomarker panel, which includes an 8-CpG Somatic Panel and the methylation status of cg23947872. This panel displayed strong predictive ability for 2-year survival, 2-year progression-free survival, and complete remission in the validation cohort.</p><p><strong>Conclusion: </strong>This study highlights DNA methylation profiling as a promising approach to enhance risk stratification in patients with CN-AML, potentially offering a pathway to more personalized treatment strategies.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300265"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11371081/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141762536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gabriel Roman Souza, Kea Turner, Keerthi Gullapalli, Mahati Paravathaneni, Filip Ionescu, Adele Semaan, Amayla Budet DeJesus, Gillian Trujillo, Casey Le, Youngchul Kim, Xiaoqi Sun, Sarah Raymond, Amy Schneider, Brandon Manley, Rohit Jain, Scott Gilbert, Heather S L Jim, Philippe E Spiess, Jad Chahoud
Purpose: Patients with advanced renal cell carcinoma (RCC) face significant challenges, stemming both from the complexities of the disease itself and the adverse effects of treatments. This study evaluated the feasibility and acceptability of a mobile health (mHealth) application tailored for education and symptom management of patients with advanced RCC receiving combined immune checkpoint inhibitor and tyrosine kinase inhibitor (ICI-TKI) therapy.
Methods: The primary end points were acceptability and feasibility. Acceptability was defined as the proportion of patients approached who consented to participate, setting a benchmark of at least 50% for this metric. Feasibility was gauged by the completion rate of the intervention among the participants; it required at least 50% of participants to fully complete the intervention and at least 70% to finish half of the administered questionnaires. The secondary end points included knowledge assessment and patient-reported outcomes (PROs). PROs were evaluated using validated instruments. To discern the changes between pre- and post-educational module quiz scores, we used the Wilcoxon signed-rank test. Time-course data of PROs were visualized using line plots and then compared using paired t-tests.
Results: From November 2022 to July 2023, 20 of 22 (90%) patients approached for the study consented and enrolled. Of the enrolled patients, 60% completed all questionnaires and knowledge assessments at every time point and 75% completed at least half of the surveys and questionnaires. Significant pre/post differences were noted in two of six quizzes in the knowledge assessment. This study population did not experience a significant change in PRO scores after starting therapy.
Conclusion: The mHealth application designed for education and symptom management in patients with advanced RCC undergoing combination ICI-TKI has proven to be both acceptable and feasible, meeting previous research benchmarks.
{"title":"Feasibility of a Smartphone Application for Education and Symptom Management of Patients With Renal Cell Carcinoma on Combined Tyrosine Kinase and Immune Checkpoint Inhibitors.","authors":"Gabriel Roman Souza, Kea Turner, Keerthi Gullapalli, Mahati Paravathaneni, Filip Ionescu, Adele Semaan, Amayla Budet DeJesus, Gillian Trujillo, Casey Le, Youngchul Kim, Xiaoqi Sun, Sarah Raymond, Amy Schneider, Brandon Manley, Rohit Jain, Scott Gilbert, Heather S L Jim, Philippe E Spiess, Jad Chahoud","doi":"10.1200/CCI.24.00044","DOIUrl":"10.1200/CCI.24.00044","url":null,"abstract":"<p><strong>Purpose: </strong>Patients with advanced renal cell carcinoma (RCC) face significant challenges, stemming both from the complexities of the disease itself and the adverse effects of treatments. This study evaluated the feasibility and acceptability of a mobile health (mHealth) application tailored for education and symptom management of patients with advanced RCC receiving combined immune checkpoint inhibitor and tyrosine kinase inhibitor (ICI-TKI) therapy.</p><p><strong>Methods: </strong>The primary end points were acceptability and feasibility. Acceptability was defined as the proportion of patients approached who consented to participate, setting a benchmark of at least 50% for this metric. Feasibility was gauged by the completion rate of the intervention among the participants; it required at least 50% of participants to fully complete the intervention and at least 70% to finish half of the administered questionnaires. The secondary end points included knowledge assessment and patient-reported outcomes (PROs). PROs were evaluated using validated instruments. To discern the changes between pre- and post-educational module quiz scores, we used the Wilcoxon signed-rank test. Time-course data of PROs were visualized using line plots and then compared using paired t-tests.</p><p><strong>Results: </strong>From November 2022 to July 2023, 20 of 22 (90%) patients approached for the study consented and enrolled. Of the enrolled patients, 60% completed all questionnaires and knowledge assessments at every time point and 75% completed at least half of the surveys and questionnaires. Significant pre/post differences were noted in two of six quizzes in the knowledge assessment. This study population did not experience a significant change in PRO scores after starting therapy.</p><p><strong>Conclusion: </strong>The mHealth application designed for education and symptom management in patients with advanced RCC undergoing combination ICI-TKI has proven to be both acceptable and feasible, meeting previous research benchmarks.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400044"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141767984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dahhay Lee, Seongyoon Kim, Sanghee Lee, Hak Jin Kim, Ji Hyun Kim, Myong Cheol Lim, Hyunsoon Cho
Purpose: Patients with epithelial ovarian cancer (EOC) have an elevated risk for venous thromboembolism (VTE). To assess the risk of VTE, models were developed by statistical or machine learning algorithms. However, few models have accommodated deep learning (DL) algorithms in realistic clinical settings. We aimed to develop a predictive DL model, exploiting rich information from electronic health records (EHRs), including dynamic clinical features and the presence of competing risks.
Methods: We extracted EHRs of 1,268 patients diagnosed with EOC from January 2007 through December 2017 at the National Cancer Center, Korea. DL survival networks using fully connected layers, temporal attention, and recurrent neural networks were adopted and compared with multi-perceptron-based classification models. Prediction accuracy was independently validated in the data set of 423 patients newly diagnosed with EOC from January 2018 to December 2019. Personalized risk plots displaying the individual interval risk were developed.
Results: DL-based survival networks achieved a superior area under the receiver operating characteristic curve (AUROC) between 0.95 and 0.98 while the AUROC of classification models was between 0.85 and 0.90. As clinical information benefits the prediction accuracy, the proposed dynamic survival network outperformed other survival networks for the test and validation data set with the highest time-dependent concordance index (0.974, 0.975) and lowest Brier score (0.051, 0.049) at 6 months after a cancer diagnosis. Our visualization showed that the interval risk fluctuating along with the changes in longitudinal clinical features.
Conclusion: Adaption of dynamic patient clinical features and accounting for competing risks from EHRs into the DL algorithms demonstrated VTE risk prediction with high accuracy. Our results show that this novel dynamic survival network can provide personalized risk prediction with the potential to assist risk-based clinical intervention to prevent VTE among patients with EOC.
{"title":"Deep Learning-Based Dynamic Risk Prediction of Venous Thromboembolism for Patients With Ovarian Cancer in Real-World Settings From Electronic Health Records.","authors":"Dahhay Lee, Seongyoon Kim, Sanghee Lee, Hak Jin Kim, Ji Hyun Kim, Myong Cheol Lim, Hyunsoon Cho","doi":"10.1200/CCI.23.00192","DOIUrl":"10.1200/CCI.23.00192","url":null,"abstract":"<p><strong>Purpose: </strong>Patients with epithelial ovarian cancer (EOC) have an elevated risk for venous thromboembolism (VTE). To assess the risk of VTE, models were developed by statistical or machine learning algorithms. However, few models have accommodated deep learning (DL) algorithms in realistic clinical settings. We aimed to develop a predictive DL model, exploiting rich information from electronic health records (EHRs), including dynamic clinical features and the presence of competing risks.</p><p><strong>Methods: </strong>We extracted EHRs of 1,268 patients diagnosed with EOC from January 2007 through December 2017 at the National Cancer Center, Korea. DL survival networks using fully connected layers, temporal attention, and recurrent neural networks were adopted and compared with multi-perceptron-based classification models. Prediction accuracy was independently validated in the data set of 423 patients newly diagnosed with EOC from January 2018 to December 2019. Personalized risk plots displaying the individual interval risk were developed.</p><p><strong>Results: </strong>DL-based survival networks achieved a superior area under the receiver operating characteristic curve (AUROC) between 0.95 and 0.98 while the AUROC of classification models was between 0.85 and 0.90. As clinical information benefits the prediction accuracy, the proposed dynamic survival network outperformed other survival networks for the test and validation data set with the highest time-dependent concordance index (0.974, 0.975) and lowest Brier score (0.051, 0.049) at 6 months after a cancer diagnosis. Our visualization showed that the interval risk fluctuating along with the changes in longitudinal clinical features.</p><p><strong>Conclusion: </strong>Adaption of dynamic patient clinical features and accounting for competing risks from EHRs into the DL algorithms demonstrated VTE risk prediction with high accuracy. Our results show that this novel dynamic survival network can provide personalized risk prediction with the potential to assist risk-based clinical intervention to prevent VTE among patients with EOC.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300192"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141602107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michael Luu, Gillian Gresham, Lynn Henry, Sungjin Kim, Andre Rogatko, Greg Yothers, Ron D Hays, Mourad Tighiouart, Patricia A Ganz
Purpose: Longitudinal patient tolerability data collected as part of randomized controlled trials are often summarized in a way that loses information and does not capture the treatment experience. To address this, we developed an interactive web application to empower clinicians and researchers to explore and visualize patient tolerability data.
Methods: We used adverse event (AE) data (Common Terminology Criteria for Adverse Events) and patient-reported outcomes (PROs) from the NSABP-B35 phase III clinical trial, which compared anastrozole with tamoxifen for breast cancer-free survival, to demonstrate the tools. An interactive web application was developed using R and the Shiny web application framework that generates Sankey diagrams to visualize AEs and PROs using four tools: AE Explorer, PRO Explorer, Cohort Explorer, and Custom Explorer.
Results: To illustrate how users can use the interactive tool, examples for each of the four applications are presented using data from the NSABP-B35 phase III trial and the NSABP-B30 trial for the Custom Explorer. In the AE and PRO explorers, users can select AEs or PROs to visualize within specified time periods and compare across treatments. In the cohort explorer, users can select a subset of patients with a specific symptom, severity, and treatment received to visualize the trajectory over time within a specified time interval. With the custom explorer, users can upload and visualize structured longitudinal toxicity and tolerability data.
Conclusion: We have created an interactive web application and tool for clinicians and researchers to explore and visualize clinical trial tolerability data. This adaptable tool can be extended for other clinical trial data visualization and incorporated into future patient-clinician interactions regarding treatment decisions.
目的:作为随机对照试验的一部分而收集的患者耐受性纵向数据在总结时往往会丢失信息,无法捕捉治疗体验。为了解决这个问题,我们开发了一个交互式网络应用程序,使临床医生和研究人员能够探索患者耐受性数据并将其可视化:我们使用 NSABP-B35 III 期临床试验中的不良事件(AE)数据(不良事件通用术语标准)和患者报告结果(PROs)来展示这些工具。我们使用 R 和 Shiny 网络应用程序框架开发了一个交互式网络应用程序,该程序可生成 Sankey 图表,使用四种工具对 AE 和 PRO 进行可视化:AE Explorer、PRO Explorer、Cohort Explorer 和 Custom Explorer.Results:为了说明用户如何使用该交互式工具,我们使用来自 NSABP-B35 III 期试验的数据和来自 NSABP-B30 试验的数据分别介绍了这四种应用的示例。在AE和PRO探索器中,用户可以选择AE或PRO,对指定时间段内的AE或PRO进行可视化,并对不同治疗进行比较。在队列探索器中,用户可以选择具有特定症状、严重程度和接受过治疗的患者子集,以可视化指定时间间隔内的随时间变化的轨迹。通过自定义资源管理器,用户可以上传并可视化结构化的纵向毒性和耐受性数据:我们为临床医生和研究人员创建了一个交互式网络应用程序和工具,用于探索和可视化临床试验耐受性数据。这一工具适应性强,可扩展用于其他临床试验数据的可视化,并可融入未来病人与医生在治疗决策方面的互动中。
{"title":"Development of a Web-Based Interactive Tool for Visualizing Breast Cancer Clinical Trial Tolerability Data.","authors":"Michael Luu, Gillian Gresham, Lynn Henry, Sungjin Kim, Andre Rogatko, Greg Yothers, Ron D Hays, Mourad Tighiouart, Patricia A Ganz","doi":"10.1200/CCI.24.00007","DOIUrl":"10.1200/CCI.24.00007","url":null,"abstract":"<p><strong>Purpose: </strong>Longitudinal patient tolerability data collected as part of randomized controlled trials are often summarized in a way that loses information and does not capture the treatment experience. To address this, we developed an interactive web application to empower clinicians and researchers to explore and visualize patient tolerability data.</p><p><strong>Methods: </strong>We used adverse event (AE) data (Common Terminology Criteria for Adverse Events) and patient-reported outcomes (PROs) from the NSABP-B35 phase III clinical trial, which compared anastrozole with tamoxifen for breast cancer-free survival, to demonstrate the tools. An interactive web application was developed using R and the Shiny web application framework that generates Sankey diagrams to visualize AEs and PROs using four tools: AE Explorer, PRO Explorer, Cohort Explorer, and Custom Explorer.</p><p><strong>Results: </strong>To illustrate how users can use the interactive tool, examples for each of the four applications are presented using data from the NSABP-B35 phase III trial and the NSABP-B30 trial for the Custom Explorer. In the AE and PRO explorers, users can select AEs or PROs to visualize within specified time periods and compare across treatments. In the cohort explorer, users can select a subset of patients with a specific symptom, severity, and treatment received to visualize the trajectory over time within a specified time interval. With the custom explorer, users can upload and visualize structured longitudinal toxicity and tolerability data.</p><p><strong>Conclusion: </strong>We have created an interactive web application and tool for clinicians and researchers to explore and visualize clinical trial tolerability data. This adaptable tool can be extended for other clinical trial data visualization and incorporated into future patient-clinician interactions regarding treatment decisions.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400007"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11254331/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141629264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marissa L Buchan, Keshav Goel, Chelsey K Schneider, Vera Steullet, Susan Bratton, Ethan Basch
Purpose: Nutritional status is an established driver of cancer outcomes, but there is an insufficient workforce of registered dietitians to meet patient needs for nutritional counseling. Artificial intelligence (AI) and machine learning (ML) afford the opportunity to expand access to guideline-based nutritional support.
Methods: An AI-based nutrition assistant called Ina was developed on the basis of a learning data set of >100,000 expert-curated interventions, peer-reviewed literature, and clinical guidelines, and provides a conversational text message-based patient interface to guide dietary habits and answer questions. Ina was implemented nationally in partnership with 25 advocacy organizations. Data on demographics, patient-reported outcomes, and utilization were systematically collected.
Results: Between July 2019 and August 2023, 3,310 users from all 50 states registered to use Ina. Users were 73% female; median age was 57 (range, 18-91) years; most common cancer types were genitourinary (22%), breast (21%), gynecologic (19%), GI (14%), and lung (12%). Users were medically complex, with 50% reporting Stage III to IV disease, 37% with metastases, and 50% with 2+ chronic conditions. Nutritional challenges were highly prevalent: 58% had overweight/obese BMIs, 83% reported barriers to good nutrition, and 42% had food allergies/intolerances. Levels of engagement were high: 68% texted questions to Ina; 79% completed surveys; median user retention was 8.8 months; 94% were satisfied with the platform; and 98% found the guidance helpful. In an evaluation of outcomes, 84% used the advice to guide diet; 47% used recommended recipes, 82% felt the program improved quality of life (QoL), and 88% reported improved symptom management.
Conclusion: Implementation of an evidence-based AI virtual dietitian is feasible and is reported by patients to be beneficial on diet, QoL, and symptom management. Ongoing evaluations are assessing impact on other outcomes.
{"title":"National Implementation of an Artificial Intelligence-Based Virtual Dietitian for Patients With Cancer.","authors":"Marissa L Buchan, Keshav Goel, Chelsey K Schneider, Vera Steullet, Susan Bratton, Ethan Basch","doi":"10.1200/CCI.24.00085","DOIUrl":"https://doi.org/10.1200/CCI.24.00085","url":null,"abstract":"<p><strong>Purpose: </strong>Nutritional status is an established driver of cancer outcomes, but there is an insufficient workforce of registered dietitians to meet patient needs for nutritional counseling. Artificial intelligence (AI) and machine learning (ML) afford the opportunity to expand access to guideline-based nutritional support.</p><p><strong>Methods: </strong>An AI-based nutrition assistant called Ina was developed on the basis of a learning data set of >100,000 expert-curated interventions, peer-reviewed literature, and clinical guidelines, and provides a conversational text message-based patient interface to guide dietary habits and answer questions. Ina was implemented nationally in partnership with 25 advocacy organizations. Data on demographics, patient-reported outcomes, and utilization were systematically collected.</p><p><strong>Results: </strong>Between July 2019 and August 2023, 3,310 users from all 50 states registered to use Ina. Users were 73% female; median age was 57 (range, 18-91) years; most common cancer types were genitourinary (22%), breast (21%), gynecologic (19%), GI (14%), and lung (12%). Users were medically complex, with 50% reporting Stage III to IV disease, 37% with metastases, and 50% with 2+ chronic conditions. Nutritional challenges were highly prevalent: 58% had overweight/obese BMIs, 83% reported barriers to good nutrition, and 42% had food allergies/intolerances. Levels of engagement were high: 68% texted questions to Ina; 79% completed surveys; median user retention was 8.8 months; 94% were satisfied with the platform; and 98% found the guidance helpful. In an evaluation of outcomes, 84% used the advice to guide diet; 47% used recommended recipes, 82% felt the program improved quality of life (QoL), and 88% reported improved symptom management.</p><p><strong>Conclusion: </strong>Implementation of an evidence-based AI virtual dietitian is feasible and is reported by patients to be beneficial on diet, QoL, and symptom management. Ongoing evaluations are assessing impact on other outcomes.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400085"},"PeriodicalIF":4.2,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141238725","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Recent clinical trials in oncology have used increasingly complex methodologies, such as causal inference methods for intercurrent events, external control, and covariate adjustment, posing challenges in clarifying the estimand and underlying assumptions. This article proposes expressing causal structures using graphical tools-directed acyclic graphs (DAGs) and single-world intervention graphs (SWIGs)-in the planning phase of a clinical trial. It presents five rules for selecting a sufficient set of adjustment variables on the basis of a diagram representing the clinical trial, along with three case studies of randomized and single-arm trials and a brief tutorial on DAG and SWIG. Through the case studies, DAGs appear effective in clarifying assumptions for identifying causal effects, although SWIGs should complement DAGs due to their limitations in the presence of intercurrent events in oncology research.
最近的肿瘤学临床试验使用了越来越复杂的方法,例如针对并发症、外部控制和协变量调整的因果推断方法,这给明确估计和基本假设带来了挑战。本文建议在临床试验的规划阶段使用图形工具--定向无循环图(DAG)和单世界干预图(SWIG)--来表达因果结构。文章介绍了在表示临床试验的图表的基础上选择足够的调整变量集的五条规则,以及随机试验和单臂试验的三个案例研究和关于 DAG 和 SWIG 的简要教程。通过案例研究,DAG 似乎能有效地澄清确定因果效应的假设,尽管 SWIG 因其在肿瘤研究中存在并发症的局限性而应作为 DAG 的补充。
{"title":"Clarifying Causal Effects of Interest and Underlying Assumptions in Randomized and Nonrandomized Clinical Trials in Oncology Using Directed Acyclic Graphs and Single-World Intervention Graphs.","authors":"Shiro Tanaka, Yuriko Muramatsu, Kosuke Inoue","doi":"10.1200/CCI.23.00262","DOIUrl":"10.1200/CCI.23.00262","url":null,"abstract":"<p><p>Recent clinical trials in oncology have used increasingly complex methodologies, such as causal inference methods for intercurrent events, external control, and covariate adjustment, posing challenges in clarifying the estimand and underlying assumptions. This article proposes expressing causal structures using graphical tools-directed acyclic graphs (DAGs) and single-world intervention graphs (SWIGs)-in the planning phase of a clinical trial. It presents five rules for selecting a sufficient set of adjustment variables on the basis of a diagram representing the clinical trial, along with three case studies of randomized and single-arm trials and a brief tutorial on DAG and SWIG. Through the case studies, DAGs appear effective in clarifying assumptions for identifying causal effects, although SWIGs should complement DAGs due to their limitations in the presence of intercurrent events in oncology research.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300262"},"PeriodicalIF":3.3,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11371110/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141447548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Savino Cilla, Romina Rossi, Ragnhild Habberstad, Pal Klepstad, Monia Dall'Agata, Stein Kaasa, Vanessa Valenti, Costanza M Donati, Marco Maltoni, Alessio G Morganti
Purpose: The estimation of prognosis and life expectancy is critical in the care of patients with advanced cancer. To aid clinical decision making, we build a prognostic strategy combining a machine learning (ML) model with explainable artificial intelligence to predict 1-year survival after palliative radiotherapy (RT) for bone metastasis.
Materials and methods: Data collected in the multicentric PRAIS trial were extracted for 574 eligible adults diagnosed with metastatic cancer. The primary end point was the overall survival (OS) at 1 year (1-year OS) after the start of RT. Candidate covariate predictors consisted of 13 clinical and tumor-related pre-RT patient characteristics, seven dosimetric and treatment-related variables, and 45 pre-RT laboratory variables. ML models were developed and internally validated using the Python package. The effectiveness of each model was evaluated in terms of discrimination. A Shapley Additive Explanations (SHAP) explainability analysis to infer the global and local feature importance and to understand the reasons for correct and misclassified predictions was performed.
Results: The best-performing model for the classification of 1-year OS was the extreme gradient boosting algorithm, with AUC and F1-score values equal to 0.805 and 0.802, respectively. The SHAP technique revealed that higher chance of 1-year survival is associated with low values of interleukin-8, higher values of hemoglobin and lymphocyte count, and the nonuse of steroids.
Conclusion: An explainable ML approach can provide a reliable prediction of 1-year survival after RT in patients with advanced cancer. The implementation of SHAP analysis provides an intelligible explanation of individualized risk prediction, enabling oncologists to identify the best strategy for patient stratification and treatment selection.
{"title":"Explainable Machine Learning Model to Predict Overall Survival in Patients Treated With Palliative Radiotherapy for Bone Metastases.","authors":"Savino Cilla, Romina Rossi, Ragnhild Habberstad, Pal Klepstad, Monia Dall'Agata, Stein Kaasa, Vanessa Valenti, Costanza M Donati, Marco Maltoni, Alessio G Morganti","doi":"10.1200/CCI.24.00027","DOIUrl":"10.1200/CCI.24.00027","url":null,"abstract":"<p><strong>Purpose: </strong>The estimation of prognosis and life expectancy is critical in the care of patients with advanced cancer. To aid clinical decision making, we build a prognostic strategy combining a machine learning (ML) model with explainable artificial intelligence to predict 1-year survival after palliative radiotherapy (RT) for bone metastasis.</p><p><strong>Materials and methods: </strong>Data collected in the multicentric PRAIS trial were extracted for 574 eligible adults diagnosed with metastatic cancer. The primary end point was the overall survival (OS) at 1 year (1-year OS) after the start of RT. Candidate covariate predictors consisted of 13 clinical and tumor-related pre-RT patient characteristics, seven dosimetric and treatment-related variables, and 45 pre-RT laboratory variables. ML models were developed and internally validated using the Python package. The effectiveness of each model was evaluated in terms of discrimination. A Shapley Additive Explanations (SHAP) explainability analysis to infer the global and local feature importance and to understand the reasons for correct and misclassified predictions was performed.</p><p><strong>Results: </strong>The best-performing model for the classification of 1-year OS was the extreme gradient boosting algorithm, with AUC and F1-score values equal to 0.805 and 0.802, respectively. The SHAP technique revealed that higher chance of 1-year survival is associated with low values of interleukin-8, higher values of hemoglobin and lymphocyte count, and the nonuse of steroids.</p><p><strong>Conclusion: </strong>An explainable ML approach can provide a reliable prediction of 1-year survival after RT in patients with advanced cancer. The implementation of SHAP analysis provides an intelligible explanation of individualized risk prediction, enabling oncologists to identify the best strategy for patient stratification and treatment selection.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400027"},"PeriodicalIF":3.3,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141452101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}