Prediction of Effectiveness and Toxicities of Immune Checkpoint Inhibitors Using Real-World Patient Data.

IF 3.3 Q2 ONCOLOGY JCO Clinical Cancer Informatics Pub Date : 2024-02-01 DOI:10.1200/CCI.23.00207
Levente Lippenszky, Kathleen F Mittendorf, Zoltán Kiss, Michele L LeNoue-Newton, Pablo Napan-Molina, Protiva Rahman, Cheng Ye, Balázs Laczi, Eszter Csernai, Neha M Jain, Marilyn E Holt, Christina N Maxwell, Madeleine Ball, Yufang Ma, Margaret B Mitchell, Douglas B Johnson, David S Smith, Ben H Park, Christine M Micheel, Daniel Fabbri, Jan Wolber, Travis J Osterman
{"title":"Prediction of Effectiveness and Toxicities of Immune Checkpoint Inhibitors Using Real-World Patient Data.","authors":"Levente Lippenszky, Kathleen F Mittendorf, Zoltán Kiss, Michele L LeNoue-Newton, Pablo Napan-Molina, Protiva Rahman, Cheng Ye, Balázs Laczi, Eszter Csernai, Neha M Jain, Marilyn E Holt, Christina N Maxwell, Madeleine Ball, Yufang Ma, Margaret B Mitchell, Douglas B Johnson, David S Smith, Ben H Park, Christine M Micheel, Daniel Fabbri, Jan Wolber, Travis J Osterman","doi":"10.1200/CCI.23.00207","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Although immune checkpoint inhibitors (ICIs) have improved outcomes in certain patients with cancer, they can also cause life-threatening immunotoxicities. Predicting immunotoxicity risks alongside response could provide a personalized risk-benefit profile, inform therapeutic decision making, and improve clinical trial cohort selection. We aimed to build a machine learning (ML) framework using routine electronic health record (EHR) data to predict hepatitis, colitis, pneumonitis, and 1-year overall survival.</p><p><strong>Methods: </strong>Real-world EHR data of more than 2,200 patients treated with ICI through December 31, 2018, were used to develop predictive models. Using a prediction time point of ICI initiation, a 1-year prediction time window was applied to create binary labels for the four outcomes for each patient. Feature engineering involved aggregating laboratory measurements over appropriate time windows (60-365 days). Patients were randomly partitioned into training (80%) and test (20%) sets. Random forest classifiers were developed using a rigorous model development framework.</p><p><strong>Results: </strong>The patient cohort had a median age of 63 years and was 61.8% male. Patients predominantly had melanoma (37.8%), lung cancer (27.3%), or genitourinary cancer (16.4%). They were treated with PD-1 (60.4%), PD-L1 (9.0%), and CTLA-4 (19.7%) ICIs. Our models demonstrate reasonably strong performance, with AUCs of 0.739, 0.729, 0.755, and 0.752 for the pneumonitis, hepatitis, colitis, and 1-year overall survival models, respectively. Each model relies on an outcome-specific feature set, though some features are shared among models.</p><p><strong>Conclusion: </strong>To our knowledge, this is the first ML solution that assesses individual ICI risk-benefit profiles based predominantly on routine structured EHR data. As such, use of our ML solution will not require additional data collection or documentation in the clinic.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":null,"pages":null},"PeriodicalIF":3.3000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10919473/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JCO Clinical Cancer Informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1200/CCI.23.00207","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: Although immune checkpoint inhibitors (ICIs) have improved outcomes in certain patients with cancer, they can also cause life-threatening immunotoxicities. Predicting immunotoxicity risks alongside response could provide a personalized risk-benefit profile, inform therapeutic decision making, and improve clinical trial cohort selection. We aimed to build a machine learning (ML) framework using routine electronic health record (EHR) data to predict hepatitis, colitis, pneumonitis, and 1-year overall survival.

Methods: Real-world EHR data of more than 2,200 patients treated with ICI through December 31, 2018, were used to develop predictive models. Using a prediction time point of ICI initiation, a 1-year prediction time window was applied to create binary labels for the four outcomes for each patient. Feature engineering involved aggregating laboratory measurements over appropriate time windows (60-365 days). Patients were randomly partitioned into training (80%) and test (20%) sets. Random forest classifiers were developed using a rigorous model development framework.

Results: The patient cohort had a median age of 63 years and was 61.8% male. Patients predominantly had melanoma (37.8%), lung cancer (27.3%), or genitourinary cancer (16.4%). They were treated with PD-1 (60.4%), PD-L1 (9.0%), and CTLA-4 (19.7%) ICIs. Our models demonstrate reasonably strong performance, with AUCs of 0.739, 0.729, 0.755, and 0.752 for the pneumonitis, hepatitis, colitis, and 1-year overall survival models, respectively. Each model relies on an outcome-specific feature set, though some features are shared among models.

Conclusion: To our knowledge, this is the first ML solution that assesses individual ICI risk-benefit profiles based predominantly on routine structured EHR data. As such, use of our ML solution will not require additional data collection or documentation in the clinic.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用真实世界的患者数据预测免疫检查点抑制剂的有效性和毒性。
目的:尽管免疫检查点抑制剂(ICIs)改善了某些癌症患者的治疗效果,但它们也可能导致危及生命的免疫毒性。预测免疫毒性风险和反应可提供个性化的风险-效益概况,为治疗决策提供信息,并改善临床试验队列的选择。我们旨在利用常规电子健康记录(EHR)数据建立一个机器学习(ML)框架,以预测肝炎、结肠炎、肺炎和1年总生存期:截至 2018 年 12 月 31 日,使用 ICI 治疗的 2200 多名患者的真实 EHR 数据被用于开发预测模型。使用 ICI 启动的预测时间点,应用 1 年的预测时间窗为每位患者的四种结果创建二进制标签。特征工程包括在适当的时间窗(60-365 天)内汇总实验室测量结果。患者被随机分为训练集(80%)和测试集(20%)。使用严格的模型开发框架开发随机森林分类器:患者群的中位年龄为 63 岁,61.8% 为男性。患者主要患有黑色素瘤(37.8%)、肺癌(27.3%)或泌尿生殖系统癌症(16.4%)。他们接受了 PD-1(60.4%)、PD-L1(9.0%)和 CTLA-4 (19.7%) ICIs 治疗。我们的模型表现出相当强的性能,肺炎、肝炎、结肠炎和 1 年总生存期模型的 AUC 分别为 0.739、0.729、0.755 和 0.752。每个模型都依赖于特定结果的特征集,尽管模型之间共享某些特征:据我们所知,这是首个主要基于常规结构化电子病历数据评估个体 ICI 风险-效益概况的 ML 解决方案。因此,使用我们的 ML 解决方案无需在临床中进行额外的数据收集或记录。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
6.20
自引率
4.80%
发文量
190
期刊最新文献
Increasing Power in Phase III Oncology Trials With Multivariable Regression: An Empirical Assessment of 535 Primary End Point Analyses. Validation of Non-Small Cell Lung Cancer Clinical Insights Using a Generalized Oncology Natural Language Processing Model. Acknowledgment of Reviewers 2024. Deep Learning Features Can Improve Radiomics-Based Prostate Cancer Aggressiveness Prediction. Development and Optimization of a Bladder Cancer Algorithm Using SEER-Medicare Claims Data.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1