Mehrdad Rakaee, Masoud Tafavvoghi, Biagio Ricciuti, Joao V. Alessi, Alessio Cortellini, Fabrizio Citarella, Lorenzo Nibid, Giuseppe Perrone, Elio Adib, Claudia A. M. Fulgenzi, Cassio Murilo Hidalgo Filho, Alessandro Di Federico, Falah Jabar, Sayed Hashemi, Ilias Houda, Elin Richardsen, Lill-Tove Rasmussen Busund, Tom Donnem, Idris Bahce, David J. Pinato, Åslaug Helland, Lynette M. Sholl, Mark M. Awad, David J. Kwiatkowski
{"title":"预测晚期非小细胞肺癌免疫治疗反应的深度学习模型","authors":"Mehrdad Rakaee, Masoud Tafavvoghi, Biagio Ricciuti, Joao V. Alessi, Alessio Cortellini, Fabrizio Citarella, Lorenzo Nibid, Giuseppe Perrone, Elio Adib, Claudia A. M. Fulgenzi, Cassio Murilo Hidalgo Filho, Alessandro Di Federico, Falah Jabar, Sayed Hashemi, Ilias Houda, Elin Richardsen, Lill-Tove Rasmussen Busund, Tom Donnem, Idris Bahce, David J. Pinato, Åslaug Helland, Lynette M. Sholl, Mark M. Awad, David J. Kwiatkowski","doi":"10.1001/jamaoncol.2024.5356","DOIUrl":null,"url":null,"abstract":"ImportanceOnly a small fraction of patients with advanced non−small cell lung cancer (NSCLC) respond to immune checkpoint inhibitor (ICI) treatment. For optimal personalized NSCLC care, it is imperative to identify patients who are most likely to benefit from immunotherapy.ObjectiveTo develop a supervised deep learning−based ICI response prediction method; evaluate its performance alongside other known predictive biomarkers; and assess its association with clinical outcomes in patients with advanced NSCLC.Design, Setting, and ParticipantsThis multicenter cohort study developed and independently validated a deep learning−based response stratification model for predicting ICI treatment outcome in patients with advanced NSCLC from whole slide hematoxylin and eosin–stained images. Images for model development and validation were obtained from 1 participating center in the US and 3 in the European Union (EU) from August 2014 to December 2022. Data analyses were performed from September 2022 to May 2024.ExposureMonotherapy with ICIs.Main Outcomes and MeasuresModel performance measured by clinical end points and objective response rate (ORR) differentiation power vs other predictive biomarkers, ie, programmed death-ligand 1 (PD-L1), tumor mutational burden (TMB), and tumor-infiltrating lymphocytes (TILs).ResultsA total of 295 581 image tiles from 958 patients (mean [SD] age, 66.0 [10.6] years; 456 [48%] females and 502 [52%] males) treated with ICI for NSCLC were included in the analysis. The US-based development cohort consisted of 614 patients with median (IQR) follow-up time of 54.5 (38.2-68.1) months, and the EU-based validation cohort, 344 patients with 43.3 (27.4-53.9) months of follow-up. The ORR to ICI was 26% in the developmental cohort and 28% in the validation cohort. The deep learning model’s area under the receiver operating characteristic curve (AUC) for ORR was 0.75 (95% CI, 0.64-0.85) in the internal test set and 0.66 (95% CI, 0.60-0.72) in the validation cohort. In a multivariable analysis, the deep learning model’s score was an independent predictor of ICI response in the validation cohort for both progression-free (hazard ratio, 0.56; 95% CI, 0.42-0.76; <jats:italic>P</jats:italic> &amp;lt; .001) and overall survival (hazard ratio, 0.53; 95% CI, 0.39-0.73; <jats:italic>P</jats:italic> &amp;lt; .001). The tuned deep learning model achieved a higher AUC than TMB, TILs, and PD-L1 in the internal set; in the validation cohort, it was superior to TILs and comparable with PD-L1 (AUC, 0.67; 95% CI, 0.60-0.74), with a 10-percentage point improvement in specificity. In the validation cohort, combining the deep learning model with PD-L1 scores achieved an AUC of 0.70 (95% CI, 0.63-0.76), outperforming either marker alone, with a response rate of 51% compared to 41% for PD-L1 (≥50%) alone.Conclusions and RelevanceThe findings of this cohort study demonstrate a strong and independent deep learning−based feature associated with ICI response in patients with NSCLC across various cohorts. Clinical use of this deep learning model could refine treatment precision and better identify patients who are likely to benefit from ICI for treatment of advanced NSCLC.","PeriodicalId":14850,"journal":{"name":"JAMA Oncology","volume":"304 1","pages":""},"PeriodicalIF":22.5000,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Learning Model for Predicting Immunotherapy Response in Advanced Non−Small Cell Lung Cancer\",\"authors\":\"Mehrdad Rakaee, Masoud Tafavvoghi, Biagio Ricciuti, Joao V. Alessi, Alessio Cortellini, Fabrizio Citarella, Lorenzo Nibid, Giuseppe Perrone, Elio Adib, Claudia A. M. Fulgenzi, Cassio Murilo Hidalgo Filho, Alessandro Di Federico, Falah Jabar, Sayed Hashemi, Ilias Houda, Elin Richardsen, Lill-Tove Rasmussen Busund, Tom Donnem, Idris Bahce, David J. Pinato, Åslaug Helland, Lynette M. Sholl, Mark M. Awad, David J. Kwiatkowski\",\"doi\":\"10.1001/jamaoncol.2024.5356\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ImportanceOnly a small fraction of patients with advanced non−small cell lung cancer (NSCLC) respond to immune checkpoint inhibitor (ICI) treatment. For optimal personalized NSCLC care, it is imperative to identify patients who are most likely to benefit from immunotherapy.ObjectiveTo develop a supervised deep learning−based ICI response prediction method; evaluate its performance alongside other known predictive biomarkers; and assess its association with clinical outcomes in patients with advanced NSCLC.Design, Setting, and ParticipantsThis multicenter cohort study developed and independently validated a deep learning−based response stratification model for predicting ICI treatment outcome in patients with advanced NSCLC from whole slide hematoxylin and eosin–stained images. Images for model development and validation were obtained from 1 participating center in the US and 3 in the European Union (EU) from August 2014 to December 2022. Data analyses were performed from September 2022 to May 2024.ExposureMonotherapy with ICIs.Main Outcomes and MeasuresModel performance measured by clinical end points and objective response rate (ORR) differentiation power vs other predictive biomarkers, ie, programmed death-ligand 1 (PD-L1), tumor mutational burden (TMB), and tumor-infiltrating lymphocytes (TILs).ResultsA total of 295 581 image tiles from 958 patients (mean [SD] age, 66.0 [10.6] years; 456 [48%] females and 502 [52%] males) treated with ICI for NSCLC were included in the analysis. The US-based development cohort consisted of 614 patients with median (IQR) follow-up time of 54.5 (38.2-68.1) months, and the EU-based validation cohort, 344 patients with 43.3 (27.4-53.9) months of follow-up. The ORR to ICI was 26% in the developmental cohort and 28% in the validation cohort. The deep learning model’s area under the receiver operating characteristic curve (AUC) for ORR was 0.75 (95% CI, 0.64-0.85) in the internal test set and 0.66 (95% CI, 0.60-0.72) in the validation cohort. In a multivariable analysis, the deep learning model’s score was an independent predictor of ICI response in the validation cohort for both progression-free (hazard ratio, 0.56; 95% CI, 0.42-0.76; <jats:italic>P</jats:italic> &amp;lt; .001) and overall survival (hazard ratio, 0.53; 95% CI, 0.39-0.73; <jats:italic>P</jats:italic> &amp;lt; .001). The tuned deep learning model achieved a higher AUC than TMB, TILs, and PD-L1 in the internal set; in the validation cohort, it was superior to TILs and comparable with PD-L1 (AUC, 0.67; 95% CI, 0.60-0.74), with a 10-percentage point improvement in specificity. In the validation cohort, combining the deep learning model with PD-L1 scores achieved an AUC of 0.70 (95% CI, 0.63-0.76), outperforming either marker alone, with a response rate of 51% compared to 41% for PD-L1 (≥50%) alone.Conclusions and RelevanceThe findings of this cohort study demonstrate a strong and independent deep learning−based feature associated with ICI response in patients with NSCLC across various cohorts. Clinical use of this deep learning model could refine treatment precision and better identify patients who are likely to benefit from ICI for treatment of advanced NSCLC.\",\"PeriodicalId\":14850,\"journal\":{\"name\":\"JAMA Oncology\",\"volume\":\"304 1\",\"pages\":\"\"},\"PeriodicalIF\":22.5000,\"publicationDate\":\"2024-12-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JAMA Oncology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1001/jamaoncol.2024.5356\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ONCOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JAMA Oncology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1001/jamaoncol.2024.5356","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ONCOLOGY","Score":null,"Total":0}
Deep Learning Model for Predicting Immunotherapy Response in Advanced Non−Small Cell Lung Cancer
ImportanceOnly a small fraction of patients with advanced non−small cell lung cancer (NSCLC) respond to immune checkpoint inhibitor (ICI) treatment. For optimal personalized NSCLC care, it is imperative to identify patients who are most likely to benefit from immunotherapy.ObjectiveTo develop a supervised deep learning−based ICI response prediction method; evaluate its performance alongside other known predictive biomarkers; and assess its association with clinical outcomes in patients with advanced NSCLC.Design, Setting, and ParticipantsThis multicenter cohort study developed and independently validated a deep learning−based response stratification model for predicting ICI treatment outcome in patients with advanced NSCLC from whole slide hematoxylin and eosin–stained images. Images for model development and validation were obtained from 1 participating center in the US and 3 in the European Union (EU) from August 2014 to December 2022. Data analyses were performed from September 2022 to May 2024.ExposureMonotherapy with ICIs.Main Outcomes and MeasuresModel performance measured by clinical end points and objective response rate (ORR) differentiation power vs other predictive biomarkers, ie, programmed death-ligand 1 (PD-L1), tumor mutational burden (TMB), and tumor-infiltrating lymphocytes (TILs).ResultsA total of 295 581 image tiles from 958 patients (mean [SD] age, 66.0 [10.6] years; 456 [48%] females and 502 [52%] males) treated with ICI for NSCLC were included in the analysis. The US-based development cohort consisted of 614 patients with median (IQR) follow-up time of 54.5 (38.2-68.1) months, and the EU-based validation cohort, 344 patients with 43.3 (27.4-53.9) months of follow-up. The ORR to ICI was 26% in the developmental cohort and 28% in the validation cohort. The deep learning model’s area under the receiver operating characteristic curve (AUC) for ORR was 0.75 (95% CI, 0.64-0.85) in the internal test set and 0.66 (95% CI, 0.60-0.72) in the validation cohort. In a multivariable analysis, the deep learning model’s score was an independent predictor of ICI response in the validation cohort for both progression-free (hazard ratio, 0.56; 95% CI, 0.42-0.76; P &lt; .001) and overall survival (hazard ratio, 0.53; 95% CI, 0.39-0.73; P &lt; .001). The tuned deep learning model achieved a higher AUC than TMB, TILs, and PD-L1 in the internal set; in the validation cohort, it was superior to TILs and comparable with PD-L1 (AUC, 0.67; 95% CI, 0.60-0.74), with a 10-percentage point improvement in specificity. In the validation cohort, combining the deep learning model with PD-L1 scores achieved an AUC of 0.70 (95% CI, 0.63-0.76), outperforming either marker alone, with a response rate of 51% compared to 41% for PD-L1 (≥50%) alone.Conclusions and RelevanceThe findings of this cohort study demonstrate a strong and independent deep learning−based feature associated with ICI response in patients with NSCLC across various cohorts. Clinical use of this deep learning model could refine treatment precision and better identify patients who are likely to benefit from ICI for treatment of advanced NSCLC.
期刊介绍:
JAMA Oncology is an international peer-reviewed journal that serves as the leading publication for scientists, clinicians, and trainees working in the field of oncology. It is part of the JAMA Network, a collection of peer-reviewed medical and specialty publications.