{"title":"The More, the Better? Modalities of Metastatic Status Extraction on Free Medical Reports Based on Natural Language Processing.","authors":"Emmanuelle Kempf, Sonia Priou, Ariel Cohen, Akram Redjdal, Etienne Guével, Xavier Tannier","doi":"10.1200/CCI.24.00026","DOIUrl":"https://doi.org/10.1200/CCI.24.00026","url":null,"abstract":"","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400026"},"PeriodicalIF":3.3,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142074533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xabier García-Albéniz, John Hsu, Ruth Etzioni, June M Chan, Joy Shi, Barbra Dickerman, Miguel A Hernán
Purpose: No consensus about the effectiveness of prostate-specific antigen (PSA) screening exists among clinical guidelines, especially for the elderly. Randomized trials of PSA screening have yielded different results, partly because of variations in adherence, and it is unlikely that new trials will be conducted. Our objective was to estimate the effect of annual PSA screening on prostate cancer (PC) mortality in Medicare beneficiaries age 67-84 years.
Methods: This is a large-scale, population-based, observational study of two screening strategies: annual PSA screening and no screening. We used data from 537,599 US Medicare (2001-2008) beneficiaries age 67-84 years who had a good life expectancy, no previous PC, and no PSA test in the 2 years before baseline. We estimated the 8-year PC mortality and incidence, treatments for PC, and treatment complications of PSA screening.
Results: In men age 67-74 years, the estimated difference in 8-year risk of PC death between PSA screening and no screening was -2.3 (95% CI, -4.1 to -1.1) deaths per 1,000 men (a negative risk difference favors screening). Treatment complications were more frequent under PSA screening than under no screening. In men age 75-84 years, risk difference estimates were closer to zero.
Conclusion: Our estimates suggest that under conventional statistical criteria, annual PSA screening for 8 years is highly compatible with reductions of PC mortality from four to one fewer PC deaths per 1,000 screened men age 67-74 years. As with any study using real-world data, the estimates could be affected by residual confounding.
{"title":"Prostate-Specific Antigen Screening and Prostate Cancer Mortality: An Emulation of Target Trials in US Medicare.","authors":"Xabier García-Albéniz, John Hsu, Ruth Etzioni, June M Chan, Joy Shi, Barbra Dickerman, Miguel A Hernán","doi":"10.1200/CCI.24.00094","DOIUrl":"10.1200/CCI.24.00094","url":null,"abstract":"<p><strong>Purpose: </strong>No consensus about the effectiveness of prostate-specific antigen (PSA) screening exists among clinical guidelines, especially for the elderly. Randomized trials of PSA screening have yielded different results, partly because of variations in adherence, and it is unlikely that new trials will be conducted. Our objective was to estimate the effect of annual PSA screening on prostate cancer (PC) mortality in Medicare beneficiaries age 67-84 years.</p><p><strong>Methods: </strong>This is a large-scale, population-based, observational study of two screening strategies: annual PSA screening and no screening. We used data from 537,599 US Medicare (2001-2008) beneficiaries age 67-84 years who had a good life expectancy, no previous PC, and no PSA test in the 2 years before baseline. We estimated the 8-year PC mortality and incidence, treatments for PC, and treatment complications of PSA screening.</p><p><strong>Results: </strong>In men age 67-74 years, the estimated difference in 8-year risk of PC death between PSA screening and no screening was -2.3 (95% CI, -4.1 to -1.1) deaths per 1,000 men (a negative risk difference favors screening). Treatment complications were more frequent under PSA screening than under no screening. In men age 75-84 years, risk difference estimates were closer to zero.</p><p><strong>Conclusion: </strong>Our estimates suggest that under conventional statistical criteria, annual PSA screening for 8 years is highly compatible with reductions of PC mortality from four to one fewer PC deaths per 1,000 screened men age 67-74 years. As with any study using real-world data, the estimates could be affected by residual confounding.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400094"},"PeriodicalIF":3.3,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579517/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142005809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Timothy J Brown, Phyllis A Gimotty, Ronac Mamtani, Thomas B Karasic, Yu-Xiao Yang
Purpose: Systemic therapy with atezolizumab and bevacizumab can extend life for patients with advanced hepatocellular carcinoma (HCC). However, there is substantial variability in response to therapy and overall survival. Although current prognostic models have been validated in HCC, they primarily consider covariates that may be reflective of the severity of the underlying liver disease of patients with HCC. We developed and internally validated a classification and regression tree (CART) to identify patient characteristics associated with risks of early mortality, at or before 6 months from treatment initiation.
Methods: This retrospective cohort study used the nationwide Flatiron Health electronic health record-derived deidentified database and included patients with a diagnosis of HCC after January 1, 2020, who received initial systemic therapy with atezolizumab and bevacizumab. CART was developed from available baseline clinical and demographic information to predict mortality within 6 months from treatment initiation. Model characteristics were compared to the albumin-bilirubin (ALBI) model and was further validated against a contemporary validation cohort of patients after a data update.
Results: A total of 293 patients were analyzed. The CART identified seven cohorts of patients from baseline demographic and laboratory characteristics. The model had an area under the receiver operating curve (AUROC) of 0.739 (95% CI, 0.683 to 0.794) for predicting 6-month mortality. This model was internally valid and performed more favorably than the ALBI model, which had an AUROC of 0.608 (95% CI, 0.557 to 0.660). The model applied to the contemporary validation cohort (n = 111) had an AUROC of 0.666 (95% CI, 0.506 to 0.826).
Conclusion: Using CART, we identified unique cohorts of patients with HCC treated with atezolizumab and bevacizumab with distinct risks of early mortality. This approach outperformed the ALBI model and used clinical and laboratory characteristics that are readily available to oncologists caring for these patients.
{"title":"Classification and Regression Trees to Predict for Survival for Patients With Hepatocellular Carcinoma Treated With Atezolizumab and Bevacizumab.","authors":"Timothy J Brown, Phyllis A Gimotty, Ronac Mamtani, Thomas B Karasic, Yu-Xiao Yang","doi":"10.1200/CCI.23.00220","DOIUrl":"10.1200/CCI.23.00220","url":null,"abstract":"<p><strong>Purpose: </strong>Systemic therapy with atezolizumab and bevacizumab can extend life for patients with advanced hepatocellular carcinoma (HCC). However, there is substantial variability in response to therapy and overall survival. Although current prognostic models have been validated in HCC, they primarily consider covariates that may be reflective of the severity of the underlying liver disease of patients with HCC. We developed and internally validated a classification and regression tree (CART) to identify patient characteristics associated with risks of early mortality, at or before 6 months from treatment initiation.</p><p><strong>Methods: </strong>This retrospective cohort study used the nationwide Flatiron Health electronic health record-derived deidentified database and included patients with a diagnosis of HCC after January 1, 2020, who received initial systemic therapy with atezolizumab and bevacizumab. CART was developed from available baseline clinical and demographic information to predict mortality within 6 months from treatment initiation. Model characteristics were compared to the albumin-bilirubin (ALBI) model and was further validated against a contemporary validation cohort of patients after a data update.</p><p><strong>Results: </strong>A total of 293 patients were analyzed. The CART identified seven cohorts of patients from baseline demographic and laboratory characteristics. The model had an area under the receiver operating curve (AUROC) of 0.739 (95% CI, 0.683 to 0.794) for predicting 6-month mortality. This model was internally valid and performed more favorably than the ALBI model, which had an AUROC of 0.608 (95% CI, 0.557 to 0.660). The model applied to the contemporary validation cohort (n = 111) had an AUROC of 0.666 (95% CI, 0.506 to 0.826).</p><p><strong>Conclusion: </strong>Using CART, we identified unique cohorts of patients with HCC treated with atezolizumab and bevacizumab with distinct risks of early mortality. This approach outperformed the ALBI model and used clinical and laboratory characteristics that are readily available to oncologists caring for these patients.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300220"},"PeriodicalIF":3.3,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11296500/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141876704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ayyuce Begum Bektas, Lynn Hakki, Asama Khan, Maria Widmar, Iris H Wei, Emmanouil Pappou, J Joshua Smith, Garrett M Nash, Philip B Paty, Julio Garcia-Aguilar, Andrea Cercek, Zsofia Stadler, Neil H Segal, Jinru Shia, Mithat Gonen, Martin R Weiser
Purpose: Outcome for patients with nonmetastatic, microsatellite instability (MSI) colon cancer is favorable: however, high-risk cohorts exist. This study was aimed at developing and validating a nomogram model to predict freedom from recurrence (FFR) for patients with resected MSI colon cancer.
Patients and methods: Data from patients who underwent curative resection of stage I, II, or III MSI colon cancer in 2014-2021 (model training cohort, 384 patients, 33 events; median follow-up, 38.8 months) were retrospectively collected from institutional databases. Variables associated with recurrence in multivariable analysis were selected for inclusion in the clinical calculator. The calculator's predictive accuracy was measured with the concordance index and validated using data from patients who underwent treatment for MSI colon cancer in 2007-2013 (validation cohort, 164 patients, eight events; median follow-up, 84.8 months).
Results: T category and number of positive lymph nodes were significantly associated with recurrence in multivariable analysis and were selected for inclusion in the clinical calculator. The calculator's concordance index for FFR in the model training cohort was 0.812 (95% CI, 0.742 to 0.873), compared with 0.759 (95% CI, 0.683 to 0.840) for the staging schema of the eighth edition of the American Joint Committee on Cancer Staging Manual. The concordance index for the validation cohort was 0.744 (95% CI, 0.666 to 0.822), confirming robust predictive accuracy.
Conclusion: Although in general patients with nonmetastatic MSI colon cancer had favorable outcome, patients with advanced T category and multiple metastatic lymph nodes had higher risk of recurrence. The clinical calculator identified patients with MSI colon cancer at high risk for recurrence, and this could inform surveillance strategies. In addition, the model could be used in trial design to identify patients suitable for novel adjuvant therapy.
{"title":"Clinical Calculator for Predicting Freedom From Recurrence After Resection of Stage I-III Colon Cancer in Patients With Microsatellite Instability.","authors":"Ayyuce Begum Bektas, Lynn Hakki, Asama Khan, Maria Widmar, Iris H Wei, Emmanouil Pappou, J Joshua Smith, Garrett M Nash, Philip B Paty, Julio Garcia-Aguilar, Andrea Cercek, Zsofia Stadler, Neil H Segal, Jinru Shia, Mithat Gonen, Martin R Weiser","doi":"10.1200/CCI.23.00233","DOIUrl":"10.1200/CCI.23.00233","url":null,"abstract":"<p><strong>Purpose: </strong>Outcome for patients with nonmetastatic, microsatellite instability (MSI) colon cancer is favorable: however, high-risk cohorts exist. This study was aimed at developing and validating a nomogram model to predict freedom from recurrence (FFR) for patients with resected MSI colon cancer.</p><p><strong>Patients and methods: </strong>Data from patients who underwent curative resection of stage I, II, or III MSI colon cancer in 2014-2021 (model training cohort, 384 patients, 33 events; median follow-up, 38.8 months) were retrospectively collected from institutional databases. Variables associated with recurrence in multivariable analysis were selected for inclusion in the clinical calculator. The calculator's predictive accuracy was measured with the concordance index and validated using data from patients who underwent treatment for MSI colon cancer in 2007-2013 (validation cohort, 164 patients, eight events; median follow-up, 84.8 months).</p><p><strong>Results: </strong>T category and number of positive lymph nodes were significantly associated with recurrence in multivariable analysis and were selected for inclusion in the clinical calculator. The calculator's concordance index for FFR in the model training cohort was 0.812 (95% CI, 0.742 to 0.873), compared with 0.759 (95% CI, 0.683 to 0.840) for the staging schema of the eighth edition of the American Joint Committee on Cancer Staging Manual. The concordance index for the validation cohort was 0.744 (95% CI, 0.666 to 0.822), confirming robust predictive accuracy.</p><p><strong>Conclusion: </strong>Although in general patients with nonmetastatic MSI colon cancer had favorable outcome, patients with advanced T category and multiple metastatic lymph nodes had higher risk of recurrence. The clinical calculator identified patients with MSI colon cancer at high risk for recurrence, and this could inform surveillance strategies. In addition, the model could be used in trial design to identify patients suitable for novel adjuvant therapy.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300233"},"PeriodicalIF":3.3,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11323037/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141910173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lew Berman, Yechiam Ostchega, John Giannini, Lakshmi Priya Anandan, Emily Clark, Matthew Spotnitz, Lina Sulieman, Michael Volynski, Andrea Ramirez
Purpose: The specific aims of this paper are to (1) develop and operationalize an electronic health record (EHR) data quality framework, (2) apply the dimensions of the framework to the phenotype and treatment pathways of ductal carcinoma in situ (DCIS) using All of Us Research Program data, and (3) propose and apply a checklist to evaluate the application of the framework.
Methods: We developed a framework of five data quality dimensions (DQD; completeness, concordance, conformance, plausibility, and temporality). Participants signed a consent and Health Insurance Portability and Accountability Act authorization to share EHR data and responded to demographic questions in the Basics questionnaire. We evaluated the internal characteristics of the data and compared data with external benchmarks with descriptive and inferential statistics. We developed a DQD checklist to evaluate concept selection, internal verification, and external validity for each DQD. The Observational Medical Outcomes Partnership Common Data Model (OMOP CDM) concept ID codes for DCIS were used to select a cohort of 2,209 females 18 years and older.
Results: Using the proposed DQD checklist criteria, (1) concepts were selected and internally verified for conformance; (2) concepts were selected and internally verified for completeness; (3) concepts were selected, internally verified, and externally validated for concordance; (4) concepts were selected, internally verified, and externally validated for plausibility; and (5) concepts were selected, internally verified, and externally validated for temporality.
Conclusion: This assessment and evaluation provided insights into data quality for the DCIS phenotype using EHR data from the All of Us Research Program. The review demonstrates that salient clinical measures can be selected, applied, and operationalized within a conceptual framework and evaluated for fitness for use by applying a proposed checklist.
{"title":"Application of a Data Quality Framework to Ductal Carcinoma In Situ Using Electronic Health Record Data From the <i>All of Us</i> Research Program.","authors":"Lew Berman, Yechiam Ostchega, John Giannini, Lakshmi Priya Anandan, Emily Clark, Matthew Spotnitz, Lina Sulieman, Michael Volynski, Andrea Ramirez","doi":"10.1200/CCI.24.00052","DOIUrl":"https://doi.org/10.1200/CCI.24.00052","url":null,"abstract":"<p><strong>Purpose: </strong>The specific aims of this paper are to (1) develop and operationalize an electronic health record (EHR) data quality framework, (2) apply the dimensions of the framework to the phenotype and treatment pathways of ductal carcinoma in situ (DCIS) using <i>All of Us</i> Research Program data, and (3) propose and apply a checklist to evaluate the application of the framework.</p><p><strong>Methods: </strong>We developed a framework of five data quality dimensions (DQD; completeness, concordance, conformance, plausibility, and temporality). Participants signed a consent and Health Insurance Portability and Accountability Act authorization to share EHR data and responded to demographic questions in the Basics questionnaire. We evaluated the internal characteristics of the data and compared data with external benchmarks with descriptive and inferential statistics. We developed a DQD checklist to evaluate concept selection, internal verification, and external validity for each DQD. The Observational Medical Outcomes Partnership Common Data Model (OMOP CDM) concept ID codes for DCIS were used to select a cohort of 2,209 females 18 years and older.</p><p><strong>Results: </strong>Using the proposed DQD checklist criteria, (1) concepts were selected and internally verified for conformance; (2) concepts were selected and internally verified for completeness; (3) concepts were selected, internally verified, and externally validated for concordance; (4) concepts were selected, internally verified, and externally validated for plausibility; and (5) concepts were selected, internally verified, and externally validated for temporality.</p><p><strong>Conclusion: </strong>This assessment and evaluation provided insights into data quality for the DCIS phenotype using EHR data from the <i>All of Us</i> Research Program. The review demonstrates that salient clinical measures can be selected, applied, and operationalized within a conceptual framework and evaluated for fitness for use by applying a proposed checklist.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400052"},"PeriodicalIF":3.3,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142044174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Emergence of Digital Toxicity and the Need for an Integrated, Patient-Centric Approach to the Development, Evaluation, and Use of Digital Health Tools for Oncology.","authors":"Chris Gibbons, Carole Baas, Caroline Chung","doi":"10.1200/CCI.23.00105","DOIUrl":"10.1200/CCI.23.00105","url":null,"abstract":"","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300105"},"PeriodicalIF":3.3,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141898874","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ricardo Ahumada, Jocelyn Dunstan, Inti Paredes, Pablo Báez
{"title":"Response to Kempf et al on Methodological and Practical Aspects of a Distant Metastasis Detection Model.","authors":"Ricardo Ahumada, Jocelyn Dunstan, Inti Paredes, Pablo Báez","doi":"10.1200/CCI-24-00154","DOIUrl":"https://doi.org/10.1200/CCI-24-00154","url":null,"abstract":"","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400154"},"PeriodicalIF":3.3,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142074532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marinde J G Bond, Maarten van Smeden, Koen Degeling, Chiara Cremolini, Hans-Joachim Schmoll, Carlotta Antoniotti, Sara Lonardi, Sabina Murgioni, Daniele Rossini, Stefan Ibach, Miriam Koopman, Rutger-Jan Swijnenburg, Cornelis J A Punt, Anne M May, Johannes J M Kwakman
Purpose: Patient outcomes may differ from randomized trial averages. We aimed to predict benefit from FOLFOXIRI versus infusional fluorouracil, leucovorin, and oxaliplatin/fluorouracil, leucovorin, and irinotecan (FOLFOX/FOLFIRI), both plus bevacizumab, in patients with metastatic colorectal cancer (mCRC).
Methods: A Cox model with prespecified clinical, molecular, and laboratory variables was developed in 639 patients from the TRIBE2 trial for predicting 2-year mortality. Data from the CHARTA (n = 232), TRIBE1 (n = 504), and CAIRO5 (liver-only mCRC, n = 287) trials were used for external validation and heterogeneity of treatment effects (HTE) analysis. This involves categorizing patients into risk groups and assessing treatment effects across these groups. Performance was assessed by the C-index and calibration plots. The C-for-benefit was calculated to assess evidence for HTE. The c-for-benefit is specifically designed for HTE analysis. Like the commonly known c-statistic, it summarizes the discrimination of a model. Values over 0.5 indicate evidence for HTE.
Results: In TRIBE2, the overoptimism-corrected C-index was 0.66 (95% CI, 0.63 to 0.69). At external validation, the C-index was 0.69 (95% CI, 0.64 to 0.75), 0.68 (95% CI, 0.64 to 0.72), and 0.65 (95% CI, 0.65 to 0.66), in CHARTA, TRIBE1, and CAIRO5, respectively. Calibration plots indicated slight underestimation of mortality. The c-for-benefit indicated evidence for HTE in CHARTA (0.56, 95% CI, 0.48 to 0.65), but not in TRIBE1 (0.49, 95% CI, 0.44 to 0.55) and CAIRO5 (0.40, 95% CI, 0.32 to 0.48).
Conclusion: Although 2-year mortality could be reasonably estimated, the HTE analysis showed that clinically available variables did not reliably identify which patients with mCRC benefit from FOLFOXIRI versus FOLFOX/FOLFIRI, both plus bevacizumab, across the three studies.
{"title":"Predicting Benefit From FOLFOXIRI Plus Bevacizumab in Patients With Metastatic Colorectal Cancer.","authors":"Marinde J G Bond, Maarten van Smeden, Koen Degeling, Chiara Cremolini, Hans-Joachim Schmoll, Carlotta Antoniotti, Sara Lonardi, Sabina Murgioni, Daniele Rossini, Stefan Ibach, Miriam Koopman, Rutger-Jan Swijnenburg, Cornelis J A Punt, Anne M May, Johannes J M Kwakman","doi":"10.1200/CCI.24.00037","DOIUrl":"https://doi.org/10.1200/CCI.24.00037","url":null,"abstract":"<p><strong>Purpose: </strong>Patient outcomes may differ from randomized trial averages. We aimed to predict benefit from FOLFOXIRI versus infusional fluorouracil, leucovorin, and oxaliplatin/fluorouracil, leucovorin, and irinotecan (FOLFOX/FOLFIRI), both plus bevacizumab, in patients with metastatic colorectal cancer (mCRC).</p><p><strong>Methods: </strong>A Cox model with prespecified clinical, molecular, and laboratory variables was developed in 639 patients from the TRIBE2 trial for predicting 2-year mortality. Data from the CHARTA (n = 232), TRIBE1 (n = 504), and CAIRO5 (liver-only mCRC, n = 287) trials were used for external validation and heterogeneity of treatment effects (HTE) analysis. This involves categorizing patients into risk groups and assessing treatment effects across these groups. Performance was assessed by the C-index and calibration plots. The C-for-benefit was calculated to assess evidence for HTE. The c-for-benefit is specifically designed for HTE analysis. Like the commonly known c-statistic, it summarizes the discrimination of a model. Values over 0.5 indicate evidence for HTE.</p><p><strong>Results: </strong>In TRIBE2, the overoptimism-corrected C-index was 0.66 (95% CI, 0.63 to 0.69). At external validation, the C-index was 0.69 (95% CI, 0.64 to 0.75), 0.68 (95% CI, 0.64 to 0.72), and 0.65 (95% CI, 0.65 to 0.66), in CHARTA, TRIBE1, and CAIRO5, respectively. Calibration plots indicated slight underestimation of mortality. The c-for-benefit indicated evidence for HTE in CHARTA (0.56, 95% CI, 0.48 to 0.65), but not in TRIBE1 (0.49, 95% CI, 0.44 to 0.55) and CAIRO5 (0.40, 95% CI, 0.32 to 0.48).</p><p><strong>Conclusion: </strong>Although 2-year mortality could be reasonably estimated, the HTE analysis showed that clinically available variables did not reliably identify which patients with mCRC benefit from FOLFOXIRI versus FOLFOX/FOLFIRI, both plus bevacizumab, across the three studies.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400037"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141635710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Amr Muhammed, Rafaat A Bakheet, Karam Kenawy, Ahmed M A Ahmed, Muhammed Abdelhamid, Walaa Gamal Soliman
Purpose: Contrast enhancement is necessary for visualizing, diagnosing, and treating brain tumors. Through this study, we aimed to examine the potential role of general adversarial neural networks in generating artificial intelligence-based enhancement of tumors using a lightweight model.
Patients and methods: A retrospective study was conducted on magnetic resonance imaging scans of patients diagnosed with brain tumors between 2020 and 2023. A generative adversarial neural network was built to generate images that would mimic the real contrast enhancement of these tumors. The performance of the neural network was evaluated quantitatively by VGG-16, ResNet, binary cross-entropy loss, mean absolute error, mean squared error, and structural similarity index measures. Regarding the qualitative evaluation, nine cases were randomly selected from the test set and were used to build a short satisfaction survey for experienced medical professionals.
Results: One hundred twenty-nine patients with 156 scans were identified from the hospital database. The data were randomly split into a training set and validation set (90%) and a test set (10%). The VGG loss function for training, validation, and test sets were 2,049.8, 2,632.6, and 4,276.9, respectively. Additionally, the structural similarity index measured 0.366, 0.356, and 0.3192, respectively. At the time of submitting the article, 23 medical professionals responded to the survey. The median overall satisfaction score was 7 of 10.
Conclusion: Our network would open the door for using lightweight models in performing artificial contrast enhancement. Further research is necessary in this field to reach the point of clinical practicality.
{"title":"Potential Role of Generative Adversarial Networks in Enhancing Brain Tumors.","authors":"Amr Muhammed, Rafaat A Bakheet, Karam Kenawy, Ahmed M A Ahmed, Muhammed Abdelhamid, Walaa Gamal Soliman","doi":"10.1200/CCI.23.00266","DOIUrl":"https://doi.org/10.1200/CCI.23.00266","url":null,"abstract":"<p><strong>Purpose: </strong>Contrast enhancement is necessary for visualizing, diagnosing, and treating brain tumors. Through this study, we aimed to examine the potential role of general adversarial neural networks in generating artificial intelligence-based enhancement of tumors using a lightweight model.</p><p><strong>Patients and methods: </strong>A retrospective study was conducted on magnetic resonance imaging scans of patients diagnosed with brain tumors between 2020 and 2023. A generative adversarial neural network was built to generate images that would mimic the real contrast enhancement of these tumors. The performance of the neural network was evaluated quantitatively by VGG-16, ResNet, binary cross-entropy loss, mean absolute error, mean squared error, and structural similarity index measures. Regarding the qualitative evaluation, nine cases were randomly selected from the test set and were used to build a short satisfaction survey for experienced medical professionals.</p><p><strong>Results: </strong>One hundred twenty-nine patients with 156 scans were identified from the hospital database. The data were randomly split into a training set and validation set (90%) and a test set (10%). The VGG loss function for training, validation, and test sets were 2,049.8, 2,632.6, and 4,276.9, respectively. Additionally, the structural similarity index measured 0.366, 0.356, and 0.3192, respectively. At the time of submitting the article, 23 medical professionals responded to the survey. The median overall satisfaction score was 7 of 10.</p><p><strong>Conclusion: </strong>Our network would open the door for using lightweight models in performing artificial contrast enhancement. Further research is necessary in this field to reach the point of clinical practicality.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2300266"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141728278","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Purpose: Denosumab is used to treat patients with bone metastasis from solid tumors, but sometimes causes severe hypocalcemia, so careful clinical management is important. This study aims to externally validate our previously developed risk prediction model for denosumab-induced hypocalcemia by using data from two facilities with different characteristics in Japan and to develop an updated model with improved performance and generalizability.
Methods: In the external validation, retrospective data of Kameda General Hospital (KGH) and Miyagi Cancer Center (MCC) between June 2013 and June 2022 were used and receiver operating characteristic (ROC)-AUC was mainly evaluated. A scoring-based updated model was developed using the same data set from a hospital-based administrative database as previously employed. Selection of variables related to prediction of hypocalcemia was based on the results of external validation.
Results: For the external validation, data from 235 KGH patients and 224 MCC patients were collected. ROC-AUC values in the original model were 0.879 and 0.774, respectively. The updated model consisting of clinical laboratory tests (calcium, albumin, and alkaline phosphatase) afforded similar ROC-AUC values in the two facilities (KGH, 0.837; MCC, 0.856).
Conclusion: We developed an updated risk prediction model for denosumab-induced hypocalcemia with small interfacility differences. Our results indicate the importance of using data from plural facilities with different characteristics in the external validation of generalized prediction models and may be generally relevant to the clinical application of risk prediction models. Our findings are expected to contribute to improved management of bone metastasis treatment.
{"title":"External Validation and Update of the Risk Prediction Model for Denosumab-Induced Hypocalcemia Developed From a Hospital-Based Administrative Database.","authors":"Keisuke Ikegami, Shungo Imai, Osamu Yasumuro, Masami Tsuchiya, Naomi Henmi, Mariko Suzuki, Katsuhisa Hayashi, Chisato Miura, Haruna Abe, Hayato Kizaki, Ryohkan Funakoshi, Yasunori Sato, Satoko Hori","doi":"10.1200/CCI.24.00078","DOIUrl":"10.1200/CCI.24.00078","url":null,"abstract":"<p><strong>Purpose: </strong>Denosumab is used to treat patients with bone metastasis from solid tumors, but sometimes causes severe hypocalcemia, so careful clinical management is important. This study aims to externally validate our previously developed risk prediction model for denosumab-induced hypocalcemia by using data from two facilities with different characteristics in Japan and to develop an updated model with improved performance and generalizability.</p><p><strong>Methods: </strong>In the external validation, retrospective data of Kameda General Hospital (KGH) and Miyagi Cancer Center (MCC) between June 2013 and June 2022 were used and receiver operating characteristic (ROC)-AUC was mainly evaluated. A scoring-based updated model was developed using the same data set from a hospital-based administrative database as previously employed. Selection of variables related to prediction of hypocalcemia was based on the results of external validation.</p><p><strong>Results: </strong>For the external validation, data from 235 KGH patients and 224 MCC patients were collected. ROC-AUC values in the original model were 0.879 and 0.774, respectively. The updated model consisting of clinical laboratory tests (calcium, albumin, and alkaline phosphatase) afforded similar ROC-AUC values in the two facilities (KGH, 0.837; MCC, 0.856).</p><p><strong>Conclusion: </strong>We developed an updated risk prediction model for denosumab-induced hypocalcemia with small interfacility differences. Our results indicate the importance of using data from plural facilities with different characteristics in the external validation of generalized prediction models and may be generally relevant to the clinical application of risk prediction models. Our findings are expected to contribute to improved management of bone metastasis treatment.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":"8 ","pages":"e2400078"},"PeriodicalIF":3.3,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11371100/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141621791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}