The receiver operating characteristic (ROC) curve stands as a cornerstone in assessing the efficacy of biomarkers for disease diagnosis. Beyond merely evaluating performance, it provides with an optimal cutoff for biomarker values, crucial for disease categorization. While diverse methodologies exist for cutoff estimation, less attention has been paid to integrating covariate impact into this process. Covariates can strongly impact diagnostic summaries, leading to variations across different covariate levels. Therefore, a tailored covariate-based framework is imperative for outlining covariate-specific optimal cutoffs. Moreover, recent investigations into cutoff estimators have overlooked the influence of ROC curve estimation methodologies. This study endeavors to bridge this gap by addressing the research void. Extensive simulation studies are conducted to scrutinize the performance of ROC curve estimation models in estimating different cutoffs in varying scenarios, encompassing diverse data-generating mechanisms and covariate effects. In addition, leveraging the Alzheimer's Disease Neuroimaging Initiative (ADNI) data set, the research assesses the performance of different biomarkers in diagnosing Alzheimer's disease and determines the suitable optimal cutoffs.
{"title":"Impact of Methodological Assumptions and Covariates on the Cutoff Estimation in ROC Analysis","authors":"Soutik Ghosal","doi":"10.1002/bimj.70053","DOIUrl":"https://doi.org/10.1002/bimj.70053","url":null,"abstract":"<p>The receiver operating characteristic (ROC) curve stands as a cornerstone in assessing the efficacy of biomarkers for disease diagnosis. Beyond merely evaluating performance, it provides with an optimal cutoff for biomarker values, crucial for disease categorization. While diverse methodologies exist for cutoff estimation, less attention has been paid to integrating covariate impact into this process. Covariates can strongly impact diagnostic summaries, leading to variations across different covariate levels. Therefore, a tailored covariate-based framework is imperative for outlining covariate-specific optimal cutoffs. Moreover, recent investigations into cutoff estimators have overlooked the influence of ROC curve estimation methodologies. This study endeavors to bridge this gap by addressing the research void. Extensive simulation studies are conducted to scrutinize the performance of ROC curve estimation models in estimating different cutoffs in varying scenarios, encompassing diverse data-generating mechanisms and covariate effects. In addition, leveraging the Alzheimer's Disease Neuroimaging Initiative (ADNI) data set, the research assesses the performance of different biomarkers in diagnosing Alzheimer's disease and determines the suitable optimal cutoffs.</p>","PeriodicalId":55360,"journal":{"name":"Biometrical Journal","volume":"67 3","pages":""},"PeriodicalIF":1.3,"publicationDate":"2025-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/bimj.70053","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143879963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Restricted mean survival time (RMST) is gaining attention as a measure to quantify the treatment effect on survival outcomes in randomized clinical trials. Several methods to determine sample size based on the RMST-based tests have been proposed. However, to the best of our knowledge, there is no discussion about the power and sample size regarding the augmented version of RMST-based tests, which utilize baseline covariates for a gain in estimation efficiency and in power for testing no treatment effect. The conventional event-driven study design based on the logrank test allows us to calculate the power for a given hazard ratio without specifying the survival functions. In contrast, the existing sample size determination methods for the RMST-based tests relies on the adequacy of the assumptions of the entire survival curves of two groups. Furthermore, to handle the augmented test, the correlation between the baseline covariates and the martingale residuals must be handled. To address these issues, we propose an approximated sample size formula for the augmented version of the RMST-based test, which does not require specifying the entire survival curve in the treatment group, and also a sample size recalculation approach to update the correlations between the baseline covariates and the martingale residuals with the blinded data. The proposed procedure will enable the studies to have the target power for a given RMST difference even when correct survival functions cannot be specified at the design stage.
{"title":"On Sample Size Determination for Augmented Tests Based on Restricted Mean Survival Time in Randomized Clinical Trials","authors":"Satoshi Hattori, Hajime Uno","doi":"10.1002/bimj.70046","DOIUrl":"https://doi.org/10.1002/bimj.70046","url":null,"abstract":"<p>Restricted mean survival time (RMST) is gaining attention as a measure to quantify the treatment effect on survival outcomes in randomized clinical trials. Several methods to determine sample size based on the RMST-based tests have been proposed. However, to the best of our knowledge, there is no discussion about the power and sample size regarding the augmented version of RMST-based tests, which utilize baseline covariates for a gain in estimation efficiency and in power for testing no treatment effect. The conventional event-driven study design based on the logrank test allows us to calculate the power for a given hazard ratio without specifying the survival functions. In contrast, the existing sample size determination methods for the RMST-based tests relies on the adequacy of the assumptions of the entire survival curves of two groups. Furthermore, to handle the augmented test, the correlation between the baseline covariates and the martingale residuals must be handled. To address these issues, we propose an approximated sample size formula for the augmented version of the RMST-based test, which does not require specifying the entire survival curve in the treatment group, and also a sample size recalculation approach to update the correlations between the baseline covariates and the martingale residuals with the blinded data. The proposed procedure will enable the studies to have the target power for a given RMST difference even when correct survival functions cannot be specified at the design stage.</p>","PeriodicalId":55360,"journal":{"name":"Biometrical Journal","volume":"67 2","pages":""},"PeriodicalIF":1.3,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/bimj.70046","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143689854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Werner Brannath, Thorsten Dickhaus, Ruth Heller, Jesse Hemerik
This special collection on Multiple Comparisons arose from the 12th International Conference on Multiple Comparison Procedures (MCP 2022) that took place from August 30 to September 2, 2022, at the University of Bremen, Germany. The conference was hosted locally by Professors Werner Brannath and Thorsten Dickhaus. MCP 2022 continued the tradition of this conference series. The contributions to the conference covered the latest methodological and applied developments in the areas of simultaneous and selective inference, including testing, confidence intervals, estimation, adaptive designs, statistical modelling, and machine learning approaches, under a variety of error rates to be controlled.
This article collection contains theoretical papers on multiple comparisons by Budig et al. (2024), Chen et al. (2024), Pöhlmann et al. (2024), and by Ochieng et al. (2024). Several sessions of MCP 2022 included contributions dealing with online control of the family-wise error rate or the false discovery rate, respectively. The papers by Fischer et al. (2024) and by Fisher (2024) in this special collection reflect this current research direction. Bounding the number or the proportion, respectively, of false discoveries is considered in the papers by Xu et al. (2024) and by Zheng et al. (2024). Statistical methods for planning and evaluating studies with adaptive or group-sequential designs are developed in the papers by Danzer et al. (2024) and by Zhao et al. (2025), and platform trials are studied by Greenstreet et al. (2025).
After the long time without face-to-face meetings because of the COVID-19 pandemic, the conference delegates (Figure 1) enjoyed the social program of MCP 2022, which included an evening reception in Bremen's historic Town Hall as well as a boat trip to Bremerhaven.
{"title":"Editorial for the Special Collection “MCP 2022”","authors":"Werner Brannath, Thorsten Dickhaus, Ruth Heller, Jesse Hemerik","doi":"10.1002/bimj.70047","DOIUrl":"https://doi.org/10.1002/bimj.70047","url":null,"abstract":"<p>This special collection on Multiple Comparisons arose from the 12th International Conference on Multiple Comparison Procedures (MCP 2022) that took place from August 30 to September 2, 2022, at the University of Bremen, Germany. The conference was hosted locally by Professors Werner Brannath and Thorsten Dickhaus. MCP 2022 continued the tradition of this conference series. The contributions to the conference covered the latest methodological and applied developments in the areas of simultaneous and selective inference, including testing, confidence intervals, estimation, adaptive designs, statistical modelling, and machine learning approaches, under a variety of error rates to be controlled.</p><p>This article collection contains theoretical papers on multiple comparisons by Budig et al. (<span>2024</span>), Chen et al. (<span>2024</span>), Pöhlmann et al. (<span>2024</span>), and by Ochieng et al. (<span>2024</span>). Several sessions of MCP 2022 included contributions dealing with online control of the family-wise error rate or the false discovery rate, respectively. The papers by Fischer et al. (<span>2024</span>) and by Fisher (<span>2024</span>) in this special collection reflect this current research direction. Bounding the number or the proportion, respectively, of false discoveries is considered in the papers by Xu et al. (<span>2024</span>) and by Zheng et al. (<span>2024</span>). Statistical methods for planning and evaluating studies with adaptive or group-sequential designs are developed in the papers by Danzer et al. (<span>2024</span>) and by Zhao et al. (<span>2025</span>), and platform trials are studied by Greenstreet et al. (<span>2025</span>).</p><p>After the long time without face-to-face meetings because of the COVID-19 pandemic, the conference delegates (Figure 1) enjoyed the social program of MCP 2022, which included an evening reception in Bremen's historic Town Hall as well as a boat trip to Bremerhaven.</p>","PeriodicalId":55360,"journal":{"name":"Biometrical Journal","volume":"67 2","pages":""},"PeriodicalIF":1.3,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/bimj.70047","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143689720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}