Jeremy Graber, Brian J Loyd, Thomas J Hoogeboom, Caitlin J Miller, Andrew J Kittelson
{"title":"Optimizing the Accuracy and Precision of the Minimal Detectable Change Statistic: Secondary Analysis of Test-Retest Data from the NIH Toolbox Study.","authors":"Jeremy Graber, Brian J Loyd, Thomas J Hoogeboom, Caitlin J Miller, Andrew J Kittelson","doi":"10.1093/ptj/pzae170","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>The minimal detectable change (MDC) statistic is often used by clinicians to monitor change in patients. However, the way in which the MDC is traditionally calculated might be suboptimal in terms of accuracy and precision, potentially resulting in erroneous clinical decisions. This study compared the performance of the MDC statistic as traditionally calculated to that of 2 regression-based alternatives.</p><p><strong>Methods: </strong>This analysis used test-retest data from adults who participated in usual walking speed (n = 169) or grip strength (n = 178) assessments as part of the NIH Toolbox Study. Three approaches for MDC calculation were compared: the traditional approach (MDCTrad), simple linear regression (MDCSLR), and generalized additive models for location, scale, and shape (MDCGAMLSS). These approaches were compared in terms of accuracy and precision across all levels of measurement and separately for initial test values above and below the median.</p><p><strong>Results: </strong>Each of the 3 approaches accurately modeled detectable change thresholds when performance was averaged across all test values. However, MDCTrad demonstrated inaccuracies when performance was considered separately for initial test values below or above the median. For walking speed, average precision improved by 12% with MDCSLR and 16% with MDCGAMLSS, compared to MDCTrad. For grip strength, average precision improved by 3% with MDCSLR and 21% with MDCGAMLSS, compared to MDCTrad.</p><p><strong>Conclusion: </strong>MDCSLR and MDCGAMLSS appeared to more accurately and precisely model detectable change thresholds, compared to MDCTRAD. In general, MDCGAMLSS demonstrated the best overall performance in this within-sample analysis.</p><p><strong>Impact: </strong>Improved precision and accuracy in detectable change thresholds for walking speed or grip strength might facilitate clinicians' ability to promptly detect a decline in function and intervene and to confidently detect improvements in function over time.</p>","PeriodicalId":20093,"journal":{"name":"Physical Therapy","volume":" ","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physical Therapy","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1093/ptj/pzae170","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: The minimal detectable change (MDC) statistic is often used by clinicians to monitor change in patients. However, the way in which the MDC is traditionally calculated might be suboptimal in terms of accuracy and precision, potentially resulting in erroneous clinical decisions. This study compared the performance of the MDC statistic as traditionally calculated to that of 2 regression-based alternatives.
Methods: This analysis used test-retest data from adults who participated in usual walking speed (n = 169) or grip strength (n = 178) assessments as part of the NIH Toolbox Study. Three approaches for MDC calculation were compared: the traditional approach (MDCTrad), simple linear regression (MDCSLR), and generalized additive models for location, scale, and shape (MDCGAMLSS). These approaches were compared in terms of accuracy and precision across all levels of measurement and separately for initial test values above and below the median.
Results: Each of the 3 approaches accurately modeled detectable change thresholds when performance was averaged across all test values. However, MDCTrad demonstrated inaccuracies when performance was considered separately for initial test values below or above the median. For walking speed, average precision improved by 12% with MDCSLR and 16% with MDCGAMLSS, compared to MDCTrad. For grip strength, average precision improved by 3% with MDCSLR and 21% with MDCGAMLSS, compared to MDCTrad.
Conclusion: MDCSLR and MDCGAMLSS appeared to more accurately and precisely model detectable change thresholds, compared to MDCTRAD. In general, MDCGAMLSS demonstrated the best overall performance in this within-sample analysis.
Impact: Improved precision and accuracy in detectable change thresholds for walking speed or grip strength might facilitate clinicians' ability to promptly detect a decline in function and intervene and to confidently detect improvements in function over time.
期刊介绍：
Physical Therapy (PTJ) engages and inspires an international readership on topics related to physical therapy. As the leading international journal for research in physical therapy and related fields, PTJ publishes innovative and highly relevant content for both clinicians and scientists and uses a variety of interactive approaches to communicate that content, with the expressed purpose of improving patient care. PTJ"s circulation in 2008 is more than 72,000. Its 2007 impact factor was 2.152. The mean time from submission to first decision is 58 days. Time from acceptance to publication online is less than or equal to 3 months and from acceptance to publication in print is less than or equal to 5 months.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
