An examination of the criterion-related validity of varying methods of indexing clinically significant change in posttraumatic stress disorder treatment.
Natasha Benfer, Benjamin C Darnell, Luke Rusowicz-Orazem, Elliot M Fielstein, Breanna Grunthal, Keren Lehavot, Brian P Marx, Brett Litz
{"title":"An examination of the criterion-related validity of varying methods of indexing clinically significant change in posttraumatic stress disorder treatment.","authors":"Natasha Benfer, Benjamin C Darnell, Luke Rusowicz-Orazem, Elliot M Fielstein, Breanna Grunthal, Keren Lehavot, Brian P Marx, Brett Litz","doi":"10.1037/tra0001479","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Clinicians, patients, and researchers need benchmarks to index individual-level clinically significant change (CSC) to guide decision making and inferences about treatment efficacy. Yet, there is no consensus best practice for determining CSC for posttraumatic stress disorder (PTSD) treatments. We examined criterion-related validity of the most common approach-Jacobson and Truax's (J&T; 1991) procedures for indexing CSC. We generated and compared four methods of calculating the J&T indices of CSC (two sets of sample-specific inputs, putatively norm-referenced benchmarks, and a combination of sample-specific and norm-referenced criteria) with respect to their association with a criterion index of quality of life (QoL).</p><p><strong>Method: </strong>Participants were 91 women Veterans enrolled in a randomized clinical trial for PTSD who completed self-report measures on PTSD symptoms and various domains of QoL and functioning, pre- and posttreatment. For each of the four methods used to calculate CSC, the QoL composite was regressed onto the CSC categories.</p><p><strong>Results: </strong>All methods explained large variance in change in QoL. Across all methods, participants categorized as unchanged had smaller changes in QoL, compared with those who improved or had probable recovery. The norm-referenced benchmarks accounted for the relatively largest amount of variance in QoL, but categorized the fewest patients as having made CSC.</p><p><strong>Conclusions: </strong>The J&T methodology for indexing CSC in PTSD symptoms has criterion-related validity, and a norm-referenced benchmark appears to be the most potent. However, the norm-referenced parameters may be overly specific, potentially leading to an underestimate of improvement. Research is needed to test the generalizability of these results. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":20982,"journal":{"name":"Psychological trauma : theory, research, practice and policy","volume":" ","pages":"802-809"},"PeriodicalIF":2.7000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10713857/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological trauma : theory, research, practice and policy","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/tra0001479","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/6/12 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"PSYCHIATRY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Clinicians, patients, and researchers need benchmarks to index individual-level clinically significant change (CSC) to guide decision making and inferences about treatment efficacy. Yet, there is no consensus best practice for determining CSC for posttraumatic stress disorder (PTSD) treatments. We examined criterion-related validity of the most common approach-Jacobson and Truax's (J&T; 1991) procedures for indexing CSC. We generated and compared four methods of calculating the J&T indices of CSC (two sets of sample-specific inputs, putatively norm-referenced benchmarks, and a combination of sample-specific and norm-referenced criteria) with respect to their association with a criterion index of quality of life (QoL).
Method: Participants were 91 women Veterans enrolled in a randomized clinical trial for PTSD who completed self-report measures on PTSD symptoms and various domains of QoL and functioning, pre- and posttreatment. For each of the four methods used to calculate CSC, the QoL composite was regressed onto the CSC categories.
Results: All methods explained large variance in change in QoL. Across all methods, participants categorized as unchanged had smaller changes in QoL, compared with those who improved or had probable recovery. The norm-referenced benchmarks accounted for the relatively largest amount of variance in QoL, but categorized the fewest patients as having made CSC.
Conclusions: The J&T methodology for indexing CSC in PTSD symptoms has criterion-related validity, and a norm-referenced benchmark appears to be the most potent. However, the norm-referenced parameters may be overly specific, potentially leading to an underestimate of improvement. Research is needed to test the generalizability of these results. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
期刊介绍:
Psychological Trauma: Theory, Research, Practice, and Policy publishes empirical research on the psychological effects of trauma. The journal is intended to be a forum for an interdisciplinary discussion on trauma, blending science, theory, practice, and policy.
The journal publishes empirical research on a wide range of trauma-related topics, including:
-Psychological treatments and effects
-Promotion of education about effects of and treatment for trauma
-Assessment and diagnosis of trauma
-Pathophysiology of trauma reactions
-Health services (delivery of services to trauma populations)
-Epidemiological studies and risk factor studies
-Neuroimaging studies
-Trauma and cultural competence