Predicting effects of a digital stress intervention for patients with depressive symptoms: Development and validation of meta-analytic prognostic models using individual participant data.
Mathias Harrer, Harald Baumeister, Pim Cuijpers, Elena Heber, Dirk Lehr, Ronald C Kessler, David Daniel Ebert
{"title":"Predicting effects of a digital stress intervention for patients with depressive symptoms: Development and validation of meta-analytic prognostic models using individual participant data.","authors":"Mathias Harrer, Harald Baumeister, Pim Cuijpers, Elena Heber, Dirk Lehr, Ronald C Kessler, David Daniel Ebert","doi":"10.1037/ccp0000852","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Digital stress interventions could be helpful as an \"indirect\" treatment for depression, but it remains unclear for whom this is a viable option. In this study, we developed models predicting individualized benefits of a digital stress intervention on depressive symptoms at 6-month follow-up.</p><p><strong>Method: </strong>Data of <i>N</i> = 1,525 patients with depressive symptoms (Center for Epidemiological Studies' Depression Scale, CES-D ≥ 16) from <i>k</i> = 6 randomized trials (digital stress intervention vs. waitlist) were collected. Prognostic models were developed using multilevel least absolute shrinkage and selection operator and boosting algorithms, and were validated using bootstrap bias correction and internal-external cross-validation. Subsequently, expected effects among those with and without a treatment recommendation were estimated based on clinically derived treatment assignment cut points.</p><p><strong>Results: </strong>Performances ranged from <i>R</i>² = 21.0%-23.4%, decreasing only slightly after model optimism correction (<i>R</i>² = 17.0%-19.6%). Predictions were greatly improved by including an interim assessment of depressive symptoms (optimism-corrected R2 = 32.6%-35.6%). Using a minimally important difference of <i>d</i> = -0.24 as assignment cut point, approximately 84.6%-93.3% of patients are helped by this type of intervention, while the remaining 6.7%-15.4% would experience clinically negligible benefits (δ^ = -0.02 to -0.19). Using reliable change as cut point, a smaller subset (39.3%-46.2%) with substantial expected benefits (δ^ = -0.68) receives a treatment recommendation.</p><p><strong>Conclusions: </strong>Meta-analytic prognostic models applied to individual participant data can be used to predict differential benefits of a digital stress intervention as an indirect treatment for depression. While most patients seem to benefit, the developed models could be helpful as a screening tool to identify those for whom a more intensive depression treatment is needed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":15447,"journal":{"name":"Journal of consulting and clinical psychology","volume":null,"pages":null},"PeriodicalIF":4.5000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of consulting and clinical psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/ccp0000852","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/12/21 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PSYCHOLOGY, CLINICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Digital stress interventions could be helpful as an "indirect" treatment for depression, but it remains unclear for whom this is a viable option. In this study, we developed models predicting individualized benefits of a digital stress intervention on depressive symptoms at 6-month follow-up.
Method: Data of N = 1,525 patients with depressive symptoms (Center for Epidemiological Studies' Depression Scale, CES-D ≥ 16) from k = 6 randomized trials (digital stress intervention vs. waitlist) were collected. Prognostic models were developed using multilevel least absolute shrinkage and selection operator and boosting algorithms, and were validated using bootstrap bias correction and internal-external cross-validation. Subsequently, expected effects among those with and without a treatment recommendation were estimated based on clinically derived treatment assignment cut points.
Results: Performances ranged from R² = 21.0%-23.4%, decreasing only slightly after model optimism correction (R² = 17.0%-19.6%). Predictions were greatly improved by including an interim assessment of depressive symptoms (optimism-corrected R2 = 32.6%-35.6%). Using a minimally important difference of d = -0.24 as assignment cut point, approximately 84.6%-93.3% of patients are helped by this type of intervention, while the remaining 6.7%-15.4% would experience clinically negligible benefits (δ^ = -0.02 to -0.19). Using reliable change as cut point, a smaller subset (39.3%-46.2%) with substantial expected benefits (δ^ = -0.68) receives a treatment recommendation.
Conclusions: Meta-analytic prognostic models applied to individual participant data can be used to predict differential benefits of a digital stress intervention as an indirect treatment for depression. While most patients seem to benefit, the developed models could be helpful as a screening tool to identify those for whom a more intensive depression treatment is needed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
期刊介绍:
The Journal of Consulting and Clinical Psychology® (JCCP) publishes original contributions on the following topics: the development, validity, and use of techniques of diagnosis and treatment of disordered behaviorstudies of a variety of populations that have clinical interest, including but not limited to medical patients, ethnic minorities, persons with serious mental illness, and community samplesstudies that have a cross-cultural or demographic focus and are of interest for treating behavior disordersstudies of personality and of its assessment and development where these have a clear bearing on problems of clinical dysfunction and treatmentstudies of gender, ethnicity, or sexual orientation that have a clear bearing on diagnosis, assessment, and treatmentstudies of psychosocial aspects of health behaviors. Studies that focus on populations that fall anywhere within the lifespan are considered. JCCP welcomes submissions on treatment and prevention in all areas of clinical and clinical–health psychology and especially on topics that appeal to a broad clinical–scientist and practitioner audience. JCCP encourages the submission of theory–based interventions, studies that investigate mechanisms of change, and studies of the effectiveness of treatments in real-world settings. JCCP recommends that authors of clinical trials pre-register their studies with an appropriate clinical trial registry (e.g., ClinicalTrials.gov, ClinicalTrialsRegister.eu) though both registered and unregistered trials will continue to be considered at this time.