Pub Date : 2024-04-16DOI: 10.1007/s10488-024-01375-1
Samuel Law, Aly Kassam, Michaela Beder, Saadia Sediqzadah, Matthew Levy, John Maher
Assertive Community Treatment (ACT) model is the gold standard in community psychiatry serving people with severe mental illness. With its outreach-based design, the pandemic has profoundly affected the operations and functioning of ACT. The Dartmouth ACT Scale (DACTS) provides a standardized comprehensive and quantitative way to evaluate ACT quality. Results could inform nature of impact and identify areas for improvement. Current online survey used DACTS during the pandemic in April-May 2021. Clinical and administrative leadership of the 80 ACT teams in Ontario, Canada cross-sectionally rated ACT quality one-year pre-Covid (2018-2019) and one-year post the start of Covid (2020-2021). The overall pre-Covid Ontario ACT DACTS fidelity was 3.65. The pandemic led to decreases in all domains of DACTS (Human Resources: -4.92%, p < 0.001, 95% CI [0.08-0.27]; Organizational Boundary: -1.03%, p < 0.013,95%CI [0.01-0.07]; and Nature of Services: -6.18%, p < 0.001, 95%CI [0.16-0.26]). These changes were accounted by expected lower face-to-face encounters, time spent with clients, reduction in psychosocial services, less interactions with hospitals and diminished workforces. The magnitude of change was modest (-3.84%, p < 0.001, 95%CI [0.09-0.19]). However, the Ontario ACT pre-Covid DACTS was substantially lower (-13.5%) when compared to that from a similar survey 15 years ago (4.22), suggestive of insidious systemic level loss of fidelity. Quantitative fidelity evaluation helped to ascertain specific pandemic impact. Changes were significant and specific, but overall relatively modest when compared to the larger system level drop over the last decade. There is both evidence for model adaptability and resilience during Covid disruption, and concerns over larger downward drift in ACT fidelity and quality.
{"title":"Impact of the Pandemic was Minor Compared to Systemic Decrease in Fidelity of Assertive Community Treatment Services- A Provincial Study in Ontario, Canada.","authors":"Samuel Law, Aly Kassam, Michaela Beder, Saadia Sediqzadah, Matthew Levy, John Maher","doi":"10.1007/s10488-024-01375-1","DOIUrl":"https://doi.org/10.1007/s10488-024-01375-1","url":null,"abstract":"<p><p>Assertive Community Treatment (ACT) model is the gold standard in community psychiatry serving people with severe mental illness. With its outreach-based design, the pandemic has profoundly affected the operations and functioning of ACT. The Dartmouth ACT Scale (DACTS) provides a standardized comprehensive and quantitative way to evaluate ACT quality. Results could inform nature of impact and identify areas for improvement. Current online survey used DACTS during the pandemic in April-May 2021. Clinical and administrative leadership of the 80 ACT teams in Ontario, Canada cross-sectionally rated ACT quality one-year pre-Covid (2018-2019) and one-year post the start of Covid (2020-2021). The overall pre-Covid Ontario ACT DACTS fidelity was 3.65. The pandemic led to decreases in all domains of DACTS (Human Resources: -4.92%, p < 0.001, 95% CI [0.08-0.27]; Organizational Boundary: -1.03%, p < 0.013,95%CI [0.01-0.07]; and Nature of Services: -6.18%, p < 0.001, 95%CI [0.16-0.26]). These changes were accounted by expected lower face-to-face encounters, time spent with clients, reduction in psychosocial services, less interactions with hospitals and diminished workforces. The magnitude of change was modest (-3.84%, p < 0.001, 95%CI [0.09-0.19]). However, the Ontario ACT pre-Covid DACTS was substantially lower (-13.5%) when compared to that from a similar survey 15 years ago (4.22), suggestive of insidious systemic level loss of fidelity. Quantitative fidelity evaluation helped to ascertain specific pandemic impact. Changes were significant and specific, but overall relatively modest when compared to the larger system level drop over the last decade. There is both evidence for model adaptability and resilience during Covid disruption, and concerns over larger downward drift in ACT fidelity and quality.</p>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":" ","pages":""},"PeriodicalIF":2.6,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140856270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-10DOI: 10.1007/s10488-024-01370-6
Giorgio A. Tasca
At the centre of POR is the concept of collaboration between patients, therapists, agencies, and third-party payers. For this commentary, I review the articles of the special issue with attention to both the opportunities and challenges offered by practice-oriented research (POR). I also reviewed some previous research on practice-research networks and how that research might inform POR. The use of routine outcome monitoring (ROM), artificial intelligence (AI), and program evaluation (PE) models show promise for advancing POR. However, each comes with its challenges. The use of ROM to improve patient outcomes has research support. However, researchers have identified problems with implementing ROM because of low uptake by clinicians and because clinicians may see ROM as a potential intrusion. AI shows promise to improve patient outcomes by potentially providing therapists with immediate and nuanced data to inform interventions and interpersonal stances specific to each patient. However, the scaling up of AI runs the risk of dehumanizing psychological interventions. PE may provide a context for allowing therapists to engage in POR to address real-world processes and outcomes of mental health interventions. However, like ROM PE faces the challenge of trust among clinicians and patients who may be reluctant to participate. Despite these challenges, and because of efforts to nurture and maintain respectful collaborations, articles in this special issue highlight how POR can play a pivotal role in bridging the gap between theory and practice.
以实践为导向的研究(POR)的核心是患者、治疗师、机构和第三方付款人之间的合作理念。在这篇评论中,我回顾了特刊中的文章,关注以实践为导向的研究(POR)带来的机遇和挑战。我还回顾了以前关于实践研究网络的一些研究,以及这些研究如何为 POR 提供信息。常规成果监测(ROM)、人工智能(AI)和项目评估(PE)模型的使用为推进 POR 带来了希望。然而,每种方法都面临着挑战。使用 ROM 改善患者预后得到了研究支持。然而,研究人员发现,由于临床医生对 ROM 的接受程度较低,而且临床医生可能会将 ROM 视为一种潜在的干扰,因此在实施 ROM 方面存在一些问题。人工智能有望为治疗师提供即时、细致的数据,为干预措施和针对每位患者的人际交往提供依据,从而改善患者的治疗效果。然而,扩大人工智能的规模有可能使心理干预非人性化。心理健康教育可以提供一个环境,让治疗师参与 POR,以解决现实世界中心理健康干预的过程和结果。然而,与 ROM 一样,PE 也面临着临床医生和患者之间信任的挑战,他们可能不愿意参与。尽管存在这些挑战,由于努力培养和保持相互尊重的合作关系,本特刊中的文章强调了 POR 如何在弥合理论与实践之间的差距方面发挥关键作用。
{"title":"The Promise and Challenges of Practice-Oriented Research: A Commentary on the Special Issue","authors":"Giorgio A. Tasca","doi":"10.1007/s10488-024-01370-6","DOIUrl":"10.1007/s10488-024-01370-6","url":null,"abstract":"<div><p>At the centre of POR is the concept of collaboration between patients, therapists, agencies, and third-party payers. For this commentary, I review the articles of the special issue with attention to both the opportunities and challenges offered by practice-oriented research (POR). I also reviewed some previous research on practice-research networks and how that research might inform POR. The use of routine outcome monitoring (ROM), artificial intelligence (AI), and program evaluation (PE) models show promise for advancing POR. However, each comes with its challenges. The use of ROM to improve patient outcomes has research support. However, researchers have identified problems with implementing ROM because of low uptake by clinicians and because clinicians may see ROM as a potential intrusion. AI shows promise to improve patient outcomes by potentially providing therapists with immediate and nuanced data to inform interventions and interpersonal stances specific to each patient. However, the scaling up of AI runs the risk of dehumanizing psychological interventions. PE may provide a context for allowing therapists to engage in POR to address real-world processes and outcomes of mental health interventions. However, like ROM PE faces the challenge of trust among clinicians and patients who may be reluctant to participate. Despite these challenges, and because of efforts to nurture and maintain respectful collaborations, articles in this special issue highlight how POR can play a pivotal role in bridging the gap between theory and practice.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"51 3","pages":"380 - 383"},"PeriodicalIF":2.0,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140847040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-08DOI: 10.1007/s10488-024-01374-2
Shaghayegh Azizian Kia, Lisette Wittkampf, Jacobine van Lankeren, Pauline Janse
Despite its demonstrated value, many mental health institutions struggle to implement progress feedback effectively. There is also insufficient information about how therapists utilize progress feedback. To gain more insight, two qualitative studies were conducted. The first study compared the attitudes and motives of therapists who used and those who did not use progress feedback. The second study examined how psychologists incorporated progress feedback into their practice. In total, 23 therapists were interviewed, and the data were analyzed using thematic analysis. The first study found that almost all the therapists had a positive attitude about progress feedback. Those who did not use it indicated reasons such as a heavy workload and patient-related factors, and they also lacked sufficient information about the potential benefits of progress feedback. The second study revealed four major ways in which the therapists utilized feedback, namely: supporting actions to discuss progress feedback, discussing progress feedback with patients, modifications in the ongoing treatment, and peer consultation. However, discussions during peer consultations about using progress feedback for patients who were not benefitting from treatment and how the treatment might be adjusted accordingly were often lacking. In conclusion, it is crucial that training and education be provided to therapists on how to use progress feedback effectively. Having regular discussions about progress feedback during peer consultations could also facilitate its integration into clinical practice.
{"title":"Motives of Therapists for Using Routine Outcome Monitoring (ROM) and How it is Used by Them in Clinical Practice: Two Qualitative Studies","authors":"Shaghayegh Azizian Kia, Lisette Wittkampf, Jacobine van Lankeren, Pauline Janse","doi":"10.1007/s10488-024-01374-2","DOIUrl":"10.1007/s10488-024-01374-2","url":null,"abstract":"<div><p>Despite its demonstrated value, many mental health institutions struggle to implement progress feedback effectively. There is also insufficient information about how therapists utilize progress feedback. To gain more insight, two qualitative studies were conducted. The first study compared the attitudes and motives of therapists who used and those who did not use progress feedback. The second study examined how psychologists incorporated progress feedback into their practice. In total, 23 therapists were interviewed, and the data were analyzed using thematic analysis. The first study found that almost all the therapists had a positive attitude about progress feedback. Those who did not use it indicated reasons such as a heavy workload and patient-related factors, and they also lacked sufficient information about the potential benefits of progress feedback. The second study revealed four major ways in which the therapists utilized feedback, namely: supporting actions to discuss progress feedback, discussing progress feedback with patients, modifications in the ongoing treatment, and peer consultation. However, discussions during peer consultations about using progress feedback for patients who were not benefitting from treatment and how the treatment might be adjusted accordingly were often lacking. In conclusion, it is crucial that training and education be provided to therapists on how to use progress feedback effectively. Having regular discussions about progress feedback during peer consultations could also facilitate its integration into clinical practice.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"52 1","pages":"159 - 170"},"PeriodicalIF":2.0,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s10488-024-01374-2.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140850016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-04DOI: 10.1007/s10488-024-01358-2
Jill Donelan, Susan Douglas, Ariane Willson, Tyrena Lester, Stephanie Daly
This paper describes the successful implementation of Measurement-Based Care (MBC) within a Partial Hospitalization Program (PHP) for children and adolescents. Measurement-based care (MBC), the practice of using patient-reported measures routinely to inform decision-making, is associated with improved clinical outcomes for behavioral health patients (Jong et al., Clinical Psychology Review 85, 2021; Fortney & Sladek, 2015). MBC holds great promise in partial hospital programs (PHP) to improve outcomes, yet implementation strategies are as complex as the setting itself. This paper provides a case study example of MBC implementation in a PHP for youth. Over the course of 18 months, an interdisciplinary staff of approximately 20 behavioral health professionals provided partial hospitalization level of care to 633 (39% in-person, 61% telehealth) youth from ages 5 to 18 years old. MBC in this setting incorporated daily patient self-report and weekly caregiver-reported measurements. This descriptive reconstruction, which includes examples of the data that were used during the implementation project, illustrates specific barriers and facilitators in a successful implementation in the local PHP setting. Implementation strategies to address workflow integration, leadership and supervision, and coaching are described, including evolution of these strategies over the course of implementation. Practical considerations for implementing MBC in youth PHP settings are discussed. Finally, the authors explore the potential relationships between the data-driven MBC model of decision making and the development of resilient organizations.
{"title":"Implementing Measurement-Based Care in a Youth Partial Hospital Setting: Leveraging Feedback for Sustainability","authors":"Jill Donelan, Susan Douglas, Ariane Willson, Tyrena Lester, Stephanie Daly","doi":"10.1007/s10488-024-01358-2","DOIUrl":"10.1007/s10488-024-01358-2","url":null,"abstract":"<div><p>This paper describes the successful implementation of Measurement-Based Care (MBC) within a Partial Hospitalization Program (PHP) for children and adolescents. Measurement-based care (MBC), the practice of using patient-reported measures routinely to inform decision-making, is associated with improved clinical outcomes for behavioral health patients (Jong et al., Clinical Psychology Review 85, 2021; Fortney & Sladek, 2015). MBC holds great promise in partial hospital programs (PHP) to improve outcomes, yet implementation strategies are as complex as the setting itself. This paper provides a case study example of MBC implementation in a PHP for youth. Over the course of 18 months, an interdisciplinary staff of approximately 20 behavioral health professionals provided partial hospitalization level of care to 633 (39% in-person, 61% telehealth) youth from ages 5 to 18 years old. MBC in this setting incorporated daily patient self-report and weekly caregiver-reported measurements. This descriptive reconstruction, which includes examples of the data that were used during the implementation project, illustrates specific barriers and facilitators in a successful implementation in the local PHP setting. Implementation strategies to address workflow integration, leadership and supervision, and coaching are described, including evolution of these strategies over the course of implementation. Practical considerations for implementing MBC in youth PHP settings are discussed. Finally, the authors explore the potential relationships between the data-driven MBC model of decision making and the development of resilient organizations.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"52 1","pages":"128 - 145"},"PeriodicalIF":2.0,"publicationDate":"2024-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140874423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-03DOI: 10.1007/s10488-024-01369-z
Louis G. Castonguay, Dana Atzil-Slonim, Kim de Jong, Soo Jeong Youn
Aimed at understanding and improving psychological therapies as they are conducted in clinical routine, practice-oriented research (POR) is now a well-established approach to the scientific foundations of mental health care services. Resting on the accumulation of a wide range of practice-based evidence related to treatment outcome and process, as well as factors associated with the participants of psychotherapy and its context, POR is ripe for new developments – regarding what to investigate and how to investigate it. This paper is the introduction of a series devoted to recent advances and future directions of POR as their pertained to routine outcome monitoring, technologies and artificial intelligence, the integration of constructs and methods from program evaluation and implementation science, and the investigation of populations with limited financial resources across various regions of the world. The series also includes commentaries from two leaders of POR.
以实践为导向的研究(POR)旨在了解和改进临床常规心理疗法,现已成为心理保健服务科学基础的一种成熟方法。以实践为导向的研究积累了大量与治疗结果和过程相关的实践证据,以及与心理治疗参与者及其背景相关的因素,因此在研究内容和研究方法方面,新的发展时机已经成熟。本文是 "POR "系列的引言,介绍了 "POR "的最新进展和未来方向,包括常规结果监测、技术和人工智能、项目评估和实施科学中的概念和方法的整合,以及对全球不同地区财政资源有限的人群的调查。该丛书还包括两位 POR 领袖的评论文章。
{"title":"Practice-Oriented Research: An Introduction to New Developments and Future Directions","authors":"Louis G. Castonguay, Dana Atzil-Slonim, Kim de Jong, Soo Jeong Youn","doi":"10.1007/s10488-024-01369-z","DOIUrl":"10.1007/s10488-024-01369-z","url":null,"abstract":"<div><p>Aimed at understanding and improving psychological therapies as they are conducted in clinical routine, practice-oriented research (POR) is now a well-established approach to the scientific foundations of mental health care services. Resting on the accumulation of a wide range of practice-based evidence related to treatment outcome and process, as well as factors associated with the participants of psychotherapy and its context, POR is ripe for new developments – regarding what to investigate and how to investigate it. This paper is the introduction of a series devoted to recent advances and future directions of POR as their pertained to routine outcome monitoring, technologies and artificial intelligence, the integration of constructs and methods from program evaluation and implementation science, and the investigation of populations with limited financial resources across various regions of the world. The series also includes commentaries from two leaders of POR.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"51 3","pages":"287 - 290"},"PeriodicalIF":2.0,"publicationDate":"2024-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140855540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-02DOI: 10.1007/s10488-024-01357-3
Anna Chorniy, Michelle A. Moffa, Rebecca R. Seltzer
{"title":"Expanding Access to Home-Based Behavioral Health Services for Children in Foster Care","authors":"Anna Chorniy, Michelle A. Moffa, Rebecca R. Seltzer","doi":"10.1007/s10488-024-01357-3","DOIUrl":"10.1007/s10488-024-01357-3","url":null,"abstract":"","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"51 4","pages":"525 - 528"},"PeriodicalIF":2.0,"publicationDate":"2024-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11196193/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140848364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-02DOI: 10.1007/s10488-024-01360-8
Alice E. Coyne, Michael J. Constantino, James F. Boswell, Averi N. Gaines, David R. Kraus
Based on patient-reported outcomes data analyzed at the provider level, there is evidence that psychotherapists can possess effectiveness strengths and weaknesses when treating patients with different presenting concerns. These within-therapist differences hold promise for personalizing care by prospectively matching patients to therapists’ historical effectiveness strengths. In a double-masked randomized controlled trial (RCT; NCT02990000), such matching outperformed pragmatically determined usual case assignment—which leaves personalized, measurement-based matching to chance—in naturalistic outpatient psychotherapy (Constantino et al., JAMA Psychiatry 78:960–969, 2021). Demonstrating that personalization can be even more precise, some research has demonstrated that the strength of this positive match effect was moderated by certain patient characteristics. Notably, though, it could also be that matching is especially important for some therapists to achieve more effective outcomes. Examining this novel question, the present study drew on the Constantino et al. (JAMA Psychiatry 78:960–969, 2021) trial data to explore three therapist-level moderators of matching: (a) effectiveness “spread” (i.e., greater performance variability across patients’ presenting problem domains), (b) overestimation of their measurement-based and problem-specific effectiveness, and (c) the frequency with which they use patient-reported routine outcomes monitoring in their practice. Patients were 206 adults, randomized to the match or control condition, treated by 40 therapists who were crossed over conditions. The therapist variables were assessed at the trial’s baseline and patients’ symptomatic/functional impairment and global distress were assessed regularly up to 16 weeks of treatment. Hierarchical linear models revealed that only therapist effectiveness spread significantly moderated the match effect for the global distress outcome; for therapists with more spread, the match effect was more pronounced, whereas the match effect was minimal for therapists with less effectiveness spread. Notably, two therapist-level covariates unexpectedly emerged as significant moderators for the symptomatic/functional impairment outcome; for clinicians who consistently treated patients with higher versus lower average severity levels and who relatedly treated a higher proportion of patients with primary presenting problems of substance misuse or violence, the beneficial match effect was even stronger. Thus, measurement-based matching may be especially potent for therapists with more variable effectiveness across problem domains, and who consistently treat patients with more severe presenting concerns or with particular primary problems, which provides further precision in conceptualizing personalized care.
{"title":"Therapist-Level Moderators of Patient-Therapist Match Effectiveness in Community Psychotherapy","authors":"Alice E. Coyne, Michael J. Constantino, James F. Boswell, Averi N. Gaines, David R. Kraus","doi":"10.1007/s10488-024-01360-8","DOIUrl":"10.1007/s10488-024-01360-8","url":null,"abstract":"<div><p>Based on patient-reported outcomes data analyzed at the provider level, there is evidence that psychotherapists can possess effectiveness strengths and weaknesses when treating patients with different presenting concerns. These within-therapist differences hold promise for personalizing care by prospectively matching patients to therapists’ historical effectiveness strengths. In a double-masked randomized controlled trial (RCT; NCT02990000), such matching outperformed pragmatically determined usual case assignment—which leaves personalized, measurement-based matching to chance—in naturalistic outpatient psychotherapy (Constantino et al., JAMA Psychiatry 78:960–969, 2021). Demonstrating that personalization can be even more precise, some research has demonstrated that the strength of this positive match effect was moderated by certain patient characteristics. Notably, though, it could also be that matching is especially important for some <i>therapists</i> to achieve more effective outcomes. Examining this novel question, the present study drew on the Constantino et al. (JAMA Psychiatry 78:960–969, 2021) trial data to explore three therapist-level moderators of matching: (a) effectiveness “spread” (i.e., greater performance variability across patients’ presenting problem domains), (b) overestimation of their measurement-based and problem-specific effectiveness, and (c) the frequency with which they use patient-reported routine outcomes monitoring in their practice. Patients were 206 adults, randomized to the match or control condition, treated by 40 therapists who were crossed over conditions. The therapist variables were assessed at the trial’s baseline and patients’ symptomatic/functional impairment and global distress were assessed regularly up to 16 weeks of treatment. Hierarchical linear models revealed that only therapist effectiveness spread significantly moderated the match effect for the global distress outcome; for therapists with more spread, the match effect was more pronounced, whereas the match effect was minimal for therapists with less effectiveness spread. Notably, two therapist-level covariates unexpectedly emerged as significant moderators for the symptomatic/functional impairment outcome; for clinicians who consistently treated patients with higher versus lower average severity levels and who relatedly treated a higher proportion of patients with <i>primary</i> presenting problems of substance misuse or violence, the beneficial match effect was even stronger. Thus, measurement-based matching may be especially potent for therapists with more variable effectiveness across problem domains, and who consistently treat patients with more severe presenting concerns or with particular primary problems, which provides further precision in conceptualizing personalized care.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"51 5","pages":"738 - 752"},"PeriodicalIF":2.0,"publicationDate":"2024-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11379779/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140855225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-29DOI: 10.1007/s10488-024-01356-4
Christopher Lalk, Tobias Steinbrenner, Weronika Kania, Alexander Popko, Robin Wester, Jana Schaffrath, Steffen Eberhardt, Brian Schwartz, Wolfgang Lutz, Julian Rubel
We aim to use topic modeling, an approach for discovering clusters of related words (“topics”), to predict symptom severity and therapeutic alliance in psychotherapy transcripts, while also identifying the most important topics and overarching themes for prediction. We analyzed 552 psychotherapy transcripts from 124 patients. Using BERTopic (Grootendorst, 2022), we extracted 250 topics each for patient and therapist speech. These topics were used to predict symptom severity and alliance with various competing machine-learning methods. Sensitivity analyses were calculated for a model based on 50 topics, LDA-based topic modeling, and a bigram model. Additionally, we grouped topics into themes using qualitative analysis and identified key topics and themes with eXplainable Artificial Intelligence (XAI). Symptom severity could be predicted with highest accuracy by patient topics ((r)=0.45, 95%-CI 0.40, 0.51), whereas alliance was better predicted by therapist topics ((r)=0.20, 95%-CI 0.16, 0.24). Drivers for symptom severity were themes related to health and negative experiences. Lower alliance was correlated with various themes, especially psychotherapy framework, income, and everyday life. This analysis shows the potential of using topic modeling in psychotherapy research allowing to predict several treatment-relevant metrics with reasonable accuracy. Further, the use of XAI allows for an analysis of the individual predictive value of topics and themes. Limitations entail heterogeneity across different topic modeling hyperparameters and a relatively small sample size.
{"title":"Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling","authors":"Christopher Lalk, Tobias Steinbrenner, Weronika Kania, Alexander Popko, Robin Wester, Jana Schaffrath, Steffen Eberhardt, Brian Schwartz, Wolfgang Lutz, Julian Rubel","doi":"10.1007/s10488-024-01356-4","DOIUrl":"10.1007/s10488-024-01356-4","url":null,"abstract":"<div><p>We aim to use topic modeling, an approach for discovering clusters of related words (“topics”), to predict symptom severity and therapeutic alliance in psychotherapy transcripts, while also identifying the most important topics and overarching themes for prediction. We analyzed 552 psychotherapy transcripts from 124 patients. Using BERTopic (Grootendorst, 2022), we extracted 250 topics each for patient and therapist speech. These topics were used to predict symptom severity and alliance with various competing machine-learning methods. Sensitivity analyses were calculated for a model based on 50 topics, LDA-based topic modeling, and a bigram model. Additionally, we grouped topics into themes using qualitative analysis and identified key topics and themes with eXplainable Artificial Intelligence (XAI). Symptom severity could be predicted with highest accuracy by patient topics (<span>(r)</span>=0.45, 95%-CI 0.40, 0.51), whereas alliance was better predicted by therapist topics (<span>(r)</span>=0.20, 95%-CI 0.16, 0.24). Drivers for symptom severity were themes related to health and negative experiences. Lower alliance was correlated with various themes, especially psychotherapy framework, income, and everyday life. This analysis shows the potential of using topic modeling in psychotherapy research allowing to predict several treatment-relevant metrics with reasonable accuracy. Further, the use of XAI allows for an analysis of the individual predictive value of topics and themes. Limitations entail heterogeneity across different topic modeling hyperparameters and a relatively small sample size.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"51 4","pages":"509 - 524"},"PeriodicalIF":2.0,"publicationDate":"2024-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11196307/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140326136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-26DOI: 10.1007/s10488-024-01362-6
Manuel Meglio, Rocío Tamara Manubens, Javier Fernández-Álvarez, Sofia Marasas, Fernando García, Beatríz Gómez, Julio Montedoro, Antonio Nicolás Jáuregui, Claudia Castañeiras, Pablo Santagnelo, Santiago Juan, Andrés Jorge Roussos, Juan Martín Gómez Penedo, Roberto Muiños
Ecological momentary assessment (EMA) allows measuring intra-individual processes moment by moment, identifying and modeling, in a naturalistic way, individual levels and changes in different psychological processes. However, active EMA requires a high degree of adherence, as it implies a significant burden for patients. Moreover, there is still no consensus on standardized procedures for implementation. There have been few results in detecting desirable characteristics for the design and implementation of an EMA device. Studies that address these issues from the perspectives of participants in psychotherapeutic processes are needed. To analyze the perspectives of patients, therapists and supervisors on the implementation of an EMA device in a psychotherapeutic treatment for depression. The sample will include eight patients, eleven therapists and five supervisors, taken from a research project that implemented an EMA system for monitoring the dynamics of affectivity at the beginning of psychotherapies for depression. Semi-structured interviews specific to each group are being conducted and analyzed from a qualitative approach based on consensual qualitative research (CQR). Participants reported having a positive evaluation of the study's informational resources and implementation. Difficulties were expressed in responding in the morning hours and the importance of having a customized EMA that is tailored to the needs of the patients was expressed. Furthermore, patients and therapists agreed that the impact of the use of the monitoring system on treatment was neutral or positive. In contrast, patients considered the EMA to be positive for their daily life.
生态瞬间评估(EMA)可以逐时测量个体内部过程,以自然的方式识别和模拟不同心理过程的个体水平和变化。然而,积极的 EMA 需要很高的依从性,因为这对患者来说意味着很大的负担。此外,对于实施的标准化程序仍未达成共识。在检测 EMA 设备的设计和实施的理想特性方面,成果寥寥无几。需要从心理治疗过程参与者的角度来研究这些问题。本研究旨在分析患者、治疗师和督导人员对抑郁症心理治疗过程中实施 EMA 仪器的看法。样本将包括 8 名患者、11 名治疗师和 5 名督导,他们都来自一个研究项目,该项目在抑郁症心理治疗开始时实施了 EMA 系统,用于监测情感动态。目前正在进行针对每个小组的半结构式访谈,并根据共识定性研究(CQR)的定性方法进行分析。参与者对研究的信息资源和实施情况给予了积极评价。他们表示,在上午的时间段做出回应存在困难,并认为根据患者的需求定制 EMA 非常重要。此外,患者和治疗师一致认为使用监测系统对治疗的影响是中性或积极的。相反,患者认为电子病历监测系统对他们的日常生活有积极影响。
{"title":"Implementation of an Ecological Momentary Assessment (EMA) in Naturalistic Psychotherapy Settings: Qualitative Insights from Patients, Therapists, and Supervisors Perspectives","authors":"Manuel Meglio, Rocío Tamara Manubens, Javier Fernández-Álvarez, Sofia Marasas, Fernando García, Beatríz Gómez, Julio Montedoro, Antonio Nicolás Jáuregui, Claudia Castañeiras, Pablo Santagnelo, Santiago Juan, Andrés Jorge Roussos, Juan Martín Gómez Penedo, Roberto Muiños","doi":"10.1007/s10488-024-01362-6","DOIUrl":"10.1007/s10488-024-01362-6","url":null,"abstract":"<div><p>Ecological momentary assessment (EMA) allows measuring intra-individual processes moment by moment, identifying and modeling, in a naturalistic way, individual levels and changes in different psychological processes. However, active EMA requires a high degree of adherence, as it implies a significant burden for patients. Moreover, there is still no consensus on standardized procedures for implementation. There have been few results in detecting desirable characteristics for the design and implementation of an EMA device. Studies that address these issues from the perspectives of participants in psychotherapeutic processes are needed. To analyze the perspectives of patients, therapists and supervisors on the implementation of an EMA device in a psychotherapeutic treatment for depression. The sample will include eight patients, eleven therapists and five supervisors, taken from a research project that implemented an EMA system for monitoring the dynamics of affectivity at the beginning of psychotherapies for depression. Semi-structured interviews specific to each group are being conducted and analyzed from a qualitative approach based on consensual qualitative research (CQR). Participants reported having a positive evaluation of the study's informational resources and implementation. Difficulties were expressed in responding in the morning hours and the importance of having a customized EMA that is tailored to the needs of the patients was expressed. Furthermore, patients and therapists agreed that the impact of the use of the monitoring system on treatment was neutral or positive. In contrast, patients considered the EMA to be positive for their daily life.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"51 4","pages":"439 - 454"},"PeriodicalIF":2.0,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140292442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-23DOI: 10.1007/s10488-024-01355-5
Tamar de Boer, Marijn Pietersma, Bea Tiemens
Disruptive behavior of patients in acute psychiatric care is a problem for both patients and staff. Preventing a patient’s impending disruption requires recognizing and understanding early signals. There are indications that a change in a patient’s global functioning may be such a signal. The global functioning of patients is a multidimensional view on their functioning. It captures a patient’s psychological symptoms, social skills, symptoms of violence, and activities in daily living. The aim of this study was to gain insight into the predictive value of global functioning on the risk of disruptive behavior of patients in acute psychiatric care. Also assessed was the time elapsed between the change in global functioning and a patient’s disruptive behavior, which is necessary to know for purposes of early intervention. In a longitudinal retrospective study, we used daily measurements with the Brøset Violence Checklist (BVC) and the Kennedy Axis V (K-As) of each patient admitted to two acute psychiatric units over a period of six years. Data from 931 patients for the first 28 days after their admission were used for survival analysis and cox regression analysis. Disruptive behavior was mostly observed during the first days of hospitalization. Global functioning predicted disruptive behavior from the very first day of hospitalization. A cut-off score of 48 or lower on the K-As on the first admission day predicted a higher risk of disruptive behavior. If functioning remained poor or deteriorated substantially over three days, this was an additional signal of increased risk of disruptive behavior. Improvement in global functioning was associated with a decreased risk of disruptive behavior. More attention is needed for early interventions on global functioning to prevent disruptive behavior.
{"title":"Prediction of Disruptive Behavior over Time from Changes in Patients’ Global Functioning in Acute Psychiatric Care","authors":"Tamar de Boer, Marijn Pietersma, Bea Tiemens","doi":"10.1007/s10488-024-01355-5","DOIUrl":"10.1007/s10488-024-01355-5","url":null,"abstract":"<div><p>Disruptive behavior of patients in acute psychiatric care is a problem for both patients and staff. Preventing a patient’s impending disruption requires recognizing and understanding early signals. There are indications that a change in a patient’s global functioning may be such a signal. The global functioning of patients is a multidimensional view on their functioning. It captures a patient’s psychological symptoms, social skills, symptoms of violence, and activities in daily living. The aim of this study was to gain insight into the predictive value of global functioning on the risk of disruptive behavior of patients in acute psychiatric care. Also assessed was the time elapsed between the change in global functioning and a patient’s disruptive behavior, which is necessary to know for purposes of early intervention. In a longitudinal retrospective study, we used daily measurements with the Brøset Violence Checklist (BVC) and the Kennedy Axis V (K-As) of each patient admitted to two acute psychiatric units over a period of six years. Data from 931 patients for the first 28 days after their admission were used for survival analysis and cox regression analysis. Disruptive behavior was mostly observed during the first days of hospitalization. Global functioning predicted disruptive behavior from the very first day of hospitalization. A cut-off score of 48 or lower on the K-As on the first admission day predicted a higher risk of disruptive behavior. If functioning remained poor or deteriorated substantially over three days, this was an additional signal of increased risk of disruptive behavior. Improvement in global functioning was associated with a decreased risk of disruptive behavior. More attention is needed for early interventions on global functioning to prevent disruptive behavior.</p></div>","PeriodicalId":7195,"journal":{"name":"Administration and Policy in Mental Health and Mental Health Services Research","volume":"51 5","pages":"725 - 737"},"PeriodicalIF":2.0,"publicationDate":"2024-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11379775/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140193058","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}