Feasibility, reliability and validity of a modified approach to goal attainment scaling to measure goal outcomes following cognitive remediation in a residential substance use disorder rehabilitation setting

Abstract

ABSTRACT Objective Although person-centred outcome measures have been recommended to evaluate cognitive rehabilitation interventions, few validated measures have been developed for this purpose. The current study examined aspects of feasibility, reliability and validity of a modified version of goal attainment scaling that uses a goal menu, calculator and control goals. Method Participants were N=25 female residents of a substance use disorder therapeutic community who were allocated to a four-week cognitive remediation (n=13) or treatment as usual (n=12) control group in a controlled sequential groups trial. Modified goal attainment scaling was used to set goals. Limited efficacy and efficiency, quality appraisal criteria, and convergent and discriminant validity of target and control goals were used to examine feasibility, reliability and content validity, and construct validity, respectively. Results Target goals were achieved at a higher rate than control goals for the Intervention, but not Control, group, with a medium effect size (r = 0.5). The approach was efficient and 44% of reliability and 75% of content validity criteria were met. Target goals correlated more strongly than control goals with the Behavior Rating Inventory of Executive Function - Adult version. Conclusions The modified approach to goal attainment scaling demonstrated aspects of feasibility, reliability and validity. Key points What is already known about this topic: Cognitive remediation is a promising intervention for people with substance use disorder. Goal attainment scaling captures individualised person-centred goals. There is much variability in the quality and application of goal attainment scaling. What this topic adds: Modified goal attainment scaling is feasible in substance use disorder treatment research. Modified goal attainment scaling meets several reliability and validity criteria. Modified goal attainment scaling can be used to generate an effect size using nonparametric techniques.