Measurement tools for behaviours that challenge and behavioural function in people with intellectual disability: A systematic review and meta-analysis of internal consistency, inter-rater reliability, and test-retest reliability
Lauren Shelley , Chris Jones , Effie Pearson , Caroline Richards , Hayley Crawford , Arianna Paricos , Courtney Greenhill , Alixandra Woodhead , Joanne Tarver , Jane Waite
{"title":"Measurement tools for behaviours that challenge and behavioural function in people with intellectual disability: A systematic review and meta-analysis of internal consistency, inter-rater reliability, and test-retest reliability","authors":"Lauren Shelley , Chris Jones , Effie Pearson , Caroline Richards , Hayley Crawford , Arianna Paricos , Courtney Greenhill , Alixandra Woodhead , Joanne Tarver , Jane Waite","doi":"10.1016/j.cpr.2024.102434","DOIUrl":null,"url":null,"abstract":"<div><p>Behaviours that challenge (BtC) are common in people with intellectual disability (ID) and associated with negative long-term outcomes. Reliable characterisation of BtC and behavioural function is integral to person-centred interventions. This systematic review and meta-analytic study quantitatively synthesised the evidence-base for the internal consistency, inter-rater reliability, and test-retest reliability of measures of BtC and behavioural function in people with ID (PROSPERO: CRD42021239042). Web of Science, Embase, PsycINFO and MEDLINE were searched from inception to March 2024. Retrieved records (<em>n</em> = 3691) were screened independently to identify studies assessing eligible measurement properties in people with ID. Data extracted from 83 studies, across 29 measures, were synthesised in a series of random-effects meta-analyses. Subgroup analyses assessed the influence of methodological quality and study-level characteristics on pooled estimates. COSMIN criteria were used to evaluate the measurement properties of each measure. Pooled estimates ranged across measures: internal consistency (0.41–0.97), inter-rater reliability (0.29–0.93) and test-retest reliability (0.52–0.98). The quantity and quality of evidence varied substantially across measures; evidence was frequently unavailable or limited to a single study. Based on current evidence, candidate measures with the most evidence for internal consistency and reliability are discussed; however, continued assessment of measurement properties in ID populations is a key priority.</p></div>","PeriodicalId":48458,"journal":{"name":"Clinical Psychology Review","volume":"110 ","pages":"Article 102434"},"PeriodicalIF":13.7000,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0272735824000552/pdfft?md5=a913aeee5d92ff07a7f7b0ebf2955a34&pid=1-s2.0-S0272735824000552-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Psychology Review","FirstCategoryId":"102","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0272735824000552","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, CLINICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Behaviours that challenge (BtC) are common in people with intellectual disability (ID) and associated with negative long-term outcomes. Reliable characterisation of BtC and behavioural function is integral to person-centred interventions. This systematic review and meta-analytic study quantitatively synthesised the evidence-base for the internal consistency, inter-rater reliability, and test-retest reliability of measures of BtC and behavioural function in people with ID (PROSPERO: CRD42021239042). Web of Science, Embase, PsycINFO and MEDLINE were searched from inception to March 2024. Retrieved records (n = 3691) were screened independently to identify studies assessing eligible measurement properties in people with ID. Data extracted from 83 studies, across 29 measures, were synthesised in a series of random-effects meta-analyses. Subgroup analyses assessed the influence of methodological quality and study-level characteristics on pooled estimates. COSMIN criteria were used to evaluate the measurement properties of each measure. Pooled estimates ranged across measures: internal consistency (0.41–0.97), inter-rater reliability (0.29–0.93) and test-retest reliability (0.52–0.98). The quantity and quality of evidence varied substantially across measures; evidence was frequently unavailable or limited to a single study. Based on current evidence, candidate measures with the most evidence for internal consistency and reliability are discussed; however, continued assessment of measurement properties in ID populations is a key priority.
期刊介绍:
Clinical Psychology Review serves as a platform for substantial reviews addressing pertinent topics in clinical psychology. Encompassing a spectrum of issues, from psychopathology to behavior therapy, cognition to cognitive therapies, behavioral medicine to community mental health, assessment, and child development, the journal seeks cutting-edge papers that significantly contribute to advancing the science and/or practice of clinical psychology.
While maintaining a primary focus on topics directly related to clinical psychology, the journal occasionally features reviews on psychophysiology, learning therapy, experimental psychopathology, and social psychology, provided they demonstrate a clear connection to research or practice in clinical psychology. Integrative literature reviews and summaries of innovative ongoing clinical research programs find a place within its pages. However, reports on individual research studies and theoretical treatises or clinical guides lacking an empirical base are deemed inappropriate for publication.