{"title":"Inter-rater variability in scoring of Addenbrooke's Cognitive Examination-Third Edition (ACE-III) protocols.","authors":"Miranda J Say, Ciarán O'Driscoll","doi":"10.1080/23279095.2022.2083964","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Despite its wide use in dementia diagnosis on the basis of cut-off points, the inter-rater variability of the Addenbrooke's Cognitive Examination-Third Edition (ACE-III) has been poorly studied.</p><p><strong>Methods: </strong>Thirty-one healthcare professionals from an older adults' mental health team scored two ACE-III protocols based on mock patients in a computerised form. Scoring accuracy, as well as total and domain-specific scoring variability, were calculated; factors relevant to participants were obtained, including their level of experience and self-rated confidence administering the ACE-III.</p><p><strong>Results: </strong>There was considerable inter-rater variability (up to 18 points for one of the cases), and one case's mean score was significantly higher (by nearly four points) than the true score. The Fluency, Visuospatial and Attention domains had greater levels of variability than Language and Memory. Higher scoring accuracy was not associated with either greater levels of experience or higher self-confidence in administering the ACE-III.</p><p><strong>Conclusions: </strong>The results suggest that the ACE-III is susceptible to scoring error and considerable inter-rater variability, which highlights the critical importance of initial, and continued, administration and scoring training.</p>","PeriodicalId":51308,"journal":{"name":"Applied Neuropsychology-Adult","volume":null,"pages":null},"PeriodicalIF":1.4000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Neuropsychology-Adult","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/23279095.2022.2083964","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/6/15 0:00:00","PubModel":"Epub","JCR":"Q4","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Despite its wide use in dementia diagnosis on the basis of cut-off points, the inter-rater variability of the Addenbrooke's Cognitive Examination-Third Edition (ACE-III) has been poorly studied.
Methods: Thirty-one healthcare professionals from an older adults' mental health team scored two ACE-III protocols based on mock patients in a computerised form. Scoring accuracy, as well as total and domain-specific scoring variability, were calculated; factors relevant to participants were obtained, including their level of experience and self-rated confidence administering the ACE-III.
Results: There was considerable inter-rater variability (up to 18 points for one of the cases), and one case's mean score was significantly higher (by nearly four points) than the true score. The Fluency, Visuospatial and Attention domains had greater levels of variability than Language and Memory. Higher scoring accuracy was not associated with either greater levels of experience or higher self-confidence in administering the ACE-III.
Conclusions: The results suggest that the ACE-III is susceptible to scoring error and considerable inter-rater variability, which highlights the critical importance of initial, and continued, administration and scoring training.
期刊介绍:
pplied Neuropsychology-Adult publishes clinical neuropsychological articles concerning assessment, brain functioning and neuroimaging, neuropsychological treatment, and rehabilitation in adults. Full-length articles and brief communications are included. Case studies of adult patients carefully assessing the nature, course, or treatment of clinical neuropsychological dysfunctions in the context of scientific literature, are suitable. Review manuscripts addressing critical issues are encouraged. Preference is given to papers of clinical relevance to others in the field. All submitted manuscripts are subject to initial appraisal by the Editor-in-Chief, and, if found suitable for further considerations are peer reviewed by independent, anonymous expert referees. All peer review is single-blind and submission is online via ScholarOne Manuscripts.