The influence of candidates' race on examiners' ratings in standardised assessments of clinical practice.

IF 3.3 2区教育学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Medical Teacher Pub Date : 2024-05-21 DOI:10.1080/0142159X.2024.2345266

Celia Brown, Sarah Khavandi, Ann Sebastian, Kerry Badger, Rachel Westacott, Malcolm W R Reed, Mark Gurnell, Amir H Sam

{"title":"The influence of candidates' race on examiners' ratings in standardised assessments of clinical practice.","authors":"Celia Brown, Sarah Khavandi, Ann Sebastian, Kerry Badger, Rachel Westacott, Malcolm W R Reed, Mark Gurnell, Amir H Sam","doi":"10.1080/0142159X.2024.2345266","DOIUrl":null,"url":null,"abstract":"Purpose: Delivering fair and reliable summative assessments in medical education assumes examiner decision making is devoid of bias. We investigated whether candidate racial appearances influenced examiner ratings in undergraduate clinical exams.Methods: We used an internet-based design. Examiners watched a randomised set of six videos of three different white candidates and three different non-white (Asian, black and Chinese) candidates taking a clinical history at either fail, borderline or pass grades. We compared the median and interquartile range (IQR) of the paired difference between scores for the white and non-white candidates at each performance grade and tested for statistical significance.Results: 160 Examiners participated. At the fail grade, the black and Chinese candidates scored lower than the white candidate, with median paired differences of -2.5 and -1 respectively (both p < 0.001). At the borderline grade, the black and Chinese candidates scored higher than the white candidate, with median paired differences of +2 and +3, respectively (both p < 0.001). At the passing grade, the Asian candidate scored lower than the white candidate (median paired difference -1, p < 0.001).Conclusion: The racial appearance of candidates appeared to influence the scores awarded by examiners, but not in a uniform manner.","PeriodicalId":18643,"journal":{"name":"Medical Teacher","volume":null,"pages":null},"PeriodicalIF":3.3000,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Teacher","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1080/0142159X.2024.2345266","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose: Delivering fair and reliable summative assessments in medical education assumes examiner decision making is devoid of bias. We investigated whether candidate racial appearances influenced examiner ratings in undergraduate clinical exams.

Methods: We used an internet-based design. Examiners watched a randomised set of six videos of three different white candidates and three different non-white (Asian, black and Chinese) candidates taking a clinical history at either fail, borderline or pass grades. We compared the median and interquartile range (IQR) of the paired difference between scores for the white and non-white candidates at each performance grade and tested for statistical significance.

Results: 160 Examiners participated. At the fail grade, the black and Chinese candidates scored lower than the white candidate, with median paired differences of -2.5 and -1 respectively (both p < 0.001). At the borderline grade, the black and Chinese candidates scored higher than the white candidate, with median paired differences of +2 and +3, respectively (both p < 0.001). At the passing grade, the Asian candidate scored lower than the white candidate (median paired difference -1, p < 0.001).

Conclusion: The racial appearance of candidates appeared to influence the scores awarded by examiners, but not in a uniform manner.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

在临床实践标准化评估中，考生的种族对考官评分的影响。

目的：在医学教育中进行公平、可靠的终结性评估时，考官的决策必须不带偏见。我们调查了在本科临床考试中，考生的种族外表是否会影响考官的评分：方法：我们采用了基于互联网的设计。方法：我们采用了基于互联网的设计，考官随机观看了一组六段视频，分别是三名不同的白人考生和三名不同的非白人（亚洲人、黑人和中国人）考生在不及格、临界或及格等级时的临床病史。我们比较了白人和非白人考生在每个成绩等级上的分数配对差异的中位数和四分位距（IQR），并进行了统计学意义检验：共有 160 名考官参加。在不及格等级中，黑人和华裔考生的得分低于白人考生，配对差异的中位数分别为-2.5和-1（均为p p p p 结论：黑人和华裔考生的得分低于白人考生，配对差异的中位数分别为-2.5和-1：考生的种族外貌似乎会影响考官的评分，但影响的方式并不一致。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Medical Teacher 医学-卫生保健

CiteScore

7.80

自引率

8.50%

发文量

396

审稿时长

3-6 weeks

期刊介绍： Medical Teacher provides accounts of new teaching methods, guidance on structuring courses and assessing achievement, and serves as a forum for communication between medical teachers and those involved in general education. In particular, the journal recognizes the problems teachers have in keeping up-to-date with the developments in educational methods that lead to more effective teaching and learning at a time when the content of the curriculum—from medical procedures to policy changes in health care provision—is also changing. The journal features reports of innovation and research in medical education, case studies, survey articles, practical guidelines, reviews of current literature and book reviews. All articles are peer reviewed.