Wassim Karkache, Samantha Halman, Christopher Tran, Rui Nie, Debra Pugh
{"title":"为虚拟客观结构化临床检查设计非接触式体格检查。","authors":"Wassim Karkache, Samantha Halman, Christopher Tran, Rui Nie, Debra Pugh","doi":"10.36834/cmej.74261","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Given the COVID-19 pandemic, many Objective Structured Clinical Examinations (OSCEs) have been adapted to virtual formats without addressing whether physical examination maneuvers can or should be assessed virtually. In response, we developed a novel touchless physical examination station for a virtual OSCE and gathered validity evidence for its use.</p><p><strong>Methods: </strong>We used a touchless physical examination OSCE station pilot-tested in a virtual OSCE in which Internal Medicine residents had to verbalize their approach to the physical examination, interpret images and videos of findings provided upon request, and make a diagnosis. We explored differences in performance by training year using ANOVA. In addition, we analyzed data using elements of Bloom's taxonomy of learning, i.e. knowledge, understanding, and synthesis.</p><p><strong>Results: </strong>Sixty-seven residents (PGY1-3) participated in the OSCE. Scores on the pilot station were significantly different between training levels (F=3.936, <i>p</i> = 0.024, η<sub>p</sub><sup>2</sup> = 0.11). The pilot station-total correlation (STC) was <i>r =</i> 0.558, and the item-station correlations ranged from <i>r =</i> 0.115-0.571, with the most discriminating items being those that assessed application of knowledge (interpretation and synthesis) rather than recall.</p><p><strong>Conclusion: </strong>This touchless physical examination station was feasible, had acceptable psychometric characteristics, and discriminated between residents at different levels of training.</p>","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11139800/pdf/","citationCount":"0","resultStr":"{\"title\":\"Designing a touchless physical examination for a virtual Objective Structured Clinical Examination.\",\"authors\":\"Wassim Karkache, Samantha Halman, Christopher Tran, Rui Nie, Debra Pugh\",\"doi\":\"10.36834/cmej.74261\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>Given the COVID-19 pandemic, many Objective Structured Clinical Examinations (OSCEs) have been adapted to virtual formats without addressing whether physical examination maneuvers can or should be assessed virtually. In response, we developed a novel touchless physical examination station for a virtual OSCE and gathered validity evidence for its use.</p><p><strong>Methods: </strong>We used a touchless physical examination OSCE station pilot-tested in a virtual OSCE in which Internal Medicine residents had to verbalize their approach to the physical examination, interpret images and videos of findings provided upon request, and make a diagnosis. We explored differences in performance by training year using ANOVA. In addition, we analyzed data using elements of Bloom's taxonomy of learning, i.e. knowledge, understanding, and synthesis.</p><p><strong>Results: </strong>Sixty-seven residents (PGY1-3) participated in the OSCE. Scores on the pilot station were significantly different between training levels (F=3.936, <i>p</i> = 0.024, η<sub>p</sub><sup>2</sup> = 0.11). The pilot station-total correlation (STC) was <i>r =</i> 0.558, and the item-station correlations ranged from <i>r =</i> 0.115-0.571, with the most discriminating items being those that assessed application of knowledge (interpretation and synthesis) rather than recall.</p><p><strong>Conclusion: </strong>This touchless physical examination station was feasible, had acceptable psychometric characteristics, and discriminated between residents at different levels of training.</p>\",\"PeriodicalId\":72503,\"journal\":{\"name\":\"Canadian medical education journal\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11139800/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Canadian medical education journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.36834/cmej.74261\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Canadian medical education journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.36834/cmej.74261","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
目的:鉴于 COVID-19 的流行,许多客观结构化临床考试(OSCE)已被改编为虚拟格式,但并未解决体格检查操作是否可以或应该进行虚拟评估的问题。为此,我们为虚拟 OSCE 开发了一种新型的非接触式体格检查站,并收集了其使用的有效性证据:方法:我们在虚拟 OSCE 中试用了无触摸体格检查站,在虚拟 OSCE 中,内科住院医师必须用语言表达他们的体格检查方法,解释根据要求提供的图像和视频结果,并做出诊断。我们使用方差分析探讨了不同培训年级的成绩差异。此外,我们还使用布卢姆学习分类学的要素(即知识、理解和综合)对数据进行了分析:67名住院医师(PGY1-3)参加了OSCE。不同培训水平的住院医师在试验站的得分有显著差异(F=3.936,p=0.024,ηp2=0.11)。试验站-总相关性(STC)为 r = 0.558,项目-试验站相关性范围为 r = 0.115-0.571,其中最具区分度的项目是那些评估知识应用(解释和综合)而非回忆的项目:结论:这种非接触式体格检查站是可行的,具有可接受的心理测量特征,并能区分不同培训水平的住院医师。
Designing a touchless physical examination for a virtual Objective Structured Clinical Examination.
Purpose: Given the COVID-19 pandemic, many Objective Structured Clinical Examinations (OSCEs) have been adapted to virtual formats without addressing whether physical examination maneuvers can or should be assessed virtually. In response, we developed a novel touchless physical examination station for a virtual OSCE and gathered validity evidence for its use.
Methods: We used a touchless physical examination OSCE station pilot-tested in a virtual OSCE in which Internal Medicine residents had to verbalize their approach to the physical examination, interpret images and videos of findings provided upon request, and make a diagnosis. We explored differences in performance by training year using ANOVA. In addition, we analyzed data using elements of Bloom's taxonomy of learning, i.e. knowledge, understanding, and synthesis.
Results: Sixty-seven residents (PGY1-3) participated in the OSCE. Scores on the pilot station were significantly different between training levels (F=3.936, p = 0.024, ηp2 = 0.11). The pilot station-total correlation (STC) was r = 0.558, and the item-station correlations ranged from r = 0.115-0.571, with the most discriminating items being those that assessed application of knowledge (interpretation and synthesis) rather than recall.
Conclusion: This touchless physical examination station was feasible, had acceptable psychometric characteristics, and discriminated between residents at different levels of training.