Inter-rater Reliability of Pressure Pain Threshold Between Experienced and Novice Examiners: A Case Study of 2 Educational Approaches.

Abigail T Wilson, Carey E Rothschild
{"title":"Inter-rater Reliability of Pressure Pain Threshold Between Experienced and Novice Examiners: A Case Study of 2 Educational Approaches.","authors":"Abigail T Wilson, Carey E Rothschild","doi":"10.1097/JTE.0000000000000376","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and purpose: </strong>Pressure Pain Threshold (PPT) is used to objectively assess pain in clinical settings and is a recommended part of physical therapist education. An individual who is experienced in administering PPT will frequently train a student on the technique; however, optimal educational approaches for this instruction have not yet been identified. Therefore, the purpose of this case report is to describe 2 educational approaches (unstructured lecture and structured feedback with clinical relevance) in training 2 separate cohorts of Doctor of Physical Therapy students in PPT. The primary outcome of interest was the inter-rater reliability of PPT between an experienced and novice examiner.</p><p><strong>Case description: </strong>Cohort 1 (n = 37) received a traditional lecture approach consisting of watching a prerecorded video online, an in-person lecture with demonstration of the technique, and time to practice. Cohort 2 (n = 34) received the prerecorded video online and lecture with demonstration; however, key additions included a clinical relevance discussion along with structured peer-to-peer and instructor-to-student feedback using a competency-based checklist. PPT was assessed by each student (novice examiner) and one instructor (experienced examiner). Inter-rater reliability of PPT between a novice and experienced examiner was evaluated.</p><p><strong>Outcomes: </strong>Inter-rater reliability improved from poor/moderate (intraclass correlation coefficient low back = 0.46 [0.16-0.68], quadriceps = 0.54 [0.26-0.73]) to good (low back = 0.84 [0.67-0.92], quadriceps = 0.90 [0.79-0.95]) after the addition of structured feedback.</p><p><strong>Discussion: </strong>Structured feedback from peers and instructors may be useful when learning PPT and improving inter-rater reliability, which has implications for training students within a laboratory or classroom. However, this case study would need to be replicated in an experimental design to examine the effects of varying types of feedback on learning outcomes.</p>","PeriodicalId":517432,"journal":{"name":"Journal, physical therapy education","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal, physical therapy education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1097/JTE.0000000000000376","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Background and purpose: Pressure Pain Threshold (PPT) is used to objectively assess pain in clinical settings and is a recommended part of physical therapist education. An individual who is experienced in administering PPT will frequently train a student on the technique; however, optimal educational approaches for this instruction have not yet been identified. Therefore, the purpose of this case report is to describe 2 educational approaches (unstructured lecture and structured feedback with clinical relevance) in training 2 separate cohorts of Doctor of Physical Therapy students in PPT. The primary outcome of interest was the inter-rater reliability of PPT between an experienced and novice examiner.

Case description: Cohort 1 (n = 37) received a traditional lecture approach consisting of watching a prerecorded video online, an in-person lecture with demonstration of the technique, and time to practice. Cohort 2 (n = 34) received the prerecorded video online and lecture with demonstration; however, key additions included a clinical relevance discussion along with structured peer-to-peer and instructor-to-student feedback using a competency-based checklist. PPT was assessed by each student (novice examiner) and one instructor (experienced examiner). Inter-rater reliability of PPT between a novice and experienced examiner was evaluated.

Outcomes: Inter-rater reliability improved from poor/moderate (intraclass correlation coefficient low back = 0.46 [0.16-0.68], quadriceps = 0.54 [0.26-0.73]) to good (low back = 0.84 [0.67-0.92], quadriceps = 0.90 [0.79-0.95]) after the addition of structured feedback.

Discussion: Structured feedback from peers and instructors may be useful when learning PPT and improving inter-rater reliability, which has implications for training students within a laboratory or classroom. However, this case study would need to be replicated in an experimental design to examine the effects of varying types of feedback on learning outcomes.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
经验丰富的检查员与新手之间压痛阈值的互评可靠性:两种教育方法的案例研究。
背景和目的:压痛阈值(PPT)用于在临床环境中客观评估疼痛,是理疗师教育中推荐的一部分。在实施 PPT 方面经验丰富的个人经常会对学生进行该技术的培训;然而,目前尚未确定该教学的最佳教育方法。因此,本病例报告旨在描述在对两批不同的理疗学博士生进行 PPT 培训时所采用的两种教育方法(非结构化讲座和与临床相关的结构化反馈)。主要结果是有经验的考官和新手之间的 PPT 评判可靠性:第一组学生(37 人)采用传统的授课方式,包括在线观看预先录制的视频、现场授课和技术演示以及练习时间。第二组学生(34 人)接受在线预录视频和演示讲座,但主要增加了临床相关性讨论,以及使用基于能力的核对表进行结构化的同行和教师对学生反馈。PPT 由每名学生(新手考官)和一名教师(经验丰富的考官)进行评估。对新手和经验丰富的考官之间 PPT 的评分者间可靠性进行了评估:结果:在加入结构化反馈后,评分者之间的可靠性从较差/中等(类内相关系数腰背=0.46 [0.16-0.68],股四头肌=0.54 [0.26-0.73])提高到良好(腰背=0.84 [0.67-0.92],股四头肌=0.90 [0.79-0.95]):讨论:在学习 PPT 和提高评分者之间的可靠性时,来自同伴和指导者的结构化反馈可能很有用,这对在实验室或教室内培训学生有一定的意义。不过,这项案例研究需要在实验设计中加以复制,以检验不同类型的反馈对学习效果的影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Prevalence of Impostor Phenomenon in Graduate Healthcare Students. Development of a Novel Evidence-Based Practice-Specific Competency for Doctor of Physical Therapy Students in Clinical Education: A Modified Delphi Approach. Retrieval Practice Improves Exam Performance as a Function of Review Question Number and Format. Using Simulation-Based Mastery Learning to Achieve Excellent Learning Outcomes in Physical Therapist Education. Web Site Accessibility Among Doctor of Physical Therapy Programs in the United States.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1