通过引入结构化口试来改善作为本科生物化学评估工具的口试过程:一项基于利益相关者调查的印度观察性研究。

Korean journal of medical education Pub Date : 2024-12-01 Epub Date: 2024-11-28 DOI:10.3946/kjme.2024.310
Rinchu Loomba, Nandita Maini Jindal
{"title":"通过引入结构化口试来改善作为本科生物化学评估工具的口试过程:一项基于利益相关者调查的印度观察性研究。","authors":"Rinchu Loomba, Nandita Maini Jindal","doi":"10.3946/kjme.2024.310","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>The traditional method of oral examination, though a good tool for assessing the depth and breadth of student's knowledge, has its shortcomings. A variable number of questions with variable difficulty levels by different examiners with different expectations can introduce bias in scores. The process aspect of oral examinations of first-year undergraduate medical students was improved by structuring them and by creating uniformity in the number, time, and difficulty level of questions for assessment, and feedback was taken regarding its acceptance as an improved tool of assessment.</p><p><strong>Methods: </strong>After finalizing the topics, questions from a viva viewpoint were structured and categorized into three difficulty levels covering all aspects of chosen topics validated by subject experts. The number of questions asked per difficulty level, time, and marks given to each question was pre-decided. After briefing the students, the structured viva was conducted, and feedback was taken from students and examiners.</p><p><strong>Results: </strong>The majority (87%) of first-year undergraduate students undertook the structured viva and filled in the feedback form. Nearly all students felt that the structured oral examination was a fair and unbiased assessment tool with less subjectivity compared to traditional viva. Most students (83.9%) felt that the topics were comprehensively covered, and 96.4% of students felt less stressed. Among examiners, there was 100% agreement on the uniformity of questions asked, topics covered, less subjectivity, and no carryover effect.</p><p><strong>Conclusion: </strong>The examiners have accepted it as one of the formative assessment tools for future batches of students and are ready to explore its utility as a summative assessment tool.</p>","PeriodicalId":37737,"journal":{"name":"Korean journal of medical education","volume":"36 4","pages":"367-377"},"PeriodicalIF":0.0000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11625900/pdf/","citationCount":"0","resultStr":"{\"title\":\"Improving process aspect of oral examination as assessment tool in undergraduate biochemistry by introducing structured oral examination: an observational study in India based on a survey among stakeholders.\",\"authors\":\"Rinchu Loomba, Nandita Maini Jindal\",\"doi\":\"10.3946/kjme.2024.310\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>The traditional method of oral examination, though a good tool for assessing the depth and breadth of student's knowledge, has its shortcomings. A variable number of questions with variable difficulty levels by different examiners with different expectations can introduce bias in scores. The process aspect of oral examinations of first-year undergraduate medical students was improved by structuring them and by creating uniformity in the number, time, and difficulty level of questions for assessment, and feedback was taken regarding its acceptance as an improved tool of assessment.</p><p><strong>Methods: </strong>After finalizing the topics, questions from a viva viewpoint were structured and categorized into three difficulty levels covering all aspects of chosen topics validated by subject experts. The number of questions asked per difficulty level, time, and marks given to each question was pre-decided. After briefing the students, the structured viva was conducted, and feedback was taken from students and examiners.</p><p><strong>Results: </strong>The majority (87%) of first-year undergraduate students undertook the structured viva and filled in the feedback form. Nearly all students felt that the structured oral examination was a fair and unbiased assessment tool with less subjectivity compared to traditional viva. Most students (83.9%) felt that the topics were comprehensively covered, and 96.4% of students felt less stressed. Among examiners, there was 100% agreement on the uniformity of questions asked, topics covered, less subjectivity, and no carryover effect.</p><p><strong>Conclusion: </strong>The examiners have accepted it as one of the formative assessment tools for future batches of students and are ready to explore its utility as a summative assessment tool.</p>\",\"PeriodicalId\":37737,\"journal\":{\"name\":\"Korean journal of medical education\",\"volume\":\"36 4\",\"pages\":\"367-377\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11625900/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Korean journal of medical education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3946/kjme.2024.310\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/11/28 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Korean journal of medical education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3946/kjme.2024.310","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/28 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

目的:传统的口语考试虽然是评估学生知识深度和广度的好工具,但也有其不足之处。不同的考官有不同的期望,他们提出的不同难度、不同数量的问题可能会导致分数偏差。通过对一年级医科本科生的口试进行结构化和统一评估问题的数量、时间和难度,改进了口试的过程,并就将口试作为一种改进的评估工具得到接受提出了反馈意见。方法:在确定主题后,从活体角度对问题进行结构化,并将其分为三个难度级别,涵盖所选主题的所有方面,并经主题专家验证。每个难度级别的问题数量、时间和每个问题的分数都是预先决定的。在对学生进行简要介绍后,进行结构化的面对面交流,并从学生和考官那里获得反馈。结果:绝大多数(87%)本科一年级学生进行了结构化问卷调查并填写了反馈表格。几乎所有学生都认为,与传统的口试相比,结构化的口试是一种公平、公正的评估工具,主观性较低。大多数学生(83.9%)认为主题被全面覆盖,96.4%的学生感到压力减轻。在审查员中,对于所提问题的一致性,所涵盖的主题,较少的主观性,没有结转效应,有100%的一致性。结论:审查员已将其作为未来批次学生的形成性评价工具之一,并准备探索其作为总结性评价工具的效用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Improving process aspect of oral examination as assessment tool in undergraduate biochemistry by introducing structured oral examination: an observational study in India based on a survey among stakeholders.

Purpose: The traditional method of oral examination, though a good tool for assessing the depth and breadth of student's knowledge, has its shortcomings. A variable number of questions with variable difficulty levels by different examiners with different expectations can introduce bias in scores. The process aspect of oral examinations of first-year undergraduate medical students was improved by structuring them and by creating uniformity in the number, time, and difficulty level of questions for assessment, and feedback was taken regarding its acceptance as an improved tool of assessment.

Methods: After finalizing the topics, questions from a viva viewpoint were structured and categorized into three difficulty levels covering all aspects of chosen topics validated by subject experts. The number of questions asked per difficulty level, time, and marks given to each question was pre-decided. After briefing the students, the structured viva was conducted, and feedback was taken from students and examiners.

Results: The majority (87%) of first-year undergraduate students undertook the structured viva and filled in the feedback form. Nearly all students felt that the structured oral examination was a fair and unbiased assessment tool with less subjectivity compared to traditional viva. Most students (83.9%) felt that the topics were comprehensively covered, and 96.4% of students felt less stressed. Among examiners, there was 100% agreement on the uniformity of questions asked, topics covered, less subjectivity, and no carryover effect.

Conclusion: The examiners have accepted it as one of the formative assessment tools for future batches of students and are ready to explore its utility as a summative assessment tool.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Korean journal of medical education
Korean journal of medical education Social Sciences-Education
CiteScore
3.20
自引率
0.00%
发文量
20
期刊介绍: The journal seeks to provide theoretical foundations, practical analysis, and up-to-date developments in health professional education: Curriculum development Teaching and learning Student assessment Educational evaluation Educational management and policy The journal welcomes high-quality papers on all levels of health professional education, including: Undergraduate education Postgraduate training Continuous professional development Interprofessional education.
期刊最新文献
Evaluation of a basic-clinical integrated pharmacology case-based learning program from a student perspective using the CIPP model. "Hey, can I go home?": a qualitative case study of wellbeing and the work environment in surgical training. Behind the scenes: teachers collaboration to facilitate interprofessional education between medical and pharmacy students in Indonesia. Current status and challenges of faculty development in Korean medical education and strategies for advancement. Fostering professionalism among health professionals: the essential role of self-regulated and self-directed aptitudes of learning.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1