{"title":"跨专业教育中基于等级的同行评估的纸质和移动应用比较:COVID-19 大流行之前、期间和之后。","authors":"Doni Widyandana, Prattama Santoso Utomo, Ide Pustaka Setiawan, Yustina Tyas Kurniawati, Sucheta Dandekar","doi":"10.1186/s12909-024-06382-2","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Education was affected during the COVID-19 pandemic, and there was a need to adapt the learning approaches to the situation. At the University of Gadjah Mada, many essential soft skills of healthcare professionals are taught using the interprofessional education (IPE) approach on-site. Our university responded to this crisis by offering online classes and similar types of training. Post-administration of the course, a peer-assessment was conducted, and it was used to provide feedback on the work or performance of peers among students. Peer assessment was done using paper-based and a mobile application during COVID-19. This study aimed to share a best practice for the implementation of a rank-based peer-assessment application for longitudinal interprofessional education in the community setting and to compare the score distribution of a rank-based peer-assessment before and after using mobile application.</p><p><strong>Methods: </strong>Quantitative research design was used by processing secondary data on student peer assessment scores from 3 bachelor programs (medicine, nursing, nutritionist) Community and Family Health Care with Interprofessional Education (CFHC-IPE) in Faculty of Medicine, Nursing, and Public Health, Universitas Gadjah Mada. 4,790 students from 2018 to 2022 (5 years) were tracked before, during, and after the COVID-19 pandemic. The assessments carried out were offline, online, and blended learning, respectively. The assessment was carried out using a paper-based method before and during the pandemic, online-based with a mobile application was used. Thus, the peer-assessment was conducted manually or using paper-based method using a 5-rank scoring system. In 2019, the peer assessment was carried out using a mobile application and applied a 10-rank scoring system.</p><p><strong>Results: </strong>The rank-based peer assessment can be well implemented to make students assess their friends more objectively, with an average score 82.02 ± 8.68. The rightward shift in the distribution of scores indicates that the average score has improved after using the mobile application compared to before its use. (82.02 ± 8.68 vs. 62.39 ± 11.13, p < 0.05).</p><p><strong>Conclusion: </strong>The implementation of rank-based peer-assessment using a mobile application was well received during and after the pandemic by interprofessional undergraduate students. The online system made the assessment more objective and the average grades were seen to be better.</p>","PeriodicalId":51234,"journal":{"name":"BMC Medical Education","volume":"24 1","pages":"1383"},"PeriodicalIF":2.7000,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11600818/pdf/","citationCount":"0","resultStr":"{\"title\":\"Comparing paper-based and mobile application for rank-based peer assessment in interprofessional education: before, during, and after the COVID-19 pandemic.\",\"authors\":\"Doni Widyandana, Prattama Santoso Utomo, Ide Pustaka Setiawan, Yustina Tyas Kurniawati, Sucheta Dandekar\",\"doi\":\"10.1186/s12909-024-06382-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Education was affected during the COVID-19 pandemic, and there was a need to adapt the learning approaches to the situation. At the University of Gadjah Mada, many essential soft skills of healthcare professionals are taught using the interprofessional education (IPE) approach on-site. Our university responded to this crisis by offering online classes and similar types of training. Post-administration of the course, a peer-assessment was conducted, and it was used to provide feedback on the work or performance of peers among students. Peer assessment was done using paper-based and a mobile application during COVID-19. This study aimed to share a best practice for the implementation of a rank-based peer-assessment application for longitudinal interprofessional education in the community setting and to compare the score distribution of a rank-based peer-assessment before and after using mobile application.</p><p><strong>Methods: </strong>Quantitative research design was used by processing secondary data on student peer assessment scores from 3 bachelor programs (medicine, nursing, nutritionist) Community and Family Health Care with Interprofessional Education (CFHC-IPE) in Faculty of Medicine, Nursing, and Public Health, Universitas Gadjah Mada. 4,790 students from 2018 to 2022 (5 years) were tracked before, during, and after the COVID-19 pandemic. The assessments carried out were offline, online, and blended learning, respectively. The assessment was carried out using a paper-based method before and during the pandemic, online-based with a mobile application was used. Thus, the peer-assessment was conducted manually or using paper-based method using a 5-rank scoring system. In 2019, the peer assessment was carried out using a mobile application and applied a 10-rank scoring system.</p><p><strong>Results: </strong>The rank-based peer assessment can be well implemented to make students assess their friends more objectively, with an average score 82.02 ± 8.68. The rightward shift in the distribution of scores indicates that the average score has improved after using the mobile application compared to before its use. (82.02 ± 8.68 vs. 62.39 ± 11.13, p < 0.05).</p><p><strong>Conclusion: </strong>The implementation of rank-based peer-assessment using a mobile application was well received during and after the pandemic by interprofessional undergraduate students. The online system made the assessment more objective and the average grades were seen to be better.</p>\",\"PeriodicalId\":51234,\"journal\":{\"name\":\"BMC Medical Education\",\"volume\":\"24 1\",\"pages\":\"1383\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2024-11-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11600818/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"BMC Medical Education\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s12909-024-06382-2\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Education","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12909-024-06382-2","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
摘要
背景:在 COVID-19 大流行期间,教育受到了影响,因此有必要调整学习方法以适应这种情况。在加札马达大学(University of Gadjah Mada),医护人员的许多基本软技能都是通过跨专业教育(IPE)的方式在现场教授的。我校通过提供在线课程和类似类型的培训来应对这一危机。课程结束后,还进行了同伴评估,用于对学生之间同伴的工作或表现提供反馈。在 COVID-19 期间,使用纸质和移动应用程序进行了同行评估。本研究旨在分享在社区纵向跨专业教育中实施基于等级的同行评估应用的最佳实践,并比较使用移动应用前后基于等级的同行评估的得分分布情况:采用定量研究设计,处理加札马达大学医学、护理和公共卫生学院3个本科专业(医学、护理、营养师)社区和家庭卫生保健跨专业教育(CFHC-IPE)学生互评分数的二手数据。在 COVID-19 大流行之前、期间和之后,对 2018 年至 2022 年(5 年)的 4790 名学生进行了跟踪调查。分别进行了离线、在线和混合式学习评估。在大流行前和大流行期间,评估采用纸质方式进行,而在大流行期间,则采用基于移动应用程序的在线方式。因此,同行评估是通过手动或纸质方式进行的,采用 5 级评分系统。2019 年,使用移动应用程序进行了同行评估,并采用了 10 级评分系统:基于等级的互评能很好地让学生更客观地评价自己的朋友,平均得分为(82.02±8.68)分。得分分布的右移表明,与使用前相比,使用移动应用程序后的平均得分有所提高。(82.02 ± 8.68 vs. 62.39 ± 11.13, p 结论:在大流行期间和之后,跨专业本科生对使用移动应用程序进行基于等级的互评反应良好。在线系统使评估更加客观,平均成绩也有所提高。
Comparing paper-based and mobile application for rank-based peer assessment in interprofessional education: before, during, and after the COVID-19 pandemic.
Background: Education was affected during the COVID-19 pandemic, and there was a need to adapt the learning approaches to the situation. At the University of Gadjah Mada, many essential soft skills of healthcare professionals are taught using the interprofessional education (IPE) approach on-site. Our university responded to this crisis by offering online classes and similar types of training. Post-administration of the course, a peer-assessment was conducted, and it was used to provide feedback on the work or performance of peers among students. Peer assessment was done using paper-based and a mobile application during COVID-19. This study aimed to share a best practice for the implementation of a rank-based peer-assessment application for longitudinal interprofessional education in the community setting and to compare the score distribution of a rank-based peer-assessment before and after using mobile application.
Methods: Quantitative research design was used by processing secondary data on student peer assessment scores from 3 bachelor programs (medicine, nursing, nutritionist) Community and Family Health Care with Interprofessional Education (CFHC-IPE) in Faculty of Medicine, Nursing, and Public Health, Universitas Gadjah Mada. 4,790 students from 2018 to 2022 (5 years) were tracked before, during, and after the COVID-19 pandemic. The assessments carried out were offline, online, and blended learning, respectively. The assessment was carried out using a paper-based method before and during the pandemic, online-based with a mobile application was used. Thus, the peer-assessment was conducted manually or using paper-based method using a 5-rank scoring system. In 2019, the peer assessment was carried out using a mobile application and applied a 10-rank scoring system.
Results: The rank-based peer assessment can be well implemented to make students assess their friends more objectively, with an average score 82.02 ± 8.68. The rightward shift in the distribution of scores indicates that the average score has improved after using the mobile application compared to before its use. (82.02 ± 8.68 vs. 62.39 ± 11.13, p < 0.05).
Conclusion: The implementation of rank-based peer-assessment using a mobile application was well received during and after the pandemic by interprofessional undergraduate students. The online system made the assessment more objective and the average grades were seen to be better.
期刊介绍:
BMC Medical Education is an open access journal publishing original peer-reviewed research articles in relation to the training of healthcare professionals, including undergraduate, postgraduate, and continuing education. The journal has a special focus on curriculum development, evaluations of performance, assessment of training needs and evidence-based medicine.