Objectives: To develop a reliable instrument to objectively assess feedback quality, to use it for assessment of the quality of students' narrative feedback and to be used as a self-assessment instrument for students in their learning process.
Methods: In a retrospective cohort study, 635 feedback narratives, provided by small groups of Medicine and Biomedical Sciences undergraduate students, have been extracted from available quarterly curriculum evaluation surveys. A rubric was developed based on literature and contents of our feedback education. It consists of seven subitems and has a maximum score of 20 points (sufficient score: >10 points). Rubric reliability was evaluated using intra-class correlation. The rubric was tested by analysing the feedback narratives. To test progression, we compared rubric scores between study years with a Kruskal-Wallis analysis and Dunn's post-hoc testing with Bonferroni correction.
Results: The rubric has an intra-class correlation of 0.894. First year students had a mean rubric score of 11.5 points (SD 3.6), second year students 12.4 (SD 3.4) and third year students 13.1 (SD 3.6). Kruskal-Wallis testing showed significant differences in feedback quality between study years (χ2(2, N=635) = 17.53, p<0.001). Dunn's post-hoc test revealed significant differences between study years one and two (p=0.012) and one and three (p<0.001).
Conclusions: The developed rubric is a reliable instrument to assess narrative feedback quality. Students were able to provide feedback of sufficient quality and quality improved across study years. The instrument will allow students to assess themselves and learn where there is still room for improvement.
Objectives: To examine the impact of dental students' usage patterns within an adaptive learning platform (ALP), using ALP-related indicators, on their final exam performance.
Methods: Track usage data from the ALP, combined with demographic and academic data including age, gender, pre- and post-test scores, and cumulative grade point average (GPA) were retrospectively collected from 115 second-year dental students enrolled in a blended learning review course. Learning performance was measured by post-test scores. Data were analyzed using correlation coefficients and linear regression tests.
Results: The ALP-related variables (without controlling for background demographics and academic data) accounted for 29.6% of student final exam performance (R2=0.296, F(10,104)=4.37, p=0.000). Positive significant ALP-related predictors of post-test scores were improvement after activities (β=0.507, t(104)=2.101, p=0.038), timely completed objectives (β=0.391, t(104)=2.418, p=0.017), and number of revisions (β=0.127, t(104)=3.240, p=0.002). Number of total activities, regardless of learning improvement, negatively predicted post-test scores (β= -0.088, t(104)=-4.447, p=0.000). The significant R2 change following the addition of gender, GPA, and pre-test score (R2=0.689, F(13, 101)=17.24, p=0.000), indicated that these predictors explained an additional 39% of the variance in student performance beyond that explained by ALP-related variables, which were no longer significant. Inclusion of cumulative GPA and pre-test scores showed to be the strongest and only predictors of post-test scores (β=18.708, t(101)=4.815, p=0.038) and (β=0.449, t(101)=6.513, p=0.038), respectively.
Conclusions: Track ALP-related data can be valuable indicators of learning behavior. Careful and contextual analysis of ALP data can guide future studies to examine practical and scalable interventions.
Objectives: This integrative literature review aimed to identify the core elements of an anti-racist approach among health professions educators.
Methods: We searched five databases CINAHL (EBSCOhost), ERIC (ProQuest Dissertations & Thesis Global), EMBASE (Ovid), MEDLINE (Ovid), and Web of Science (Social Sciences Citation Index, Citation Index Expanded) in March 2021. The search strategy combined concepts related to anti-racist pedagogies in the context of health professions education by educators in any capacity. From 1,755 results, we selected 249 manuscripts published in English or French between 2008 and 2021 based on titles and abstracts. After reviewing the full texts, we selected the 48 most relevant sources. We extracted data regarding knowledge, skills, and attitudes in reference to anti-racist approaches or surrogate terms. Within each category, we grouped similar data using a conceptual map.
Results: Analysis of the selected sources revealed that, for health professions educators, engaging in an anti-racist pedagogical approach requires more than incorporating racialized perspectives and content into the classroom. It rather rests on three interrelated components: developing a critical understanding of power relationships, moving toward a critical consciousness, and taking action at individual and organizational levels.
Conclusions: This review sheds light on knowledge, attitudes and skills that educators must deploy to adopt an anti-racist approach competently. This approach is a learned, intentional, and strategic effort in which health professions educators incorporate anti-racism into their teaching and apply anti-racist values to their various spheres of influence. This ongoing process strives for institutional and structural changes and requires whole-system actions.