Objective: While approaches for utilizing student course evaluations (SCEs) have been discussed in the literature, there remain opportunities to identify ideal practices for SCEs. Thus, the objective of this project was to generate consensus on best practices in creating, administering, and using SCEs.
Methods: A modified Delphi approach was utilized to generate a set of items based on the literature and prior work. Experts were identified from different roles, institution types, and geographic regions to participate in the panel. Consensus-building rounds were performed until no new ideas were introduced using an electronic survey platform. Data were analyzed descriptively each round.
Results: After the second round, 47 items met consensus. Key recommendations included enhanced training of students to provide feedback, transparency with students on how feedback is utilized, using SCEs as one element of data sources, and the importance of ensuring intentional approaches based on theoretical constructs used in the field of course evaluation.
Conclusions: This Delphi study established consensus on approaches programs can use to optimize SCEs, according to experts from across the academy. Though some items are very specific, there are opportunities for individualization based on program priorities.
This article investigates the narrative skills of children acquiring Finnish Sign Language (FinSL). Producing a narrative requires vocabulary, the ability to form sentences, and cognitive skills to construct actions in a logical order for the recipient to understand the story. Research has shown that narrative skills are an excellent way of observing a child's language skills, for they reflect both grammatical language skills and the ability to use the language in situationally appropriate ways. This study was conducted using the FinSL Narrative Skills Production Test assessment to observe how narrative skills develop in children between the ages of 4 and 11 who acquire FinSL in their natural language environments. The results show that the narrative skills of children acquiring FinSL develop following the same guidelines found in other signed and spoken languages. Narrative structure and content increase with age.
Background: The Ethiopian Ministry of Health introduced medical licensure examinations to maintain high standards in medical practice and build public trust in healthcare professionals. Studies also suggested significant issues in clinical competence among Ethiopian junior doctors as well concerns regarding unlicensed practice. Given the need to ensure safe health care, we investigated the psychometric properties of the multiple-choice items comprising the Ethiopian national licensing exam (NLE). These analyses help to provide an argument for the validity and reliability of the test scores. Method: We used a cross-sectional study design to analyze data from three cohorts of undergraduate medicine licensing examinations in Ethiopia (2020-2022, N = 2,213). Using Classical Test Theory, we assessed the psychometric properties of 600 MCQ items with 2400 single best answer choices, specifically item difficulty, item discrimination, and the number of nonfunctional distractors, and scale reliability. We provide results regarding the overall test and its sub-domains. Results: Ethiopia's undergraduate medical licensure examination demonstrated acceptable reliability (Alpha > 0.80), with significant variability in item difficulty and examinee performance. Although these results indicate a sufficiently defensible exam, our results point to issues regarding item statistics, especially a high number of nonfunctional distractors. Conclusions: This study provides first evidence regarding the psychometric soundness of the Ethiopian NLE. However, a significant number of items should be carefully reviewed and possibly revised. As the examination is relatively new, ongoing refinement to item-development and review processes is essential to improve and ensure its quality.
As early as preschool, Black children are more at risk than their peers to receive exclusionary practices. These negative early childhood school experiences can create greater risk for entrance into the preschool-to-prison pipeline. However, familial protective factors can help reduce exposure and mitigate this systemic pipeline for young children. The purpose of this study was to determine the familial factors associated with reducing a child’s entrance into the preschool-to-prison pipeline. Results from this study indicated that there were differences in perspectives among teachers and families regarding their child’s academic and behavioral risk. The findings also suggest that consistent strategies and collaboration among teachers and families can serve as familial protective factors, potentially mitigating the risk of academic failures and behavioral disorders.
Objective: Limited and conflicting evidence exists evaluating how components of pharmacy residency applications are prioritized by residency program directors (RPDs). This study aims to identify what pharmacy residency programs prioritize when selecting candidates to interview given the incorporation of new American Society of Health-System Pharmacists (ASHP) Pharmacy Residency Standards.
Methods: A Qualtrics survey was distributed to postgraduate year 1 (PGY1) RPDs across the United States. Programs were identified using the American College of Clinical Pharmacy and ASHP residency directory. Data was collected from October 23, 2023, to December 4, 2023, and priorities were captured using percentage weighting and rank order lists.
Results: Of the 1389 survey links disseminated, a total of 254 programs submitted responses for a total response rate of 18.2%. According to RPDs the highest weighted section of a residency application was the curriculum vitae (CV) with an average weight of 51.7% followed by letters of recommendation, letter of intent, and supplemental application (if applicable) in descending order, respectively. Within the CV, programs valued work, leadership, and rotation experiences most. Ability to organize and manage time was reported to be the most important characteristic within letters of recommendation.
Conclusion: Based on the results of this study, when reviewing pharmacy residency applications, PGY1 RPDs prioritize the CV, followed by letters of recommendation and letter of intent. These findings could be used by RPDs when assessing current scoring rubrics and may help to inform the efforts of students and letter of recommendation writers when preparing individual components of an application.