Evaluation & the Health Professions最新文献

Objective Structured Clinical Examinations (OSCEs) and written tests are commonly used to assess health professional students, but it remains unclear whether the additional human resources and expenses required for OSCEs, both in-person and online, are worthwhile for assessing competencies. This scoping review summarized literature identified by searching MEDLINE and EMBASE comparing 1) OSCEs and written tests and 2) in-person and online OSCEs, for assessing health professional trainees' competencies. For Q1, 21 studies satisfied inclusion criteria. The most examined health profession was medical trainees (19, 90.5%), the comparison was most frequently OSCEs versus multiple-choice questions (MCQs) (18, 85.7%), and 18 (87.5%) examined the same competency domain. Most (77.5%) total score correlation coefficients between testing methods were weak (r < 0.40). For Q2, 13 articles were included. In-person and online OSCEs were most used for medical trainees (9, 69.2%), checklists were the most prevalent evaluation scheme (7, 63.6%), and 14/17 overall score comparisons were not statistically significantly different. Generally low correlations exist between MCQ and OSCE scores, providing insufficient evidence as to whether OSCEs provide sufficient value to be worth their additional cost. Online OSCEs may be a viable alternative to in-person OSCEs for certain competencies where technical challenges can be met.

The balance of lifelong learning with assessment for continued certification is a challenge faced by healthcare professions. The value of single-point-in-time assessments has been questioned, and a shift to longitudinal assessments (LA) has been undertaken to assess lifelong learning over-time. This scoping review was conducted to inform healthcare certifying organizations who are considering LA as an assessment tool of competence and lifelong learning in healthcare professionals. A search of 6 databases and grey literature yielded 957 articles. After screening and removal of duplicates, 14 articles were included. Most articles were background studies informing the underpinnings of LA in the form of progress testing, pilot studies, and process of implementation. Progress testing is used in educational settings. Pilot studies reported satisfaction with LA's ease of use, online format, and provision of lifelong learning. Implementation processes reveal that key aspects of success include stakeholder participation, phased rollout, and a publicly available content outline. Initial outcomes data affirm that LA addresses knowledge gaps, and results in improved performance on maintenance of certification exams. Future research is needed to substantiate validity evidence of LA and its correlation with high-stakes exam performance when assessing lifelong learning and continued competence of healthcare professionals over time.

The listserv, although considered old technology by some, continues to show benefit for and growth in subscribers. We investigated the roles the DR-ED listserv plays within the medical education community. We asked, Who subscribes? Why do they subscribe? and How do they use the listserv? We conducted a mixed-methods evaluation of the DR-ED listserv based on message content analysis and user surveys. We found the DR-ED listserv fulfills medical educators' need to network collegially; keep current with issues and ideas in the field; share solutions to problems; share resources; and advertise development opportunities. We found two types of listserv engagement: a) one-way engagement by using it as a resource, or two-way engagement by using and sharing resources. Our findings also highlight the value users attribute to virtual resources and the role listservs can play as economical professional development in a time of constrained costs, and our analysis methods can be used to guide future listserv evaluations. We conclude the relatively easy access to a global medical education listserv is one strategy to create a community of practice for medical education practitioners.

The study aimed to analyze the psychometric properties of a newly developed Chinese screening tool, the Chinese Version of the Speech Disorders in Parkinson's Disease Questionnaire (SDPD-C). The SDPD-C contains a 24-item questionnaire with four assessment domains. Overall, 93 patients with idiopathic Parkinson's disease (PD) (age 70.1 ± 8.9 years) and 76 healthy older adults (age 67.2 ± 8.1 years) participated in the psychometric analysis study. The internal consistency of the SDPD-C was .91 (four dimensions: .69-.85), and test-retest reliability was .91 (four dimensions: .85-.88). The SDPD-C was highly correlated with the Voice Handicap Index-10 and Movement Disorder Society-Unified Parkinson's Disease Rating Scale II 2.1 (r = .83 and .78, respectively). The SDPD-C scores also differed significantly between stages 1 and 4 of the Hoehn and Yahr Scale (p < .05). The area under the receiver operating characteristic curve was .955 (95% confidence interval, .927-.983; asymptotic significance p < .001), and the optimal cut-off score of this study was 36, with a sensitivity of .849 and specificity of .947. The results indicate that SDPD-C showed good reliability, validity, accuracy, and discrimination. It can be used as a screening tool for speech disorders in patients with PD.

The JHand is an easy-to-understand questionnaire that includes questions that exclude hand dominance. It was developed to evaluate patients with hand and elbow disorders. However, JHand has not been translated and validated in the Turkish language. The aim of this study is to investigate the psychometric properties of the culturally adapted Turkish version of the JHand for Turkish patients. A total of 262 patients were included in the study. JHand, Disabilities of the Arm, Shoulder, and Hand Questionnaire, and Hand20 were used to evaluate patients. Internal consistency and test-retest analyses were applied to determine the reliability of the Turkish version of the JHand. Confirmatory factor analysis and similar scale validity were used to determine its validity. The Turkish version of the JHand showed high levels of internal consistency and excellent test-retest reliability (Cronbach α = 0.907, ICC = 0.923). The model fit indices of the Turkish version of the JHand had good and acceptable fit with reference values. Statistically positive and very strong correlations were found between JHand and DASH (r = .825, p < .001) as well as the JHand and Hand20 (r = .846, p < .001). The Turkish version of the JHand had excellent internal consistency and test-retest reliability as well as a high level of validity.

The Patient Activation Measure (PAM) is a 13-item questionnaire that assesses patients' knowledge, skills, and confidence in self-management. The current study aimed to translate the American version of the PAM-13 into Persian and test the psychometric properties of the Persian version among chronic patients. This cross-sectional study was conducted on 438 chronically ill patients in Rafsanjan, Iran from May to November 2019. The American version of the PAM-13 was translated into Persian using a standardized forward-backward translation method. Internal consistency, test-retest reliability, face and content validity, as well as construct validity (structural and convergent validity) were all assessed. The content validity index of the Patient Activation Measure-13 Persian (PAM-13-P) was 0.91. Exploratory and confirmatory factor analyses showed that the PAM-13-P had a meaningful structural validity. The PAM-13-P scores were negatively correlated with the Partner in Health Measure (PIH) (r = -0.29, p < 0.001). In addition, the PAM13-P scores were positively correlated with the Satisfaction with Life Scale (SWLS) (r = 0.31, p < 0.001). The internal consistency was 0.88, and the repeatability was excellent [Intraclass Correlation Coefficient (ICC):0.96 and confidence interval (CI): 0.94-0.98]. This study demonstrates that the PAM-13-P is a reliable and valid measure for assessing activation among chronically ill patients. The PAM-13-P scale assesses the level of self-management of chronic patients and identifies appropriate care strategies to meet their needs.

This study evaluates the psychometric properties of the Access of Older Adults to Outpatient Primary-Care Health Services Scale (AOAOPHSS), in research conducted among 707 Mexican older adults selected by convenience from 14 rural and one urban locations. The AOAOPHSS explores 10 dimensions of two integrated subscales: Accessibility and Personal Abilities. Data analysis was performed in five phases. First, potentially biased responses were identified. Second, the response efficiency of the items and their association with external variables were evaluated. Third, the basic properties of the scores for the subscales' dimensions of the AOAOPHSS were identified using non-parametric Mokken Scaling Analysis (MSA). Fourth, the Structural Equation Modeling methodology was used to identify the properties of the internal structure of the latent construct. Finally, reliability and internal consistency were evaluated at both score and item levels. The following findings emerged. 13 items with inefficient response options were removed, and 24 were retained using the MSA. The latent structure of the latter was defined based on 21 items of five Accessibility Subscale dimensions. Its internal consistency reliability ranged between 0.67 and 0.81 (omega coefficients) and between 0.61 and 0.78 (alpha coefficients). Accordingly, this paper discusses the overall implications of using the Accessibility Subscale.

The Pain Resilience Scale (PRS) is a useful tool that evaluates behavioral engagement and adaptively regulates cognitions and emotions despite the pain. This study aimed to translate the PRS to Turkish and investigate its psychometric properties. The Turkish version of PRS was completed online by 332 healthy adults, and a subset of 105 respondents was re-assessed after 7-14 days. The reliability of the adapted measure was evaluated in terms of internal consistency, relative, and absolute test-retest reliability. Validity was evaluated in terms of structural, construct, and known-group validity using positive and negative psychological scales. The Turkish version of PRS has a three-factor structure and its cumulative variance is 78.06%. The total PRS score and its subscales correlated positively with pain self-efficacy, general resilience, and quality of life, and negatively with pain catastrophizing, kinesiophobia, anxiety, depression, and disability. The PRS scores were significantly higher in those with high general resilience (p < 0.001). The PRS had high internal consistency and test-retest reliability. Standard Error of Measurement (SEM) and Minimum Detectable Difference (MDD) were calculated as 2.9 and 8.0, respectively. The Turkish version of PRS is a reliable and valid instrument for measuring pain resilience in terms of behavioral perseverance and cognitive positivity.