Study goals: It is known that the manifold limitations of oral and practical examinations can be improved by specific training. With the help of an online survey, our present study analyzes the effects that can be achieved by the training conducted at the University of Ulm for examiners in the final medical examination, the long-lasting impact of the training, and differences among participant subgroups.
Method: All 367 participants in the training at Ulm (2007- 2012) were contacted via email. Sixty-three persons responded to the survey that included 28 items concerning demographic data, effectiveness, and sustainability.
Results: Six main effects of the training were identified (meaning effects rated with a grade of 1 or 2 on a 6-point scale by two thirds of the participants, with 1="applicable" and 6="not applicable"; cumulated percentage of answers of 1 or 2 in parentheses): 1. Conscious handling of strengths and weaknesses of oral examinations (71%), 2. Knowledge of factors contributing to the reliability of oral/practical examinations (76%), 3. Knowledge of factors contributing to the validity of oral/practical examinations (75%), 4. Improvement of competence in task construction (68%), 5. Improvement of competence in respect to examination formalities (75%), 6. Implementation of the concept of "structured oral examinations" (a priori planning of examination subjects, tasks, levels of expectation and grading criteria) (86%). The responses of participants trained more than two years ago were not significantly different from the answers given by recently trained persons. This is an argument for the sustainability of the training effects. Furthermore, participants without relevant prior experience in oral/practical examinations profited significantly more from the trainings, especially in the areas of stress reduction, confidence in grading, and competence in critical discrimination of grading.
Conclusion: The positive and sustained effects of the examiner training argue for continuing the training program, especially for inexperienced examiners. Expansion of the successful training program to include the first medical exam should be considered.
Background: Regular student evaluations at the Technical University Munich indicate the necessity for improvement of the clinical examination course. The aim of this study was to examine if targeted measures to restructure and improve a clinical examination course session lead to a higher level of student satisfaction as well as better self-assessment of the acquired techniques of clinical examination.
Methods: At three medical departments of the Technical University Munich during the 2010 summer semester, the quantitative results of 49 student evaluations (ratings 1-6, German scholastic grading system) of the clinical examination course were compared for a course before and a course after structured measures for improvement. These measures included structured teaching instructions, handouts and additional material from the Internet.
Results: 47 evaluations were completed before and 34 evaluations after the measures for improvement. The measures named above led to a significant improvement of the evaluative ratings in the following areas: short introduction to the topic of each clinical examination course (from 2.4±1.2 to1.7±1.0; p=0.0020) and to basic measures of hygiene (from 3.8±1.9 to 2.5±1.8; p=0.004), structured demonstration of each clinical examination step (from 2.9±1.5 to 1.8±1.0; p=0.001), sufficient practice of each clinical examination step (from 3.1±1.8 to 2.2±1.4; p=0.030) structured feedback on each clinical examination step (from 3.0±1.4 to 2.3±1.0; p=0.0070), use of handouts (from 5.2±1.4 to 1.8±1.4; p<0.001), advice on additional learning material (from 5.0±1.4 to 3.4±2.0; p<0.001), general learning experience (from 2.4±0.9 to 1.9±0.8; p=0.017), and self-assessment of the acquired techniques of clinical examination (from 3.5±1.3 to 2.5±1.1; p<0.01).
Conclusion: Structured changes led to significant improvement in the evaluative ratings of a clinical examination course session concerning preparation of the tutors, structure of the course, and confidence in performing physical examinations.
Unlabelled: BACKGROUND/GOAL: Neurology is rated as one of the most difficult specialties by medical students, as well as by medical practitioners in other areas. Team-based learning (TBL) as a method of active and group-based learning seems to be a suitable method to achieve greater learning success and a better understanding of neurology.
Methods: The TBL neurology course was designed as a supplemental program within the regular neurology course for third-year medical students. This supplemental course consisted of six 90-minute units as a pilot study during the 2011-12 winter semester and was evaluated in terms of time and effort. The acceptance of the TBL concept in general, as well as of the TBL neurology course in particular, was assessed using written evaluations. The results of the final exam were analyzed with regard to participation in TBL and the content imparted therein.
Results: The preparation time was approximately 8 hours per unit. The implementation was without difficulty. The high rate of regular attendance and the consistently very positive evaluation results indicated a high acceptance of the TBL concept in general, as well as of the TBL neurology course in particular. TBL participants displayed better results on the final exam in topics also covered in the TBL units.
Conclusion: The resulting achievement of a subjectively better understanding and a simultaneously higher level of interest in neurology justified the one-time, relatively intense preparation effort for TBL. The high acceptance among students inexperienced in teamwork suggests an unproblematic transfer to other preclinical or clinical courses. The impact on measurably improved results in clinical reasoning and problem-solving skills should be further investigated in the context of controlled studies.
The German graduate medical education system is going through an important phase of changes. Besides the ongoing reform of the national guidelines for graduate medical education (Musterweiterbildungsordnung), other factors like societal and demographic changes, health and research policy reforms also play a central role for the future and competitiveness of graduate medical education. With this position paper, the committee on graduate medical education of the Society for Medical Education (GMA) would like to point out some central questions for this process and support the current discourse. As an interprofessional and interdisciplinary scientific society, the GMA has the resources to contribute in a meaningful way to an evidence-based and future-oriented graduate medical education strategy. In this position paper, we use four key questions with regards to educational goals, quality assurance, teaching competence and policy requirements to address the core issues for the future of graduate medical education in Germany. The GMA sees its task in contributing to the necessary reform processes as the only German speaking scientific society in the field of medical education.
Unlabelled: The standardized training of practical competences in skills labs is relatively new among German Medical Faculties. The broad acceptance and outstanding evaluation results do not provide objective data on the efficiency and cost-efficiency of these trainings. This study aims on the quantification of the teaching effect of the surgical scrubbing technique EN1500 and its comparison with clinical references of OR personnel.
Methods: 161 4(th) year medical students were randomized into intervention and control group. The intervention group received a 45 minute standardized peer-teaching training of practical competences necessary in the OR including the scrubbing according to EN1500. Fluorescence dye was mixed in the disinfectant solution. After hand disinfection, standardized fotographs and semi-automated digital processing resulted in quantification of the insufficiently covered hand area. These results were compared with the control group that received the training after the test. In order to provide information on the achieved clinical competence level, the results were compared with the two clinical reference groups.
Results: The intervention group remained with 4,99% (SD 2,34) insufficiently covered hand area after the training compared to the control group 7,33% (SD 3,91), p<0,01. There was no significant difference between control group and reference groups: surgeons 9,32% (SD 4,97), scrub nurses 8,46% (SD 4,66). The student intervention group showed results that were significantly better than the clinical references. The methodic mistake remained negligible. In the sub-group analysis, the students with low or medium experience in surgical scrubbing and hand disinfection derived highest benefit from the training, whereas students with no or high experience did benefit less. All participants showed better results on hand palms compared to back of hand areas.
Discussion: A single standardized peer-teaching of surgical scrubbing and hand disinfection according to EN1500 is sufficient to improve the measurable coverage of hand area and reduce the disinfection gap by 1/3. In absolute measures, the competence level of experienced surgeons and scrub nurses is achieved or even exceeded.
Since 1986 medical students at the University Children's Hospital Essen are trained as peers in a two week intensive course in order to teach basic paediatric examination techniques to younger students. Student peers are employed by the University for one year. Emphasis of the peer teaching program is laid on the mediation of affective and sensomotorical skills e.g. get into contact with parents and children, as well as manual paediatric examination techniques. The aim of this study is to analyse whether student peers are able to impart specific paediatric examination skills as good as an experienced senior paediatric lecturer. 123 students were randomly assigned to a group with either a senior lecturer or a student peer teacher. Following one-hour teaching-sessions in small groups students had to demonstrate the learned skills in a 10 minute modified OSCE. In comparison to a control group consisting of 23 students who never examined a child before, both groups achieved a significantly better result. Medical students taught by student peers almost reached the same examination result as the group taught by paediatric teachers (21,7±4,1 vs. 22,6±3,6 of 36 points, p=0,203). Especially the part of the OSCE where exclusively practical skills where examined revealed no difference between the two groups (7,44±2,15 vs. 7,97±1,87 of a maximum of 16 points, p=0,154). The majority of students (77%) evaluated peer teaching as stimulating and helpful. The results of this quantitative teaching study reveal that peer teaching of selected skills can be a useful addition to classical paediatric teaching classes.