Empirical Research in Vocational Education and Training最新文献

This study seeks to investigate the association between distinct tracks of secondary education—namely, vocational school (Sekolah Menengah Kejuruan, SMK) and general school (Sekolah Menengah Atas, SMA)—and two key labor market outcomes: the duration required for graduates to attain their initial employment and their resilience in the face of pandemic, as measured by changes in average monthly income. While the former sheds light on the outcome under typical circumstances, the latter offers valuable insights into the outcome during periods of crisis. Focused on Indonesia, this research employs Heckman two-step model alongside ordinary least square (OLS) for the first outcome and ordered probit regression for the second. The research draws upon data extracted from the 2021 National Labor Force Survey (Survey Angkatan Kerja Nasional, SAKERNAS). Our results suggest that SMK provides an advantage in securing initial employment compared to SMA, with SMK graduates entering the workforce earlier than their counterparts. Moreover, in terms of resilience during the pandemic, as evidenced by changes in income, SMK graduates exhibit greater resilience, with a higher likelihood of maintaining or even increasing their income compared to SMA graduates. These findings offer valuable implications for both theoretical understanding and practical considerations.

Background

Authentic situations are considered a source of learning due to their real world relevance. This can encourage learners to acquire new knowledge. Increasing digitisation and associated resources, such as professional development opportunities for teachers, technology tools, or digital equipment for schools enable the development and implementation of authentic assessments. The basic academic principles for acquiring economic literacy are already provided in lower secondary school. This article examines, using the example of a new authentic technology-based assessment (TBA)—Economic Literacy—Assessing the Status Quo in Grade 8 (ECON 2022) -, the processes involved in constructing a TBA. The purpose is to develop a curricular valid measurement instrument for surveying the current state of economic literacy in the 8th grade of a German federal state. This study explores which economic competencies students—typically between 14 and 15 years of age—possess in Grade 8, and what level of competence can therefore be expected of them at the beginning of a vocational training programme. The assessment is geared toward the curriculum of the subject of economics and is based on a domain model. This article presents the background and construction process for the development of ECON 2022 as a TBA.

Methods

To check the validity of test construction with a focus on the implementation of the authentic assessment and an analysis of difficulty-generating characteristics, the ECON 2022 test items were validated with an expert survey (N = 25). The two-stage data analysis comprised a descriptive quantifying analysis of the rating from the difficulty-generating characteristics specificity, cognitive demand and modelling and the design criterion authenticity. A set of experts rated the criteria. The expert survey was then compared with a previously conducted rating by the research team. The analysis of free-text comments on individual items was carried out discursively and qualitatively by the research team. Both sources of information were used to adapt the test items to measured item difficulties from the field test. For this purpose, items of great difficulty were changed to slightly easier items. In this context, the paper focuses on two central research questions: - How does the authenticity of a test environment relate to difficulty-generating criteria at item level? - Does the authenticity of a test environment have an impact on test results?

Results

Results are as follows. (1) The ECON 2022 assessment offers an example of a test design in which the use of TBAs can support innovative and interactive item development. (2) Using the ECON 2022 assessment enabled the implementation of an assessment of economic literacy using authentic situations and the mapping of different facets of economic competence. (

Based on the social cognitive model and on the psychology of working theory, this research aims to study the job and life satisfaction of apprentices, considering proactive personality, person-supervisor and person-group fit, occupational self-efficacy, and decent work as antecedents. The participants were 530 Swiss apprentices enrolled in a three-year VET program with the Federal VET Diploma. The results show that proactivity is directly linked with person-supervisor and person-group fit, occupational self-efficacy, and job and life satisfaction. Decent work is related positively with job satisfaction. Person-supervisor and person-group fit seem to directly influence occupational self-efficacy. Decent work, in turn, seems to mediate the relationship between person-supervisor and person-group fit and job satisfaction. In conclusion, this study suggests that encouraging apprentices’ proactivity, person-supervisor and person-group fit at work could be crucial to improving their perceptions of decent work and increasing their job and life satisfaction.

In the present study, we recorded the eye movements of 20 criterion-based selected trainee teachers in economics while they responded to 25 single choice (SC) items in an economic content knowledge (CK) test and rated their confidence for each response in a digital assessment. By using a multilevel modeling approach with crossed random effects, we confirmed prior findings from eye-tracking research on SC tests, which showed longer dwell time on the correct response options (attractor) and shorter dwell time on the distractors are positively linked to correct options. Furthermore, we identified an additional effect on dwell time on the attractor in a moderator model with participants who highly rated their confidence for correct response options. Thus, we identified a specific role of students’ confidence in their CK on the gaze bias effect. We interpret these results in terms of students’ actual understanding of test contents from assessments of their professional knowledge and draw implications for further research and teacher education.

Abstract

After more than 50 years of research on drop-out from Vocational Education and Training (VET), databases provide vast amounts of drop-out studies from around the globe that entail hundreds of potential drop-out factors. However, many scholars tend to explore the topic without detailed and theoretically grounded foundation. Several diverging research foci exist within the research field of drop-out from VET: Studies differ with regard to the analysed phase of drop-out (development, decision-making, paths after dropping out), the applied sample perspective (learners, educators, further stakeholders), and the overall research perspective that is applied based on a specific theoretical approach. Given the range of drop-out factors, stakeholders, and possible theoretical approaches within studies, this article aims at organising the research on the multi-facetted phenomenon for future endeavours by presenting a framework model that comprises a three-step recommendation: First, the model illustrates different phases (Development-, Decision-, Adjustment-Phase) of drop-out research that should be differentiated. Second, it is argued that the chosen sample perspective is highly relevant for drop-out research and must be chosen carefully. Third, the overarching disciplinary research perspectives on drop-out from VET, which scholars may adopt within their research, entail particular relevant variables and focal points and should therefore be discussed. Four examples of research perspectives (economical, psychological, sociological, pedagogical) are briefly presented, structured on a micro-, meso- and macro-level, to exemplify different theoretical accesses to drop-out research. Throughout the article, the novel organisation framework is explained and exemplified by illustrating relevant aspects of each research area and exemplary literature. The presented framework will help organising the research field and enable scholars to delimit their work more precisely, leading to a more traceable structure of further research efforts and more significant contributions to the state of knowledge.

We investigated the ecological validity of performance measures from a computer-based assessment tool that utilises scripted video vignettes. The intended purpose of this tool is to assess the maintenance and repair skills of automotive technician apprentices, complementing traditional hands-on assessment formats from the German journeymen’s exams. We hypothesise that the ability to correctly judge repair actions shown in videos is a good predictor of the ability to perform corresponding actions in hands-on scenarios. Apprentices in the third year of vocational training carried out repairs on real cars or car systems, while experts rated their performance. After this, they worked on our computer-based tests, which utilise videos of very similar repairs. The correlation between video judgement and hands-on performance was lower than expected for most repair actions as well as for overall scores, indicating insufficient ecological validity of the test score interpretations. However, the findings are promising for developing future tests, as the results for some repair actions indicate it is generally possible to develop ecologically valid video-based items focusing on hands-on skills. We discuss the results in the light of a validation framework that combines validity evidence from different sources for the same assessment tool. Finally, we hope our findings contribute to a broader discussion about the psychometric quality of exams.