Introduction
The participant's self-perception of a training is indicative of the achievement of its objectives, but the functionality and applicability of the instrument used to evaluate it must be submitted to a process of qualitative and quantitative analysis. Simulation is an experiential and collaborative training methodology, generally multidimensional and costly, which requires reliable instruments to assess its effectiveness. This study describes the process to create and validate a survey to assess the opinion of participants in a learning activity with simulation methodology.
Method
The process included a qualitative phase with two stages for obtaining content evidence, responses from an internal (n = 6) and external (n = 15) expert committee, and administration of the instrument to participants on three occasions (n = 10; n = 104; n = 446), as well as analysis in a focus group of participants (n = 35) regarding the structure, comprehension, and content. This phase also included a quantitative phase with psychometric analysis for the adjustment and measurement of the instrument.
Results
After the process, a final survey was obtained with 24 questions with answers from 4 ordinal categorical categories, which shows a unidimensional internal structure of 71.1% of the total variance. The model fit indices were χ2 = 123.936 (p < 0.001), d.f. = 48.67; RMSEA = 0.00; CFI = 1.00; TLI = 1.00. It showed correlation with other variables (r = 0.7) and reliability of α = 0,963 (0.957–0.967); ω = 0.963 (0.955–0.970).
Conclusion
The combination of qualitative and quantitative methods made it possible to refine the instrument and detect method errors to readjust the instrument without affecting its representativeness. The survey is valid for students and professionals to assess the effectiveness of training simulation sessions, and to detect opportunities for improve them.
扫码关注我们
求助内容:
应助结果提醒方式:
