Bruna Moreno Dias , Lúcia Marta Giunta da Silva , Pedro Tadao Hamamoto Filho , Valdes Roberto Bollela , Carmen Silvia Gabriel
{"title":"Development of qualified items for nursing education assessment: The progress testing experience","authors":"Bruna Moreno Dias , Lúcia Marta Giunta da Silva , Pedro Tadao Hamamoto Filho , Valdes Roberto Bollela , Carmen Silvia Gabriel","doi":"10.1016/j.nepr.2024.104199","DOIUrl":null,"url":null,"abstract":"<div><h3>Aim</h3><div>To analyze the psychometric characteristics of items in the nursing inter-institutional progress testing for the years 2019, 2021, 2022 and 2023.</div></div><div><h3>Background</h3><div>Progress testing is a validated method for evaluating professional undergraduate education, aimed at identifying knowledge gain in a continuous and progressive manner, with potential benefits for nursing education. However, for its results to be useful, the evaluation items used in the test must have good psychometric performance.</div></div><div><h3>Design</h3><div>A cross-sectional study.</div></div><div><h3>Methods</h3><div>A sample of 377 items (multiple-choice questions) was applied to 4678 students in four years of progress testing. The difficulty and discrimination indexes were analyzed using descriptive statistics, ANOVA and simple linear regression.</div></div><div><h3>Results</h3><div>The average difficulty index of the test items ranged between 0.39 and 0.46. The areas of child and adolescent health, women's health and adult health had the most difficult items, while the areas of management, mental health and public health had the least difficult items. Discrimination index ranged from 0.35 to 0.43. There was a difference between discrimination index between the years of application (p < 0.001), with a significant increase in the discrimination index (p < 0.001) in the trend analysis. Students in the final years showed lower levels of difficulty and discrimination when compared with students in the initial years, demonstrating that the test is easier and there is less dispersion of performance among students in the final years.</div></div><div><h3>Conclusions</h3><div>The items are not difficult and have good discrimination. A gradual annual increase in the discrimination index of the items was observed. This study provides useful information for the psychometric analysis and quality assurance of knowledge assessment items, both for the implementation of similar PT experiences and in the use of multiple-choice questions for other knowledge assessment purposes.</div></div>","PeriodicalId":48715,"journal":{"name":"Nurse Education in Practice","volume":"81 ","pages":"Article 104199"},"PeriodicalIF":3.3000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nurse Education in Practice","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1471595324003287","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NURSING","Score":null,"Total":0}
引用次数: 0
Abstract
Aim
To analyze the psychometric characteristics of items in the nursing inter-institutional progress testing for the years 2019, 2021, 2022 and 2023.
Background
Progress testing is a validated method for evaluating professional undergraduate education, aimed at identifying knowledge gain in a continuous and progressive manner, with potential benefits for nursing education. However, for its results to be useful, the evaluation items used in the test must have good psychometric performance.
Design
A cross-sectional study.
Methods
A sample of 377 items (multiple-choice questions) was applied to 4678 students in four years of progress testing. The difficulty and discrimination indexes were analyzed using descriptive statistics, ANOVA and simple linear regression.
Results
The average difficulty index of the test items ranged between 0.39 and 0.46. The areas of child and adolescent health, women's health and adult health had the most difficult items, while the areas of management, mental health and public health had the least difficult items. Discrimination index ranged from 0.35 to 0.43. There was a difference between discrimination index between the years of application (p < 0.001), with a significant increase in the discrimination index (p < 0.001) in the trend analysis. Students in the final years showed lower levels of difficulty and discrimination when compared with students in the initial years, demonstrating that the test is easier and there is less dispersion of performance among students in the final years.
Conclusions
The items are not difficult and have good discrimination. A gradual annual increase in the discrimination index of the items was observed. This study provides useful information for the psychometric analysis and quality assurance of knowledge assessment items, both for the implementation of similar PT experiences and in the use of multiple-choice questions for other knowledge assessment purposes.
期刊介绍：
Nurse Education in Practice enables lecturers and practitioners to both share and disseminate evidence that demonstrates the actual practice of education as it is experienced in the realities of their respective work environments. It is supportive of new authors and will be at the forefront in publishing individual and collaborative papers that demonstrate the link between education and practice.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
