Xuelan Qiu, Sheng-Yun Huang, Wen-Chung Wang, You-Gan Wang
{"title":"lz上用于检测异常响应的迭代规模纯化程序。","authors":"Xuelan Qiu, Sheng-Yun Huang, Wen-Chung Wang, You-Gan Wang","doi":"10.1080/00273171.2023.2211564","DOIUrl":null,"url":null,"abstract":"<p><p>Many person-fit statistics have been proposed to detect aberrant response behaviors (e.g., cheating, guessing). Among them, <i>l</i><sub>z</sub> is one of the most widely used indices. The computation of <i>l</i><sub>z</sub> assumes the item and person parameters are known. In reality, they often have to be estimated from data. The better the estimation, the better <i>l</i><sub>z</sub> will perform. When aberrant behaviors occur, the person and item parameter estimations are inaccurate, which in turn degrade the performance of <i>l</i><sub>z</sub>. In this study, an iterative procedure was developed to attain more accurate person parameter estimates for improved performance of <i>l</i><sub>z</sub>. A series of simulations were conducted to evaluate the iterative procedure under two conditions of item parameters, known and unknown, and three aberrant response styles of difficulty-sharing cheating, random-sharing cheating, and random guessing. The results demonstrated the superiority of the iterative procedure over the non-iterative one in maintaining control of Type-I error rates and improving the power of detecting aberrant responses. The proposed procedure was applied to a high-stake intelligence test.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"62-77"},"PeriodicalIF":5.3000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Iterative Scale Purification Procedure on <i>l</i><sub>z</sub> for the Detection of Aberrant Responses.\",\"authors\":\"Xuelan Qiu, Sheng-Yun Huang, Wen-Chung Wang, You-Gan Wang\",\"doi\":\"10.1080/00273171.2023.2211564\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Many person-fit statistics have been proposed to detect aberrant response behaviors (e.g., cheating, guessing). Among them, <i>l</i><sub>z</sub> is one of the most widely used indices. The computation of <i>l</i><sub>z</sub> assumes the item and person parameters are known. In reality, they often have to be estimated from data. The better the estimation, the better <i>l</i><sub>z</sub> will perform. When aberrant behaviors occur, the person and item parameter estimations are inaccurate, which in turn degrade the performance of <i>l</i><sub>z</sub>. In this study, an iterative procedure was developed to attain more accurate person parameter estimates for improved performance of <i>l</i><sub>z</sub>. A series of simulations were conducted to evaluate the iterative procedure under two conditions of item parameters, known and unknown, and three aberrant response styles of difficulty-sharing cheating, random-sharing cheating, and random guessing. The results demonstrated the superiority of the iterative procedure over the non-iterative one in maintaining control of Type-I error rates and improving the power of detecting aberrant responses. The proposed procedure was applied to a high-stake intelligence test.</p>\",\"PeriodicalId\":53155,\"journal\":{\"name\":\"Multivariate Behavioral Research\",\"volume\":\" \",\"pages\":\"62-77\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Multivariate Behavioral Research\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1080/00273171.2023.2211564\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/6/1 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"MATHEMATICS, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Multivariate Behavioral Research","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/00273171.2023.2211564","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/6/1 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"MATHEMATICS, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
An Iterative Scale Purification Procedure on lz for the Detection of Aberrant Responses.
Many person-fit statistics have been proposed to detect aberrant response behaviors (e.g., cheating, guessing). Among them, lz is one of the most widely used indices. The computation of lz assumes the item and person parameters are known. In reality, they often have to be estimated from data. The better the estimation, the better lz will perform. When aberrant behaviors occur, the person and item parameter estimations are inaccurate, which in turn degrade the performance of lz. In this study, an iterative procedure was developed to attain more accurate person parameter estimates for improved performance of lz. A series of simulations were conducted to evaluate the iterative procedure under two conditions of item parameters, known and unknown, and three aberrant response styles of difficulty-sharing cheating, random-sharing cheating, and random guessing. The results demonstrated the superiority of the iterative procedure over the non-iterative one in maintaining control of Type-I error rates and improving the power of detecting aberrant responses. The proposed procedure was applied to a high-stake intelligence test.
期刊介绍:
Multivariate Behavioral Research (MBR) publishes a variety of substantive, methodological, and theoretical articles in all areas of the social and behavioral sciences. Most MBR articles fall into one of two categories. Substantive articles report on applications of sophisticated multivariate research methods to study topics of substantive interest in personality, health, intelligence, industrial/organizational, and other behavioral science areas. Methodological articles present and/or evaluate new developments in multivariate methods, or address methodological issues in current research. We also encourage submission of integrative articles related to pedagogy involving multivariate research methods, and to historical treatments of interest and relevance to multivariate research methods.