Pub Date : 2024-09-10DOI: 10.1080/08957347.2024.2386935
John R. Donoghue, Carol Eckerly
Trend scoring constructed response items (i.e. rescoring Time A responses at Time B) gives rise to two-way data that follow a product multinomial distribution rather than the multinomial distributi...
趋势计分的构建式反应项目(即在时间 B 对时间 A 的反应重新计分)会产生遵循乘积多叉分布的双向数据,而不是遵循多叉分布的双向数据。
{"title":"New Tests of Rater Drift in Trend Scoring","authors":"John R. Donoghue, Carol Eckerly","doi":"10.1080/08957347.2024.2386935","DOIUrl":"https://doi.org/10.1080/08957347.2024.2386935","url":null,"abstract":"Trend scoring constructed response items (i.e. rescoring Time A responses at Time B) gives rise to two-way data that follow a product multinomial distribution rather than the multinomial distributi...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"156 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142255831","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-19DOI: 10.1080/08957347.2024.2386945
Brian E. Clauser, Victoria Yaneva, Peter Baldwin, Le An Ha, Janet Mee
Multiple-choice questions have become ubiquitous in educational measurement because the format allows for efficient and accurate scoring. Nonetheless, there remains continued interest in constructe...
{"title":"Automated Scoring of Short-Answer Questions: A Progress Report","authors":"Brian E. Clauser, Victoria Yaneva, Peter Baldwin, Le An Ha, Janet Mee","doi":"10.1080/08957347.2024.2386945","DOIUrl":"https://doi.org/10.1080/08957347.2024.2386945","url":null,"abstract":"Multiple-choice questions have become ubiquitous in educational measurement because the format allows for efficient and accurate scoring. Nonetheless, there remains continued interest in constructe...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"127 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142191282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-14DOI: 10.1080/08957347.2024.2386933
Chunyan Liu, Raja Subhiyah, Richard A. Feinberg
Mixed-format tests that include both multiple-choice (MC) and constructed-response (CR) items have become widely used in many large-scale assessments. When an item response theory (IRT) model is us...
{"title":"Impact of violating unidimensionality on Rasch calibration for mixed-format tests","authors":"Chunyan Liu, Raja Subhiyah, Richard A. Feinberg","doi":"10.1080/08957347.2024.2386933","DOIUrl":"https://doi.org/10.1080/08957347.2024.2386933","url":null,"abstract":"Mixed-format tests that include both multiple-choice (MC) and constructed-response (CR) items have become widely used in many large-scale assessments. When an item response theory (IRT) model is us...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"08 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142191284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-14DOI: 10.1080/08957347.2024.2386939
Jianbin Fu, Xuan Tan, Patrick C. Kyllonen
A process is proposed to create the one-dimensional expected item characteristic curve (ICC) and test characteristic curve (TCC) for each trait in multidimensional forced-choice questionnaires base...
{"title":"Item and Test Characteristic Curves of Rank-2PL Models for Multidimensional Forced-Choice Questionnaires","authors":"Jianbin Fu, Xuan Tan, Patrick C. Kyllonen","doi":"10.1080/08957347.2024.2386939","DOIUrl":"https://doi.org/10.1080/08957347.2024.2386939","url":null,"abstract":"A process is proposed to create the one-dimensional expected item characteristic curve (ICC) and test characteristic curve (TCC) for each trait in multidimensional forced-choice questionnaires base...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"5 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142191283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-14DOI: 10.1080/08957347.2024.2386932
Yi-Hsuan Lee, Yue Jia
Test-taking experience is a consequence of the interaction between students and assessment properties. We define a new notion, rapid-pacing behavior, to reflect two types of test-taking experience ...
{"title":"Can Adaptive Testing Improve Test-Taking Experience? A Case Study on Educational Survey Assessment","authors":"Yi-Hsuan Lee, Yue Jia","doi":"10.1080/08957347.2024.2386932","DOIUrl":"https://doi.org/10.1080/08957347.2024.2386932","url":null,"abstract":"Test-taking experience is a consequence of the interaction between students and assessment properties. We define a new notion, rapid-pacing behavior, to reflect two types of test-taking experience ...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"9 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142191285","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-05DOI: 10.1080/08957347.2024.2386934
Joshua B. Gilbert, James S. Kim, Luke W. Miratrix
Longitudinal models typically emphasize between-person predictors of change but ignore how growth varies within persons because each person contributes only one data point at each time. In contrast...
{"title":"Leveraging Item Parameter Drift to Assess Transfer Effects in Vocabulary Learning","authors":"Joshua B. Gilbert, James S. Kim, Luke W. Miratrix","doi":"10.1080/08957347.2024.2386934","DOIUrl":"https://doi.org/10.1080/08957347.2024.2386934","url":null,"abstract":"Longitudinal models typically emphasize between-person predictors of change but ignore how growth varies within persons because each person contributes only one data point at each time. In contrast...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"34 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141944491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-28DOI: 10.1080/08957347.2024.2345597
Marcelo Andrade da Silva, A. Corinne Huggins-Manley, Jorge Luis Bazán, Amber Benedict
A Q-matrix is a binary matrix that defines the relationship between items and latent variables and is widely used in diagnostic classification models (DCMs), and can also be adopted in multidimensi...
{"title":"A Method of Empirical Q-Matrix Validation for Multidimensional Item Response Theory","authors":"Marcelo Andrade da Silva, A. Corinne Huggins-Manley, Jorge Luis Bazán, Amber Benedict","doi":"10.1080/08957347.2024.2345597","DOIUrl":"https://doi.org/10.1080/08957347.2024.2345597","url":null,"abstract":"A Q-matrix is a binary matrix that defines the relationship between items and latent variables and is widely used in diagnostic classification models (DCMs), and can also be adopted in multidimensi...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"1 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141509884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-09DOI: 10.1080/08957347.2024.2311935
Tony Albano, Brian F. French, Thao Thu Vo
Recent research has demonstrated an intersectional approach to the study of differential item functioning (DIF). This approach expands DIF to account for the interactions between what have traditio...
{"title":"Traditional vs Intersectional DIF Analysis: Considerations and a Comparison Using State Testing Data","authors":"Tony Albano, Brian F. French, Thao Thu Vo","doi":"10.1080/08957347.2024.2311935","DOIUrl":"https://doi.org/10.1080/08957347.2024.2311935","url":null,"abstract":"Recent research has demonstrated an intersectional approach to the study of differential item functioning (DIF). This approach expands DIF to account for the interactions between what have traditio...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"22 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-02-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139772332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-07DOI: 10.1080/08957347.2024.2311934
Mingfeng Xue, Mark Wilson
Multidimensionality is common in psychological and educational measurements. This study focuses on dimensions that converge at the upper anchor (i.e. the highest acquisition status defined in a lea...
多维性在心理和教育测量中很常见。本研究的重点是汇聚在上锚点(即在lea...
{"title":"Modeling Dimensions Converging at the Upper Anchor in Learning Progressions: An Example of Micro-Evolution","authors":"Mingfeng Xue, Mark Wilson","doi":"10.1080/08957347.2024.2311934","DOIUrl":"https://doi.org/10.1080/08957347.2024.2311934","url":null,"abstract":"Multidimensionality is common in psychological and educational measurements. This study focuses on dimensions that converge at the upper anchor (i.e. the highest acquisition status defined in a lea...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"3 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139772330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-05DOI: 10.1080/08957347.2024.2311933
Ben Backes, James Cowan
We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated...
{"title":"Are Online and Paper Tests Comparable? Evidence from Statewide K-12 Tests","authors":"Ben Backes, James Cowan","doi":"10.1080/08957347.2024.2311933","DOIUrl":"https://doi.org/10.1080/08957347.2024.2311933","url":null,"abstract":"We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated...","PeriodicalId":51609,"journal":{"name":"Applied Measurement in Education","volume":"29 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139773306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}