首页 > 最新文献

Chinese/English journal of educational measurement and evaluation最新文献

英文 中文
数学问题解决的行程问题测试与学生的解题策略分析: 混合项目反应理论模型 数学问题解决的行程问题测试与学生的解题策略分析: 混合项目反应理论模型
Pub Date : 2021-10-01 DOI: 10.59863/ckoa2517
Chun Jiang, Do-Hong Kim, Chuan Wang
本研究使用混合项目反应理论(IRT)模型将六年级学生在数学问题解决的行程问题测试中的表现分为几个有着质的区别的群组。来自新加坡的345名学生和来自中国的361名学生参加了行程问题的测试。混合IRT分析表明存在两个潜在的组别,其中一组学生(我们称为代数熟手组)倾向于用传统的代数和算术策略去解决问题,而另一组学生(我们称为代数初学组)除了使用传统的代数和算术策略外,更倾向于运用模型化方法、单位元方法和猜测-检验方法等策略。本研究表明在小学数学教学中可以提倡使用多种不同的问题解决策略,小学高年级的数学教学需要帮助学生建立这些策略之间的联系,特别是它们和抽象的代数策略之间的联系,以便顺利过渡到代数的学习。
本研究使用混合项目反应理论(IRT)模型将六年级学生在数学问题解决的行程问题测试中的表现分为几个有着质的区别的群组。来自新加坡的345名学生和来自中国的361名学生参加了行程问题的测试。混合IRT分析表明存在两个潜在的组别,其中一组学生(我们称为代数熟手组)倾向于用传统的代数和算术策略去解决问题,而另一组学生(我们称为代数初学组)除了使用传统的代数和算术策略外,更倾向于运用模型化方法、单位元方法和猜测-检验方法等策略。本研究表明在小学数学教学中可以提倡使用多种不同的问题解决策略,小学高年级的数学教学需要帮助学生建立这些策略之间的联系,特别是它们和抽象的代数策略之间的联系,以便顺利过渡到代数的学习。
{"title":"数学问题解决的行程问题测试与学生的解题策略分析: 混合项目反应理论模型","authors":"Chun Jiang, Do-Hong Kim, Chuan Wang","doi":"10.59863/ckoa2517","DOIUrl":"https://doi.org/10.59863/ckoa2517","url":null,"abstract":"本研究使用混合项目反应理论(IRT)模型将六年级学生在数学问题解决的行程问题测试中的表现分为几个有着质的区别的群组。来自新加坡的345名学生和来自中国的361名学生参加了行程问题的测试。混合IRT分析表明存在两个潜在的组别,其中一组学生(我们称为代数熟手组)倾向于用传统的代数和算术策略去解决问题,而另一组学生(我们称为代数初学组)除了使用传统的代数和算术策略外,更倾向于运用模型化方法、单位元方法和猜测-检验方法等策略。本研究表明在小学数学教学中可以提倡使用多种不同的问题解决策略,小学高年级的数学教学需要帮助学生建立这些策略之间的联系,特别是它们和抽象的代数策略之间的联系,以便顺利过渡到代数的学习。","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"70 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89792883","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Five Trends That Are Reshaping the Course of American Higher Education 重塑美国高等教育进程的五大趋势
Pub Date : 2021-10-01 DOI: 10.59863/ndbc2976
O. Liu
The landscape of higher education has gone through substantial changes due to technological advancements, automation, and shifting learner demographics, further complicated by the pandemic situation. In this paper, I will discuss five trends in higher education: (a) the emergence of parallel tracks of education and training from both higher education institutions and corporates, (b) broader expansion of hybrid education and further separation of time and space in instruction, (c) polarized enrollment and retention between selective and non-selective institutions, (d) reckoning in admissions around equity and diversity, and (e) new paradigms of international education. The five trends will significantly impact how higher education might be evaluated, operated, and reformed.
由于技术进步、自动化和学习者人口结构的变化,高等教育的格局发生了重大变化,而疫情又使情况进一步复杂化。在本文中,我将讨论高等教育的五个趋势:(a)高等教育机构和企业的教育和培训平行轨道的出现,(b)混合教育的更广泛扩展和教学中时间和空间的进一步分离,(c)选择性和非选择性机构之间两极分化的招生和保留,(d)在招生中考虑公平和多样性,以及(e)国际教育的新范式。这五大趋势将对高等教育的评估、运作和改革产生重大影响。
{"title":"Five Trends That Are Reshaping the Course of American Higher Education","authors":"O. Liu","doi":"10.59863/ndbc2976","DOIUrl":"https://doi.org/10.59863/ndbc2976","url":null,"abstract":"The landscape of higher education has gone through substantial changes due to technological advancements, automation, and shifting learner demographics, further complicated by the pandemic situation. In this paper, I will discuss five trends in higher education: (a) the emergence of parallel tracks of education and training from both higher education institutions and corporates, (b) broader expansion of hybrid education and further separation of time and space in instruction, (c) polarized enrollment and retention between selective and non-selective institutions, (d) reckoning in admissions around equity and diversity, and (e) new paradigms of international education. The five trends will significantly impact how higher education might be evaluated, operated, and reformed.","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"72 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74498210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
美国高等教育发展的五个趋势 美国高等教育发展的五个趋势
Pub Date : 2021-10-01 DOI: 10.59863/vxkk7363
O. Liu
由于科技进步、自动化和学生人口结构的改变,高等教育的格局发生了重大变化,而疫情则使该情况进一步复杂化。在本文中,我将讨论高等教育发展的五个趋势:(a) 高校和企业在教育培训领域平行赛道的出现,(b) 多元化教育方式的普及以及教学上时间和场所的进一步分离,(c) 精英大学和普通院校之间在学生入学和流失上的两极分化,(d) 招生中的公平和多样性,以及 (e) 国际教育的新常态。这五个趋势将显著影响高等教育的评估、运营和改革方式。
由于科技进步、自动化和学生人口结构的改变,高等教育的格局发生了重大变化,而疫情则使该情况进一步复杂化。在本文中,我将讨论高等教育发展的五个趋势:(a) 高校和企业在教育培训领域平行赛道的出现,(b) 多元化教育方式的普及以及教学上时间和场所的进一步分离,(c) 精英大学和普通院校之间在学生入学和流失上的两极分化,(d) 招生中的公平和多样性,以及 (e) 国际教育的新常态。这五个趋势将显著影响高等教育的评估、运营和改革方式。
{"title":"美国高等教育发展的五个趋势","authors":"O. Liu","doi":"10.59863/vxkk7363","DOIUrl":"https://doi.org/10.59863/vxkk7363","url":null,"abstract":"由于科技进步、自动化和学生人口结构的改变,高等教育的格局发生了重大变化,而疫情则使该情况进一步复杂化。在本文中,我将讨论高等教育发展的五个趋势:(a) 高校和企业在教育培训领域平行赛道的出现,(b) 多元化教育方式的普及以及教学上时间和场所的进一步分离,(c) 精英大学和普通院校之间在学生入学和流失上的两极分化,(d) 招生中的公平和多样性,以及 (e) 国际教育的新常态。这五个趋势将显著影响高等教育的评估、运营和改革方式。","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"26 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89268729","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
未来技能规划:雇主和高等教育机构的观点 未来技能规划:雇主和高等教育机构的观点
Pub Date : 2021-07-01 DOI: 10.59863/vcgs5620
O. Liu, Guangming Ling, Daniel Fishtein
自动化正迅速改变21世纪的劳动力和对工作者的技能要求。随着越来越多的工作将由机器执行,不太可能被取代的则是那些涉及人工判断和交互的任务。对于高等教育机构而言,在发展、传达和记录现代劳动力的技能需求方面与雇主保持一致至关重要。本文回顾了当前劳动力中的技能趋势,介绍了对来自41家高等教育机构和28家雇主代表的深入访谈所收集的结果,并讨论了对学术到职业转变的影响。
自动化正迅速改变21世纪的劳动力和对工作者的技能要求。随着越来越多的工作将由机器执行,不太可能被取代的则是那些涉及人工判断和交互的任务。对于高等教育机构而言,在发展、传达和记录现代劳动力的技能需求方面与雇主保持一致至关重要。本文回顾了当前劳动力中的技能趋势,介绍了对来自41家高等教育机构和28家雇主代表的深入访谈所收集的结果,并讨论了对学术到职业转变的影响。
{"title":"未来技能规划:雇主和高等教育机构的观点","authors":"O. Liu, Guangming Ling, Daniel Fishtein","doi":"10.59863/vcgs5620","DOIUrl":"https://doi.org/10.59863/vcgs5620","url":null,"abstract":"自动化正迅速改变21世纪的劳动力和对工作者的技能要求。随着越来越多的工作将由机器执行,不太可能被取代的则是那些涉及人工判断和交互的任务。对于高等教育机构而言,在发展、传达和记录现代劳动力的技能需求方面与雇主保持一致至关重要。本文回顾了当前劳动力中的技能趋势,介绍了对来自41家高等教育机构和28家雇主代表的深入访谈所收集的结果,并讨论了对学术到职业转变的影响。","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"16 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85339932","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Augment Algorithm and its Role in Cognitive Diagnosis 增强算法及其在认知诊断中的作用
Pub Date : 2021-07-01 DOI: 10.59863/hvdg5260
Shu-liang Ding, Fen Luo, Wen-yi Wang, Xiaofeng Yu, Jianhua Xiong
Both the augment algorithm and the reduction algorithm can be used to obtain non-zero knowledge states vector in testing. In particular, the augment algorithm based on the reachability matrix can imply the structure of the Q-matrix and its non-zero columns, thus proving the set of Q-matrix columns forms an algebraic structure (Lattice). Applying the augment algorithm based on the reachability matrix and the test Q-matrix, respectively, we can obtain the theoretical construct validity of the test Q-matrix (i.e., the degree of the test Q-matrix fitting the cognitive model) and use the results to evaluate test quality. We can also use the algorithm when constructing and evaluating cognitive models, as well as when developing cognitive diagnostic models. Moreover, the augment algorithm and its reverse algorithm (reduction algorithm) are suitable for analyzing and evaluating retrofitting data.
增强算法和约简算法都可以在测试中得到非零的知识状态向量。特别地,基于可达矩阵的增广算法可以推导出q矩阵及其非零列的结构,从而证明q矩阵列的集合形成一个代数结构(格)。分别应用基于可达性矩阵和测试q -矩阵的增强算法,我们可以得到测试q -矩阵的理论构造效度(即测试q -矩阵拟合认知模型的程度),并利用结果来评价测试质量。我们还可以在构建和评估认知模型以及开发认知诊断模型时使用该算法。此外,增强算法及其反向算法(约简算法)适合于对改造数据进行分析和评价。
{"title":"The Augment Algorithm and its Role in Cognitive Diagnosis","authors":"Shu-liang Ding, Fen Luo, Wen-yi Wang, Xiaofeng Yu, Jianhua Xiong","doi":"10.59863/hvdg5260","DOIUrl":"https://doi.org/10.59863/hvdg5260","url":null,"abstract":"Both the augment algorithm and the reduction algorithm can be used to obtain non-zero knowledge states vector in testing. In particular, the augment algorithm based on the reachability matrix can imply the structure of the Q-matrix and its non-zero columns, thus proving the set of Q-matrix columns forms an algebraic structure (Lattice). Applying the augment algorithm based on the reachability matrix and the test Q-matrix, respectively, we can obtain the theoretical construct validity of the test Q-matrix (i.e., the degree of the test Q-matrix fitting the cognitive model) and use the results to evaluate test quality. We can also use the algorithm when constructing and evaluating cognitive models, as well as when developing cognitive diagnostic models. Moreover, the augment algorithm and its reverse algorithm (reduction algorithm) are suitable for analyzing and evaluating retrofitting data.","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"38 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88484110","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
扩张算法及其在认知诊断中的作用 扩张算法及其在认知诊断中的作用
Pub Date : 2021-07-01 DOI: 10.59863/wijd8552
树良 丁, 芬 罗, 文义 汪, 晓锋 喻, 建华 熊
删减法和扩张算法均可以获得给定范围内被试不同非零知识状态的种类,而基于可达阵的扩张算法能够揭示Q矩阵和Q矩阵中非零列的构造,从而证明学生Q矩阵的列集合形成一个代数结构(格)。分别基于可达阵和测验Q矩阵使用扩张算法可得到测验Q矩阵的理论构念效度,这可用于对试卷质量进行评估。扩张算法还可用于认知模型的构造和测量、认知诊断模型的开发,扩张算法和它的逆算法(缩减算法)特别适用于对翻新数据的诊断分析和评估。
删减法和扩张算法均可以获得给定范围内被试不同非零知识状态的种类,而基于可达阵的扩张算法能够揭示Q矩阵和Q矩阵中非零列的构造,从而证明学生Q矩阵的列集合形成一个代数结构(格)。分别基于可达阵和测验Q矩阵使用扩张算法可得到测验Q矩阵的理论构念效度,这可用于对试卷质量进行评估。扩张算法还可用于认知模型的构造和测量、认知诊断模型的开发,扩张算法和它的逆算法(缩减算法)特别适用于对翻新数据的诊断分析和评估。
{"title":"扩张算法及其在认知诊断中的作用","authors":"树良 丁, 芬 罗, 文义 汪, 晓锋 喻, 建华 熊","doi":"10.59863/wijd8552","DOIUrl":"https://doi.org/10.59863/wijd8552","url":null,"abstract":"删减法和扩张算法均可以获得给定范围内被试不同非零知识状态的种类,而基于可达阵的扩张算法能够揭示Q矩阵和Q矩阵中非零列的构造,从而证明学生Q矩阵的列集合形成一个代数结构(格)。分别基于可达阵和测验Q矩阵使用扩张算法可得到测验Q矩阵的理论构念效度,这可用于对试卷质量进行评估。扩张算法还可用于认知模型的构造和测量、认知诊断模型的开发,扩张算法和它的逆算法(缩减算法)特别适用于对翻新数据的诊断分析和评估。","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"213 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76974459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
教育高危群体在写作过程上的性别差异研究 教育高危群体在写作过程上的性别差异研究
Pub Date : 2021-03-01 DOI: 10.59863/rnsc1388
Randy Bennett, Mo Zhang, S. Sinharay
本研究基于一个中学同等学力测验,考察了教育高危群体在写作过程上的性 别差异。研究涉及了来自美国23个州的合计三万多考生,每一考生均参与了 该语言测验的12副本考卷中的一个。研究借助键盘记录中抽取出的特征推断 背后的写作过程,并将之整合为7个过程指标。研究结果发现女性被试的作文 得分和语言测验总分均领先于男性,但领先程度很微弱。更重要的是,当控 制了语言测验总分、年龄和作文题目后,全部7个过程指标均显示出显著的性 别差异,其中,最突出的指标是流畅性和编辑性的不同方面。当前研究结果 在许多重要方面与先前一些对在校生和成人的研究结果相一致,也与在线和 纸笔写作任务的研究结果相吻合。关于对使用字符类语言(如汉语) 进行写作 的个体如何开展类似研究,文章结尾给出了一些建议。
本研究基于一个中学同等学力测验,考察了教育高危群体在写作过程上的性 别差异。研究涉及了来自美国23个州的合计三万多考生,每一考生均参与了 该语言测验的12副本考卷中的一个。研究借助键盘记录中抽取出的特征推断 背后的写作过程,并将之整合为7个过程指标。研究结果发现女性被试的作文 得分和语言测验总分均领先于男性,但领先程度很微弱。更重要的是,当控 制了语言测验总分、年龄和作文题目后,全部7个过程指标均显示出显著的性 别差异,其中,最突出的指标是流畅性和编辑性的不同方面。当前研究结果 在许多重要方面与先前一些对在校生和成人的研究结果相一致,也与在线和 纸笔写作任务的研究结果相吻合。关于对使用字符类语言(如汉语) 进行写作 的个体如何开展类似研究,文章结尾给出了一些建议。
{"title":"教育高危群体在写作过程上的性别差异研究","authors":"Randy Bennett, Mo Zhang, S. Sinharay","doi":"10.59863/rnsc1388","DOIUrl":"https://doi.org/10.59863/rnsc1388","url":null,"abstract":"本研究基于一个中学同等学力测验,考察了教育高危群体在写作过程上的性 别差异。研究涉及了来自美国23个州的合计三万多考生,每一考生均参与了 该语言测验的12副本考卷中的一个。研究借助键盘记录中抽取出的特征推断 背后的写作过程,并将之整合为7个过程指标。研究结果发现女性被试的作文 得分和语言测验总分均领先于男性,但领先程度很微弱。更重要的是,当控 制了语言测验总分、年龄和作文题目后,全部7个过程指标均显示出显著的性 别差异,其中,最突出的指标是流畅性和编辑性的不同方面。当前研究结果 在许多重要方面与先前一些对在校生和成人的研究结果相一致,也与在线和 纸笔写作任务的研究结果相吻合。关于对使用字符类语言(如汉语) 进行写作 的个体如何开展类似研究,文章结尾给出了一些建议。","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"163 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81668927","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
定义与测量语言水平的基于IRT的潜在类别方法 定义与测量语言水平的基于IRT的潜在类别方法
Pub Date : 2021-03-01 DOI: 10.59863/nfhi8942
Tammy D Tolar, David Francis, Paulina Kulesz, K. Stuebing
英语学习者(EL) 的状态对决定何时以及如何评估英语学习者的学业成就具有至关重要的意义。在美国, 被指定为英语学习者的学生每年都要接受英语水平(ELP) 的评估,这是一个复杂的构念,其概念的形成 近年来不断发展,以更准确地反映达成学科内容领域成就所需的语言要求,如各个州和州语言评估联盟 (如WIDA和ELPA21) 的标准所反映的那样。本文的目的是探讨使用学科内容领域成就测试来验证掌握语 言水平的标准的可能的作用和效用。具体来说,我们应用混合项目反应模型来识别两类EL学生:(1) 一 类EL学生他的英语语言艺术和数学成就测试题目具有与non-EL相似的难度和区分度参数和(2)另一类是测 试题目功能不同的EL学生。我们使用潜在类别IRT方法来识别两类EL学生,并评估ELP的不同分量表(读、 写、听、说) 对成员分类的影响。只有阅读和写作是成员分类的显著预测因子。基于ELP总分的划界分数 并不是学生成员分类的完美的预测指标,并表明需要在最高水平类别内进行更精细的区分。这项研究证 明了将语言水平的定义与使用语言水平的(评价) 环境联系起来的重要性,并提出了当语言水平标准与学 科内容领域成就所需的语言要求联系起来时,心理测量分析的可能的价值。
英语学习者(EL) 的状态对决定何时以及如何评估英语学习者的学业成就具有至关重要的意义。在美国, 被指定为英语学习者的学生每年都要接受英语水平(ELP) 的评估,这是一个复杂的构念,其概念的形成 近年来不断发展,以更准确地反映达成学科内容领域成就所需的语言要求,如各个州和州语言评估联盟 (如WIDA和ELPA21) 的标准所反映的那样。本文的目的是探讨使用学科内容领域成就测试来验证掌握语 言水平的标准的可能的作用和效用。具体来说,我们应用混合项目反应模型来识别两类EL学生:(1) 一 类EL学生他的英语语言艺术和数学成就测试题目具有与non-EL相似的难度和区分度参数和(2)另一类是测 试题目功能不同的EL学生。我们使用潜在类别IRT方法来识别两类EL学生,并评估ELP的不同分量表(读、 写、听、说) 对成员分类的影响。只有阅读和写作是成员分类的显著预测因子。基于ELP总分的划界分数 并不是学生成员分类的完美的预测指标,并表明需要在最高水平类别内进行更精细的区分。这项研究证 明了将语言水平的定义与使用语言水平的(评价) 环境联系起来的重要性,并提出了当语言水平标准与学 科内容领域成就所需的语言要求联系起来时,心理测量分析的可能的价值。
{"title":"定义与测量语言水平的基于IRT的潜在类别方法","authors":"Tammy D Tolar, David Francis, Paulina Kulesz, K. Stuebing","doi":"10.59863/nfhi8942","DOIUrl":"https://doi.org/10.59863/nfhi8942","url":null,"abstract":"英语学习者(EL) 的状态对决定何时以及如何评估英语学习者的学业成就具有至关重要的意义。在美国, 被指定为英语学习者的学生每年都要接受英语水平(ELP) 的评估,这是一个复杂的构念,其概念的形成 近年来不断发展,以更准确地反映达成学科内容领域成就所需的语言要求,如各个州和州语言评估联盟 (如WIDA和ELPA21) 的标准所反映的那样。本文的目的是探讨使用学科内容领域成就测试来验证掌握语 言水平的标准的可能的作用和效用。具体来说,我们应用混合项目反应模型来识别两类EL学生:(1) 一 类EL学生他的英语语言艺术和数学成就测试题目具有与non-EL相似的难度和区分度参数和(2)另一类是测 试题目功能不同的EL学生。我们使用潜在类别IRT方法来识别两类EL学生,并评估ELP的不同分量表(读、 写、听、说) 对成员分类的影响。只有阅读和写作是成员分类的显著预测因子。基于ELP总分的划界分数 并不是学生成员分类的完美的预测指标,并表明需要在最高水平类别内进行更精细的区分。这项研究证 明了将语言水平的定义与使用语言水平的(评价) 环境联系起来的重要性,并提出了当语言水平标准与学 科内容领域成就所需的语言要求联系起来时,心理测量分析的可能的价值。","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"33 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87977180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Latent Class IRT Approach to Defining and Measuring Language Proficiency. 定义和测量语言能力的潜在类别IRT方法。
Tammy D Tolar, David J Francis, Paulina A Kulesz, Karla K Stuebing

English language learner (EL) status has high stakes implications for determining when and how ELs should be evaluated for academic achievement. In the US, students designated as English learners are assessed annually for English language proficiency (ELP), a complex construct whose conceptualization has evolved in recent years to reflect more precisely the language demands of content area achievement as reflected in the standards of individual states and state language assessment consortia, such as WIDA and ELPA21. The goal of this paper was to examine the possible role for and utility of using content area assessments to validate language proficiency mastery criteria. Specifically, we applied mixture item response models to identify two classes of EL students: (1) ELs for whom English language arts and math achievement test items have similar difficulty and discrimination parameters as they do for non-ELs and (2) ELs for whom the test items function differently. We used latent class IRT methods to identify the two groups of ELs and to evaluate the effects of different subscales of ELP (reading, writing, listening, and speaking) on group membership. Only reading and writing were significant predictors of class membership. Cut-scores based on summary scores of ELP were imperfect predictors of class membership and indicated the need for finer differentiation within the top proficiency category. This study demonstrates the importance of linking definitions of ELP to the context for which ELP is used and suggests the possible value of psychometric analyses when language proficiency standards are linked to the language requirements for content area achievement.

英语学习者(EL)的状态对于决定何时以及如何评估EL的学业成就具有重大意义。在美国,被指定为英语学习者的学生每年都要接受英语语言能力(ELP)评估,这是一个复杂的结构,其概念近年来不断发展,以更准确地反映各州和各州语言评估联盟(如WIDA和ELPA21)的标准中所反映的内容领域成就的语言要求。本文的目的是检查使用内容区域评估来验证语言熟练掌握标准的可能作用和效用。具体来说,我们应用混合项目反应模型来识别两类英语学生:(1)英语语言艺术和数学成就测试项目的难度和辨别参数与非英语学生相似的英语学生;(2)测试项目的功能不同的英语学生。我们使用潜在类别IRT方法来识别两组ELP,并评估ELP不同分量表(阅读、写作、听力和口语)对群体成员的影响。只有阅读和写作是班级成员的重要预测因素。基于ELP总结分数的Cut-scores是不完美的班级成员预测,并表明需要在最高熟练程度类别中进行更精细的区分。本研究证明了将语言能力水平定义与使用语言能力水平的语境联系起来的重要性,并表明当语言能力标准与内容领域成就的语言要求联系起来时,心理测量分析的可能价值。
{"title":"A Latent Class IRT Approach to Defining and Measuring Language Proficiency.","authors":"Tammy D Tolar,&nbsp;David J Francis,&nbsp;Paulina A Kulesz,&nbsp;Karla K Stuebing","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>English language learner (EL) status has high stakes implications for determining when and how ELs should be evaluated for academic achievement. In the US, students designated as English learners are assessed annually for English language proficiency (ELP), a complex construct whose conceptualization has evolved in recent years to reflect more precisely the language demands of content area achievement as reflected in the standards of individual states and state language assessment consortia, such as WIDA and ELPA21. The goal of this paper was to examine the possible role for and utility of using content area assessments to validate language proficiency mastery criteria. Specifically, we applied mixture item response models to identify two classes of EL students: (1) ELs for whom English language arts and math achievement test items have similar difficulty and discrimination parameters as they do for non-ELs and (2) ELs for whom the test items function differently. We used latent class IRT methods to identify the two groups of ELs and to evaluate the effects of different subscales of ELP (reading, writing, listening, and speaking) on group membership. Only reading and writing were significant predictors of class membership. Cut-scores based on summary scores of ELP were imperfect predictors of class membership and indicated the need for finer differentiation within the top proficiency category. This study demonstrates the importance of linking definitions of ELP to the context for which ELP is used and suggests the possible value of psychometric analyses when language proficiency standards are linked to the language requirements for content area achievement.</p>","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"2 1","pages":"49-73"},"PeriodicalIF":0.0,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9869716/pdf/nihms-1860750.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9172668","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How Do Educationally At-Risk Men and Women Differ in Their Essay-Writing Processes? 教育风险男性和女性在论文写作过程中有何不同?
Pub Date : 2021-03-01 DOI: 10.59863/pboz7295
R. Bennett, Mo Zhang, S. Sinharay
This study examined differences in the composition processes used by educationally at-risk males and females who wrote essays as part of a high-school equivalency examination. Over 30,000 individuals were assessed, each taking one of 12 forms of the examination’s language arts writing subtest in 23 US states. Writing processes were inferred using features extracted from keystroke logs and aggregated into seven composite indicators. Results showed that females earned higher essay and total language arts writing composite scores than did males, but only by trivial amounts. More pertinent was that, after controlling for language arts writing composite score, age, and essay prompt, all seven process indicators showed nontrivial, statistically significant differences, the most notable being for indicators related to fluency and different aspects of editing. The study’s findings are consistent in important ways with those from other investigations of school-age students and adults, and with results from both online and paper-based writing tasks. Implications are offered for conducting similar research for individuals composing in character-based languages like Chinese.
这项研究调查了在高中同等考试中,有教育风险的男性和女性在写作过程中所使用的差异。超过30,000人接受了评估,每个人都参加了美国23个州的12种语言艺术写作测试中的一种。使用从击键日志中提取的特征来推断书写过程,并将其汇总为七个复合指标。结果显示,女性的论文和语言艺术写作综合总分得分高于男性,但差距很小。更相关的是,在控制了语言艺术写作综合分数、年龄和论文提示后,所有七个过程指标都显示出非琐碎的、统计上显著的差异,最显著的是与流利性和编辑不同方面相关的指标。这项研究的结果与其他针对学龄学生和成年人的调查结果,以及在线和纸质写作任务的结果在很多重要方面是一致的。这对使用汉字等以字符为基础的语言写作的个人进行类似的研究提供了启示。
{"title":"How Do Educationally At-Risk Men and Women Differ in Their Essay-Writing Processes?","authors":"R. Bennett, Mo Zhang, S. Sinharay","doi":"10.59863/pboz7295","DOIUrl":"https://doi.org/10.59863/pboz7295","url":null,"abstract":"This study examined differences in the composition processes used by educationally at-risk males and females who wrote essays as part of a high-school equivalency examination. Over 30,000 individuals were assessed, each taking one of 12 forms of the examination’s language arts writing subtest in 23 US states. Writing processes were inferred using features extracted from keystroke logs and aggregated into seven composite indicators. Results showed that females earned higher essay and total language arts writing composite scores than did males, but only by trivial amounts. More pertinent was that, after controlling for language arts writing composite score, age, and essay prompt, all seven process indicators showed nontrivial, statistically significant differences, the most notable being for indicators related to fluency and different aspects of editing. The study’s findings are consistent in important ways with those from other investigations of school-age students and adults, and with results from both online and paper-based writing tasks. Implications are offered for conducting similar research for individuals composing in character-based languages like Chinese.","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"16 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83559608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Chinese/English journal of educational measurement and evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1