首页 > 最新文献

International Journal of Assessment Tools in Education最新文献

英文 中文
A rating scale development study for the evaluation of lesson plans and teaching practices on argumentation-based inquiry 基于议论文探究的课程计划与教学实践评价量表开发研究
IF 0.9 Pub Date : 2022-12-19 DOI: 10.21449/ijate.948489
Funda Hasançebi, Büşra Tuncay Yüksel, Günkut Mesci
The purpose of this study was to develop a reliable and valid rating scale for the use of the assessment and evaluation of lesson plans and teaching practices that are based on argumentation-based inquiry (ABI). The study covered two academic years (four academic semesters). Qualitative and quantitative methods were utilized throughout the development of the rating scale including data collection and data analyses. A purposive sample of 72 pre-service science teachers (PSTs) who were enrolled in a public university located in East Black Sea region of Turkey constituted the sample of the study. Content Validity Ratio (CVR=.80) and Content Validity Index (CVI=.94) values were calculated as measures of content validity. Pearson Correlation Coefficient (r=.96) and Cohen’s Kappa value (κ value was between .60 and 1.00) were calculated to test inter-rater reliability of the scores obtained by the rating scale. Findings provided evidence for the reliability and the validity of the ABI rating scale. ABI lesson plan template and ABI rating scale developed for the assessment and evaluation of ABI lesson plans and subsequent teaching practices are provided to the readers. Contributions to the field are discussed.
本研究的目的是开发一种可靠有效的评分量表,用于基于论证探究(ABI)的课程计划和教学实践的评估和评估。这项研究为期两年(四个学期)。在整个评级量表的制定过程中,包括数据收集和数据分析,都采用了定性和定量方法。这项研究的样本是72名入职前科学教师,他们就读于土耳其东黑海地区的一所公立大学。计算内容有效性比率(CVR=.80)和内容有效性指数(CVI=.94)值作为内容有效性的衡量标准。计算Pearson相关系数(r=.96)和Cohen Kappa值(κ值在.60和1.00之间),以测试评分量表获得的评分的评分者间可靠性。研究结果为ABI评定量表的可靠性和有效性提供了证据。为评估和评价ABI课程计划和后续教学实践而开发的ABI课程规划模板和ABI评分量表提供给读者。讨论了对该领域的贡献。
{"title":"A rating scale development study for the evaluation of lesson plans and teaching practices on argumentation-based inquiry","authors":"Funda Hasançebi, Büşra Tuncay Yüksel, Günkut Mesci","doi":"10.21449/ijate.948489","DOIUrl":"https://doi.org/10.21449/ijate.948489","url":null,"abstract":"The purpose of this study was to develop a reliable and valid rating scale for the use of the assessment and evaluation of lesson plans and teaching practices that are based on argumentation-based inquiry (ABI). The study covered two academic years (four academic semesters). Qualitative and quantitative methods were utilized throughout the development of the rating scale including data collection and data analyses. A purposive sample of 72 pre-service science teachers (PSTs) who were enrolled in a public university located in East Black Sea region of Turkey constituted the sample of the study. Content Validity Ratio (CVR=.80) and Content Validity Index (CVI=.94) values were calculated as measures of content validity. Pearson Correlation Coefficient (r=.96) and Cohen’s Kappa value (κ value was between .60 and 1.00) were calculated to test inter-rater reliability of the scores obtained by the rating scale. Findings provided evidence for the reliability and the validity of the ABI rating scale. ABI lesson plan template and ABI rating scale developed for the assessment and evaluation of ABI lesson plans and subsequent teaching practices are provided to the readers. Contributions to the field are discussed.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45858585","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Rasch analysis to examine raters’ expertise Turkish teacher candidates’ competency levels in writing different types of test items 使用Rasch分析来检查评分者的专业知识土耳其教师候选人在写作不同类型的测试项目的能力水平
IF 0.9 Pub Date : 2022-12-18 DOI: 10.21449/ijate.1058300
Ayfer Sayin, M. Şata
The aim of the present study was to examine Turkish teacher candidates’ competency levels in writing different types of test items by utilizing Rasch analysis. In addition, the effect of the expertise of the raters scoring the items written by the teacher candidates was examined within the scope of the study. 84 Turkish teacher candidates participated in the present study, which was conducted using the relational survey model, one of the quantitative research methods. Three experts participated in the rating process: an expert in Turkish education, an expert in measurement and evaluation, and an expert in both Turkish education and measurement and evaluation. The teacher candidates wrote true-false, short response, multiple choice and open-ended types of items in accordance with the Test Item Development Form, and the raters scored each item type by designating a score between 1 and 5 based on the item evaluation scoring rubric prepared for each item type. The study revealed that Turkish teacher candidates had the highest level of competency in writing true-false items, while they had the lowest competency in writing multiple-choice items. Moreover, it was revealed that raters’ expertise had an effect on teacher candidates’ competencies in writing different types of items. Finally, it was found that the rater who was an expert in both Turkish education and measurement and evaluation had the highest level of scoring reliability, while the rater who solely had expertise in measurement and evaluation had the relatively lowest level of scoring reliability.
本研究的目的是利用Rasch分析来检验土耳其教师候选人在写作不同类型测试项目方面的能力水平。此外,在研究范围内,对教师候选人所写的项目进行评分的评分者的专业知识的影响进行了检查。本研究采用定量研究方法之一的关系调查模型对84名土耳其教师候选人进行了研究。三名专家参加了评级过程:一名土耳其教育专家、一名测量和评价专家以及一名土耳其教育和测量和评价专家。教师考生根据《测试项目开发表》编写真假、短答题、选择题和开放式题型,评分员根据为每个题型准备的题型评价计分表,对每个题型进行1 - 5分的评分。研究表明,土耳其教师候选人在写真假题方面的能力水平最高,而在写多项选择题方面的能力水平最低。此外,评价者的专业知识对教师候选人写作不同类型项目的能力有影响。最后,我们发现,既精通土耳其教育又精通测量与评价的评分者的评分信度水平最高,而仅精通测量与评价的评分者的评分信度水平相对最低。
{"title":"Using Rasch analysis to examine raters’ expertise Turkish teacher candidates’ competency levels in writing different types of test items","authors":"Ayfer Sayin, M. Şata","doi":"10.21449/ijate.1058300","DOIUrl":"https://doi.org/10.21449/ijate.1058300","url":null,"abstract":"The aim of the present study was to examine Turkish teacher candidates’ competency levels in writing different types of test items by utilizing Rasch analysis. In addition, the effect of the expertise of the raters scoring the items written by the teacher candidates was examined within the scope of the study. 84 Turkish teacher candidates participated in the present study, which was conducted using the relational survey model, one of the quantitative research methods. Three experts participated in the rating process: an expert in Turkish education, an expert in measurement and evaluation, and an expert in both Turkish education and measurement and evaluation. The teacher candidates wrote true-false, short response, multiple choice and open-ended types of items in accordance with the Test Item Development Form, and the raters scored each item type by designating a score between 1 and 5 based on the item evaluation scoring rubric prepared for each item type. The study revealed that Turkish teacher candidates had the highest level of competency in writing true-false items, while they had the lowest competency in writing multiple-choice items. Moreover, it was revealed that raters’ expertise had an effect on teacher candidates’ competencies in writing different types of items. Finally, it was found that the rater who was an expert in both Turkish education and measurement and evaluation had the highest level of scoring reliability, while the rater who solely had expertise in measurement and evaluation had the relatively lowest level of scoring reliability.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43133862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Adaptation of Motivation to Read Profile Scale to Turkish 阅读动机档案量表对土耳其语的适应性
IF 0.9 Pub Date : 2022-12-18 DOI: 10.21449/ijate.1002824
Zeynep Aydemi̇r, Ergün Öztürk
The purpose of this research is to adapt the "Motivation to Read Profile Scale" developed by Malloy et al. (2013) into Turkish. Within the framework of adaptation studies, firstly, the items of the scale were translated into Turkish by the researchers, then ten experts were consulted for the Turkish and English forms of the scale, and amendments to the translation were made in line with their opinions. The scale was administered to 317 students for validity and reliability studies. Confirmatory factor analysis was performed directly on the two-factor scale, as the experimental evidence regarding the construct validity of the scale in the original culture was determined. As a result of the general confirmatory factor analysis, the two-factor structure can be characterized as having values that can be acceptable. Cronbach’s alpha internal consistency coefficient for the Turkish form of the scale was 0.86. As a result, it was seen that the Turkish form of the scale was valid and reliable for this research group.
本研究的目的是将Malloy等人(2013)开发的“阅读动机档案量表”改编为土耳其语。在适应研究的框架内,研究者首先将量表的条目翻译成土耳其语,然后就量表的土耳其语和英语形式咨询了10位专家,并根据他们的意见对翻译进行了修改。对317名学生进行了效度和信度研究。验证性因子分析直接在双因子量表上进行,作为在原始培养中确定量表构建效度的实验证据。作为一般验证性因子分析的结果,双因子结构可以被表征为具有可接受的值。土耳其式量表的Cronbach 's alpha内部一致性系数为0.86。由此可见,土耳其式量表对于本课题组来说是有效可靠的。
{"title":"Adaptation of Motivation to Read Profile Scale to Turkish","authors":"Zeynep Aydemi̇r, Ergün Öztürk","doi":"10.21449/ijate.1002824","DOIUrl":"https://doi.org/10.21449/ijate.1002824","url":null,"abstract":"The purpose of this research is to adapt the \"Motivation to Read Profile Scale\" developed by Malloy et al. (2013) into Turkish. Within the framework of adaptation studies, firstly, the items of the scale were translated into Turkish by the researchers, then ten experts were consulted for the Turkish and English forms of the scale, and amendments to the translation were made in line with their opinions. The scale was administered to 317 students for validity and reliability studies. Confirmatory factor analysis was performed directly on the two-factor scale, as the experimental evidence regarding the construct validity of the scale in the original culture was determined. As a result of the general confirmatory factor analysis, the two-factor structure can be characterized as having values that can be acceptable. Cronbach’s alpha internal consistency coefficient for the Turkish form of the scale was 0.86. As a result, it was seen that the Turkish form of the scale was valid and reliable for this research group.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42684819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Inside the black box: do teachers practice assessment as learning? 黑匣子里:教师是否将评估视为学习?
IF 0.9 Pub Date : 2022-11-29 DOI: 10.21449/ijate.1132923
Özen Yıldırım, Safiye Bilican Demir
The conceptual development of assessment literature in recent years has been remarkable. One of the latest concepts to have emerged in parallel with this development is Assessment as Learning (AsL). This study investigated how AsL pertains to classroom practices within its conceptual framework by examining teacher reports. Case study design, a qualitative research method, was used to collect detailed information about in-class teacher practices. The teachers were interviewed with semi-structured interview forms and the data obtained were then analyzed using content analysis. The results revealed that in-class teacher practices were incapable of supporting AsL and promoting self-regulated behaviors and that many of the activities conducted in class were teacher-centered. Teachers did not apply self-assessment or peer-assessment practices, and the feedback they gave to students was mainly based on measurement scores. The researchers discussed the results in relation to the relevant literature and offered some suggestions for applying AsL in practice.
近年来,评估文献的概念发展非常显著。与这一发展并行出现的最新概念之一是作为学习的评估(AsL)。本研究通过检查教师报告,调查了AsL如何在其概念框架内与课堂实践相关联。案例研究设计是一种定性研究方法,用于收集有关课堂教师实践的详细信息。采用半结构化访谈表对教师进行访谈,然后使用内容分析对获得的数据进行分析。结果表明,课堂上的教师实践无法支持AsL和促进自我调节行为,课堂上进行的许多活动都是以教师为中心的。教师没有采用自我评估或同伴评估的做法,他们给学生的反馈主要基于测量分数。研究人员结合相关文献对研究结果进行了讨论,并对AsL在实践中的应用提出了一些建议。
{"title":"Inside the black box: do teachers practice assessment as learning?","authors":"Özen Yıldırım, Safiye Bilican Demir","doi":"10.21449/ijate.1132923","DOIUrl":"https://doi.org/10.21449/ijate.1132923","url":null,"abstract":"The conceptual development of assessment literature in recent years has been remarkable. One of the latest concepts to have emerged in parallel with this development is Assessment as Learning (AsL). This study investigated how AsL pertains to classroom practices within its conceptual framework by examining teacher reports. Case study design, a qualitative research method, was used to collect detailed information about in-class teacher practices. The teachers were interviewed with semi-structured interview forms and the data obtained were then analyzed using content analysis. The results revealed that in-class teacher practices were incapable of supporting AsL and promoting self-regulated behaviors and that many of the activities conducted in class were teacher-centered. Teachers did not apply self-assessment or peer-assessment practices, and the feedback they gave to students was mainly based on measurement scores. The researchers discussed the results in relation to the relevant literature and offered some suggestions for applying AsL in practice.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49145996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Classroom Assessment: The Psychological and Theoretical Foundations of the Formative Assessment 课堂评价:形成性评价的心理学和理论基础
IF 0.9 Pub Date : 2022-11-29 DOI: 10.21449/ijate.1127958
Seval Kula Kartal
The change of the learning and teaching definitions in psychology has also changed the nature of classroom assessment implementations. One of these important changes is that the targeted skills in the classroom assessment, and item structures utilized to measure these skills have changed. Teachers have started to use items and tasks that can represent the significant knowledge and skills of subject better and provide rich information and evidence for students’ development rather than utilizing items measuring only remembering the bits of knowledge or simple comprehension. The second important change has taken place in terms of why and how teachers and students use classroom assessment. Although there are a few studies on the change of targeted skills and item structures used in the classroom assessment in the related national literature, the number of studies providing information on how to apply classroom assessment in line with its recent definitions, aims and implementation is still limited. Thus, the current study aims at providing guiding information on why and how to implement classroom assessment to develop students’ learning, motivation, and self-assessment skills.
心理学中学习和教学定义的变化也改变了课堂评估实施的性质。其中一个重要的变化是,课堂评估中的目标技能以及用于衡量这些技能的项目结构发生了变化。教师们已经开始使用能够更好地代表学科重要知识和技能的项目和任务,并为学生的发展提供丰富的信息和证据,而不是使用只记住知识或简单理解的项目。第二个重要变化发生在教师和学生为什么以及如何使用课堂评估方面。尽管在相关的国家文献中有一些关于课堂评估中使用的目标技能和项目结构的变化的研究,但提供如何根据其最新定义、目标和实施应用课堂评估信息的研究数量仍然有限。因此,本研究旨在提供指导信息,说明为什么以及如何实施课堂评估,以培养学生的学习、动机和自我评估技能。
{"title":"Classroom Assessment: The Psychological and Theoretical Foundations of the Formative Assessment","authors":"Seval Kula Kartal","doi":"10.21449/ijate.1127958","DOIUrl":"https://doi.org/10.21449/ijate.1127958","url":null,"abstract":"The change of the learning and teaching definitions in psychology has also changed the nature of classroom assessment implementations. One of these important changes is that the targeted skills in the classroom assessment, and item structures utilized to measure these skills have changed. Teachers have started to use items and tasks that can represent the significant knowledge and skills of subject better and provide rich information and evidence for students’ development rather than utilizing items measuring only remembering the bits of knowledge or simple comprehension. The second important change has taken place in terms of why and how teachers and students use classroom assessment. Although there are a few studies on the change of targeted skills and item structures used in the classroom assessment in the related national literature, the number of studies providing information on how to apply classroom assessment in line with its recent definitions, aims and implementation is still limited. Thus, the current study aims at providing guiding information on why and how to implement classroom assessment to develop students’ learning, motivation, and self-assessment skills.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48548120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Views of academician examiners on the testing accommodations of the measurement, selection and placement center for disabled test takers 院士考试人员对残疾考生计量选拔安置中心考场设置的看法
IF 0.9 Pub Date : 2022-11-29 DOI: 10.21449/ijate.1084501
M. İlhan, M. Şahin, B. Çetin
The Measurement, Selection and Placement Center–MSPC (original acronym: Ölçme, Seçme ve Yerleştirme Merkezi–ÖSYM) administers many of the high-stake examinations applied in Türkiye. In order to support equality of opportunity in education and create a fair evaluation system, MSPC actualizes various testing accommodations by adjusting the standardization protocol for disabled test takers. In this research, we examined the views of academicians who served in the halls where disabled candidates take the test in the examinations held by MSPC about the testing accommodations for the disabled. The study design was in the basic qualitative research model. The participants consisted of 12 academicians working at a state university in Türkiye, who had served at least three times in the examination halls reserved for disabled test takers by MSPC. We collected the data via an interview form which included four items and administered it to the participants according to the drop-off and pick-up later method. The research results revealed that academician examiners have various positive opinions about MSPC’s testing accommodations for disabled test takers. However, the participants also expressed that current accommodations have certain limitations that should be revised.
测量,选择和安置中心- mspc(最初的缩写:Ölçme, se me ve yerle timme Merkezi -ÖSYM)管理许多在 rkiye中应用的高风险考试。为了支持教育机会平等,建立公平的评估体系,MSPC通过调整残疾考生的标准化协议,实现了各种考试便利。在本研究中,我们调查了在MSPC举办的残疾考生考试大厅服务的院士对残疾考生考试便利的看法。研究设计采用基本的定性研究模式。参与者包括12名在基伊州一所州立大学工作的院士,他们至少三次在MSPC为残疾人考生保留的考场服务。我们通过一份包含四项内容的访谈表收集数据,并按照先送后取的方法对参与者进行管理。研究结果显示,院士考官对我校为残疾考生提供的考试便利有各种积极的评价。但是,与会者也表示,目前的安排有一定的局限性,应该加以修订。
{"title":"Views of academician examiners on the testing accommodations of the measurement, selection and placement center for disabled test takers","authors":"M. İlhan, M. Şahin, B. Çetin","doi":"10.21449/ijate.1084501","DOIUrl":"https://doi.org/10.21449/ijate.1084501","url":null,"abstract":"The Measurement, Selection and Placement Center–MSPC (original acronym: Ölçme, Seçme ve Yerleştirme Merkezi–ÖSYM) administers many of the high-stake examinations applied in Türkiye. In order to support equality of opportunity in education and create a fair evaluation system, MSPC actualizes various testing accommodations by adjusting the standardization protocol for disabled test takers. In this research, we examined the views of academicians who served in the halls where disabled candidates take the test in the examinations held by MSPC about the testing accommodations for the disabled. The study design was in the basic qualitative research model. The participants consisted of 12 academicians working at a state university in Türkiye, who had served at least three times in the examination halls reserved for disabled test takers by MSPC. We collected the data via an interview form which included four items and administered it to the participants according to the drop-off and pick-up later method. The research results revealed that academician examiners have various positive opinions about MSPC’s testing accommodations for disabled test takers. However, the participants also expressed that current accommodations have certain limitations that should be revised.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42216624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Creating multiple-choice items for testing student learning 创建多项选择题来测试学生的学习
IF 0.9 Pub Date : 2022-11-29 DOI: 10.21449/ijate.1196701
T. Haladyna
The use of multiple-choice items for classroom testing is firmly established for many good reasons. The content any unit or course of study can be well sampled. Test scores can be reliable (trusted). And time spent administering and scoring can be minimized. This article provides a current review of best practices in the design and use of a variety of multiple-choice formats for classroom assessment of student learning. One of the most serious problems facing current educators is developing test items that measure more than simple factual recall. It is important to measure understanding, comprehension, critical thinking, and problem solving. Not only are these types of higher-level thinking described, but items are presented that illustrate how this is done. These best practices are continually evolving. The objective is always to use tests to measure validly what students have learned as well as help students learn what they have not yet learned. We call this formative and summative assessment. Guidelines are presented showing good and bad practices. What may be surprising to readers is the extensive variety of formats and methods for gathering or generating new test items. Readers are encouraged to experiment with these formats. Some formats can very efficiently measure what students were supposed to learn.
在课堂测试中使用多项选择题有很多很好的理由。任何单元或课程的内容都可以很好地抽样。考试成绩可以是可靠的。管理和评分所花费的时间可以最小化。这篇文章提供了设计和使用各种课堂评估学生学习的多项选择格式的最佳实践的最新回顾。当前教育工作者面临的最严重的问题之一是开发出比简单的事实记忆更重要的测试项目。衡量理解、理解、批判性思维和解决问题的能力是很重要的。不仅描述了这些类型的高级思维,而且还提供了一些项目来说明如何完成这些工作。这些最佳实践在不断发展。目标始终是使用测试来有效地衡量学生学到了什么,并帮助学生学习他们还没有学到的东西。我们称之为形成性和总结性评估。提出了指导方针,说明了好的和坏的做法。读者可能会感到惊讶的是,收集或生成新测试项的格式和方法种类繁多。我们鼓励读者尝试这些格式。一些格式可以非常有效地衡量学生应该学什么。
{"title":"Creating multiple-choice items for testing student learning","authors":"T. Haladyna","doi":"10.21449/ijate.1196701","DOIUrl":"https://doi.org/10.21449/ijate.1196701","url":null,"abstract":"The use of multiple-choice items for classroom testing is firmly established for many good reasons. The content any unit or course of study can be well sampled. Test scores can be reliable (trusted). And time spent administering and scoring can be minimized. This article provides a current review of best practices in the design and use of a variety of multiple-choice formats for classroom assessment of student learning. One of the most serious problems facing current educators is developing test items that measure more than simple factual recall. It is important to measure understanding, comprehension, critical thinking, and problem solving. Not only are these types of higher-level thinking described, but items are presented that illustrate how this is done. These best practices are continually evolving. The objective is always to use tests to measure validly what students have learned as well as help students learn what they have not yet learned. We call this formative and summative assessment. Guidelines are presented showing good and bad practices. What may be surprising to readers is the extensive variety of formats and methods for gathering or generating new test items. Readers are encouraged to experiment with these formats. Some formats can very efficiently measure what students were supposed to learn.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45929761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Investigation of Data Mining Classification Methods in Classifying Students According to 2018 PISA Reading Scores 数据挖掘分类方法在根据2018年PISA阅读成绩对学生进行分类中的应用研究
IF 0.9 Pub Date : 2022-11-29 DOI: 10.21449/ijate.1208809
Emrah Büyükatak, Duygu Anil
The purpose of this research was to determine classification accuracy of the factors affecting the success of students' reading skills based on PISA 2018 data by using Artificial Neural Networks, Decision Trees, K-Nearest Neighbor, and Naive Bayes data mining classification methods and to examine the general characteristics of success groups. In the research, 6890 student surveys of PISA 2018 were used. Firstly, missing data were examined and completed. Secondly, 24 index variables thought to affect the success of students' reading skills were determined by examining the related literature, PISA 2018 Technical Report, and PISA 2018 data. Thirdly, considering the sub-classification problem, the students were scaled in two categories as “Successful” and “Unsuccessful” according to the scores of PISA 2018 reading skills achievement test. Statistical analysis was conducted with SPSS MODELER program. At the end of the research, it was determined that Decision Trees C5.0 algorithm had the highest classification rate with 89.6%, the QUEST algorithm had the lowest classification rate with 75%, and four clusters were obtained proportionally close to each other in Two-Step Clustering analysis method to examine the general characteristics according to the success scores. It can be said that the data sets are suitable for clustering since the Silhouette Coefficient, which is calculated as 0.1 in clustering analyses, is greater than 0. It can be concluded that according to achievement scores, all data mining methods can be used to classify students since these models make accurate classification beyond chance.
本研究的目的是基于PISA 2018数据,使用人工神经网络、决策树、K-最近邻和Naive Bayes数据挖掘分类方法,确定影响学生阅读技能成功因素的分类准确性,并检验成功群体的一般特征。在这项研究中,使用了6890份PISA 2018的学生调查。首先,对缺失的数据进行了检查和填写。其次,通过查阅相关文献、PISA 2018技术报告和PISA 2018数据,确定了24个被认为影响学生阅读技能成功的指标变量。再次,考虑到亚分类问题,根据PISA 2018阅读技能成就测试的成绩,将学生分为“成功”和“不成功”两类。采用SPSS MODELER软件进行统计分析。在研究的最后,确定决策树C5.0算法的分类率最高,为89.6%,QUEST算法的分类效率最低,为75%,并且在两步聚类分析方法中获得了四个按比例接近的聚类,以根据成功分数检验总体特征。可以说,数据集适合聚类,因为在聚类分析中计算为0.1的Silhouette系数大于0。可以得出的结论是,根据成绩得分,所有的数据挖掘方法都可以用来对学生进行分类,因为这些模型使准确的分类变得不可能。
{"title":"An Investigation of Data Mining Classification Methods in Classifying Students According to 2018 PISA Reading Scores","authors":"Emrah Büyükatak, Duygu Anil","doi":"10.21449/ijate.1208809","DOIUrl":"https://doi.org/10.21449/ijate.1208809","url":null,"abstract":"The purpose of this research was to determine classification accuracy of the factors affecting the success of students' reading skills based on PISA 2018 data by using Artificial Neural Networks, Decision Trees, K-Nearest Neighbor, and Naive Bayes data mining classification methods and to examine the general characteristics of success groups. In the research, 6890 student surveys of PISA 2018 were used. Firstly, missing data were examined and completed. Secondly, 24 index variables thought to affect the success of students' reading skills were determined by examining the related literature, PISA 2018 Technical Report, and PISA 2018 data. Thirdly, considering the sub-classification problem, the students were scaled in two categories as “Successful” and “Unsuccessful” according to the scores of PISA 2018 reading skills achievement test. Statistical analysis was conducted with SPSS MODELER program. At the end of the research, it was determined that Decision Trees C5.0 algorithm had the highest classification rate with 89.6%, the QUEST algorithm had the lowest classification rate with 75%, and four clusters were obtained proportionally close to each other in Two-Step Clustering analysis method to examine the general characteristics according to the success scores. It can be said that the data sets are suitable for clustering since the Silhouette Coefficient, which is calculated as 0.1 in clustering analyses, is greater than 0. It can be concluded that according to achievement scores, all data mining methods can be used to classify students since these models make accurate classification beyond chance.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46087107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Effect of formative assessment on reading comprehension 形成性评价对阅读理解的影响
IF 0.9 Pub Date : 2022-11-29 DOI: 10.21449/ijate.1104868
Muhammet Sönmez, Fatih Çetin Çetinkaya
The aim of this research is to set forth the effects of formative assessment methods on reading comprehension. To this end, reading status of a group of students was assessed with formative assessment methods, while that of another group was evaluated with traditional ones. The research was carried out by using unequalised quasi-experimental design. The experimental and control groups of the research were randomly assigned. The study group consisted of 50 3rd grade students of a primary school in the Dilovası district of Kocaeli city, Türkiye. The data of the study were obtained from the texts within 3rd grade curriculum and from the comprehension questions prepared for these texts. The data were analyzed via SPSS 22 program. Mann-Whitney and Wilcoxon signed rank tests were used during analyses. In the findings of the research, a highly significant difference was observed in favor of the experimental group. As a result of the findings of the research, it was observed that formative assessment methods contributed to reading comprehension success positively.
本研究的目的是阐明形成性评价方法对阅读理解的影响。为此,我们采用形成性评价法对一组学生的阅读状况进行评价,而采用传统评价法对另一组学生进行评价。本研究采用非均衡准实验设计。本研究的实验组和对照组是随机分配的。该研究小组由基耶省科恰埃利市迪洛瓦斯基区一所小学的50名三年级学生组成。本研究的数据来自三年级课程中的课文和为这些课文准备的理解题。数据采用SPSS 22软件进行分析。分析时采用Mann-Whitney和Wilcoxon符号秩检验。在研究结果中,观察到一个非常显著的差异,有利于实验组。研究结果表明,形成性评价方法对阅读理解的成功有积极的促进作用。
{"title":"The Effect of formative assessment on reading comprehension","authors":"Muhammet Sönmez, Fatih Çetin Çetinkaya","doi":"10.21449/ijate.1104868","DOIUrl":"https://doi.org/10.21449/ijate.1104868","url":null,"abstract":"The aim of this research is to set forth the effects of formative assessment methods on reading comprehension. To this end, reading status of a group of students was assessed with formative assessment methods, while that of another group was evaluated with traditional ones. The research was carried out by using unequalised quasi-experimental design. The experimental and control groups of the research were randomly assigned. The study group consisted of 50 3rd grade students of a primary school in the Dilovası district of Kocaeli city, Türkiye. The data of the study were obtained from the texts within 3rd grade curriculum and from the comprehension questions prepared for these texts. The data were analyzed via SPSS 22 program. Mann-Whitney and Wilcoxon signed rank tests were used during analyses. In the findings of the research, a highly significant difference was observed in favor of the experimental group. As a result of the findings of the research, it was observed that formative assessment methods contributed to reading comprehension success positively.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68257915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Identifying the presence of context and item-writing flaws in practice items: The case of Turkish mathematics textbooks 识别练习项目中存在的语境和项目写作缺陷:以土耳其数学教科书为例
IF 0.9 Pub Date : 2022-11-29 DOI: 10.21449/ijate.1089472
Münevver İLGÜN DİBEK, Zerrin Toker
This study seeks to ascertain the degree to which context-based items are offered in Turkish mathematics textbooks as well as the quality of the items in terms of item writing guidelines, whether or not they are given as traditional or context-based. A qualitative research approach is used in this study. The eighth-grade mathematics textbook used in public schools and a textbook used in certain private school chains constitute its sample. The practice items (i.e, exercises without solutions given) included in the textbooks were analyzed by performing document analysis. The results revealed that both textbooks contain several flawed items in terms of item writing rules, as well as having mainly non-contextual items.
本研究旨在确定土耳其数学教科书中提供基于上下文的项目的程度,以及项目写作指南中项目的质量,无论这些项目是传统的还是基于上下文的。本研究采用了定性研究方法。公立学校使用的八年级数学教科书和某些私立学校连锁学校使用的教科书构成了其样本。通过文献分析对教材中的练习项目(即未给出解决方案的练习)进行了分析。研究结果表明,这两本教科书在项目写作规则方面都包含一些有缺陷的项目,而且主要有非上下文项目。
{"title":"Identifying the presence of context and item-writing flaws in practice items: The case of Turkish mathematics textbooks","authors":"Münevver İLGÜN DİBEK, Zerrin Toker","doi":"10.21449/ijate.1089472","DOIUrl":"https://doi.org/10.21449/ijate.1089472","url":null,"abstract":"This study seeks to ascertain the degree to which context-based items are offered in Turkish mathematics textbooks as well as the quality of the items in terms of item writing guidelines, whether or not they are given as traditional or context-based. A qualitative research approach is used in this study. The eighth-grade mathematics textbook used in public schools and a textbook used in certain private school chains constitute its sample. The practice items (i.e, exercises without solutions given) included in the textbooks were analyzed by performing document analysis. The results revealed that both textbooks contain several flawed items in terms of item writing rules, as well as having mainly non-contextual items.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42309652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Assessment Tools in Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1