{"title":"Comparison of Inter-Rater Reliability Techniques in Performance-Based Assessment","authors":"Sinem ARSLAN MANCAR, H. D. Gülleroğlu","doi":"10.21449/ijate.993805","DOIUrl":"https://doi.org/10.21449/ijate.993805","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43246563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The current study investigates the optimum number of response categories for the Likert type of scales under the item response theory (IRT). The data was collected from university students attend to mainly the faculty of medicine and the faculty of education. A form of the “Social Gender Equity Scale” developed by Gozutok et al. (2017) was prepared, which had 3, 5 and 7-point response categories. The graded response model (GRM) was used for item calibrations. The results of the study have revealed that using a 5-point response option provides advantages over using a 3-point response category in terms of reliability and test information perspective in the scale development process. The-5 point scale also provides easier responding process for the respondents while it does not pose a major disadvantage compared to a 7-point response category in the terms of reliability. Therefore, based on the findings of the study, researchers are recommended to use a 5-point response category in their scale development process.
{"title":"How many response categories are sufficient for Likert type scales? An empirical study based on the Item Response Theory","authors":"E. C. Aybek, Çetin Toraman","doi":"10.21449/ijate.1132931","DOIUrl":"https://doi.org/10.21449/ijate.1132931","url":null,"abstract":"The current study investigates the optimum number of response categories for the Likert type of scales under the item response theory (IRT). The data was collected from university students attend to mainly the faculty of medicine and the faculty of education. A form of the “Social Gender Equity Scale” developed by Gozutok et al. (2017) was prepared, which had 3, 5 and 7-point response categories. The graded response model (GRM) was used for item calibrations. The results of the study have revealed that using a 5-point response option provides advantages over using a 3-point response category in terms of reliability and test information perspective in the scale development process. The-5 point scale also provides easier responding process for the respondents while it does not pose a major disadvantage compared to a 7-point response category in the terms of reliability. Therefore, based on the findings of the study, researchers are recommended to use a 5-point response category in their scale development process.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47496027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Çiğdem AKIN ARIKAN, Pınar Kanık Uysal, Huzeyfe Bi̇lge, Kasım Yıldırım
{"title":"Reliability of Ratings of Multidimensional Fluency Scale with Many-Facet Rasch Model","authors":"Çiğdem AKIN ARIKAN, Pınar Kanık Uysal, Huzeyfe Bi̇lge, Kasım Yıldırım","doi":"10.21449/ijate.974214","DOIUrl":"https://doi.org/10.21449/ijate.974214","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48604436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigating the Impact of Rater Training on Rater Errors in the Process of Assessing Writing Skill","authors":"M. Şata, İsmail Karakaya","doi":"10.21449/ijate.877035","DOIUrl":"https://doi.org/10.21449/ijate.877035","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42906466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The thematic content analysis of the scales used in citizenship education","authors":"Melehat Gezer","doi":"10.21449/ijate.884855","DOIUrl":"https://doi.org/10.21449/ijate.884855","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":"1 1","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41508808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Item parameter recovery via traditional 2PL, Testlet and Bi-factor models for Testlet-Based tests","authors":"Sümeyra Soysal, Esin Yılmaz Koğar","doi":"10.21449/ijate.948182","DOIUrl":"https://doi.org/10.21449/ijate.948182","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45364593","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Scaling the criteria to be considered in determining exam anxiety by pairwise comparison method","authors":"Hasibe YAHSİ SARI, Duygu Anil","doi":"10.21449/ijate.960565","DOIUrl":"https://doi.org/10.21449/ijate.960565","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46966699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigation of the Effectiveness of the Research Skills Teaching Program","authors":"Betül Polat, O. Kutlu","doi":"10.21449/ijate.1058302","DOIUrl":"https://doi.org/10.21449/ijate.1058302","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45632046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Standard Setting in Academic Writing Assessment through Objective Standard Setting Method","authors":"Fatıma Nur Fişne, M. Şata, İsmail Karakaya","doi":"10.21449/ijate.1059304","DOIUrl":"https://doi.org/10.21449/ijate.1059304","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47178422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Collective Teacher Efficacy Behaviours Scale: A Validity and Reliability Study","authors":"Seyfettin Kapat, S. Şahin, Mevlüt Kara","doi":"10.21449/ijate.946171","DOIUrl":"https://doi.org/10.21449/ijate.946171","url":null,"abstract":"","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":" ","pages":""},"PeriodicalIF":0.9,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47750234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}