In this study, it was aimed to perform an in-depth examination of the opinions of social studies teachers on how citizenship education should be given. Phenomenology design, one of the qualitative research methods, was used in the research. The study group of the research was formed with 17 social studies teachers working in different regions of Turkey, having different professional seniority and also different genders, by using maximum diversity sampling. The data of the study were collected through a semi-structured interview form developed by the researchers. Descriptive analysis was used to analyze the data. As a result of the research, it was concluded that the perception of social studies teachers regarding the phenomenon of citizenship varied. It was determined that social studies teachers considered the main purpose of social studies as citizenship education and also as a course aimed at raising individuals that the society needs. In the study, it was also concluded that the teachers were of the opinion that appropriate content should be used, different teaching methods-techniques should be employed, and value education should be emphasized while giving citizenship education in the social studies course. Various suggestions were made based on the results of the research.
{"title":"How should citizenship education be given?: A study based on the opinions of social studies teachers","authors":"Suat Polat, Ibrahim Özgül, Hüseyin Bayram","doi":"10.21449/ijate.1150981","DOIUrl":"https://doi.org/10.21449/ijate.1150981","url":null,"abstract":"In this study, it was aimed to perform an in-depth examination of the opinions of social studies teachers on how citizenship education should be given. Phenomenology design, one of the qualitative research methods, was used in the research. The study group of the research was formed with 17 social studies teachers working in different regions of Turkey, having different professional seniority and also different genders, by using maximum diversity sampling. The data of the study were collected through a semi-structured interview form developed by the researchers. Descriptive analysis was used to analyze the data. As a result of the research, it was concluded that the perception of social studies teachers regarding the phenomenon of citizenship varied. It was determined that social studies teachers considered the main purpose of social studies as citizenship education and also as a course aimed at raising individuals that the society needs. In the study, it was also concluded that the teachers were of the opinion that appropriate content should be used, different teaching methods-techniques should be employed, and value education should be emphasized while giving citizenship education in the social studies course. Various suggestions were made based on the results of the research.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48704955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The three components that form the basis of the educational process are the teacher, the learner, and the environment. These three components are affected by the developing and changing technology as a result of globalization considerably. Teaching and learning techniques should be updated and connected with these developments; new tools are therefore needed to make the necessary updates. Determination and application of the new tools include many decisions. Decision-makers can make more effective decisions using Multi-Criteria Decision-Making Techniques (MCDM), a complex decision-making tool that includes both quantitative and qualitative factors at present time. This study aimed to determine which MCDM methods are used in studies conducted in higher education, which is one of the most important development level indicators of countries, and to present a systematic literature review of MCDM method applications. The study was conducted in three stages: first, known electronics were searched until the end of 2021 using keywords; then, all studies were listed in a systematic taxonomy, and in the last stage, Thematic Network Analysis was used to evaluate the development of MCDM studies in the higher education area. It is determined that the Analytical Hierarchy Process (AHP) method is the most widely used method in higher education in MCDM applications. It was observed that the most common use of MCDM applications in higher education is e-learning as well. This study aims to be a guide for all researchers and practitioners who will study in both higher education and the MCDM areas.
{"title":"A systematic literature review on multi-criteria decision making in higher education","authors":"Fatma Şeyma Yüksel, Ayşe Nilgün Kayadelen, Figen Antmen","doi":"10.21449/ijate.1104005","DOIUrl":"https://doi.org/10.21449/ijate.1104005","url":null,"abstract":"The three components that form the basis of the educational process are the teacher, the learner, and the environment. These three components are affected by the developing and changing technology as a result of globalization considerably. Teaching and learning techniques should be updated and connected with these developments; new tools are therefore needed to make the necessary updates. Determination and application of the new tools include many decisions. Decision-makers can make more effective decisions using Multi-Criteria Decision-Making Techniques (MCDM), a complex decision-making tool that includes both quantitative and qualitative factors at present time. This study aimed to determine which MCDM methods are used in studies conducted in higher education, which is one of the most important development level indicators of countries, and to present a systematic literature review of MCDM method applications. The study was conducted in three stages: first, known electronics were searched until the end of 2021 using keywords; then, all studies were listed in a systematic taxonomy, and in the last stage, Thematic Network Analysis was used to evaluate the development of MCDM studies in the higher education area. It is determined that the Analytical Hierarchy Process (AHP) method is the most widely used method in higher education in MCDM applications. It was observed that the most common use of MCDM applications in higher education is e-learning as well. This study aims to be a guide for all researchers and practitioners who will study in both higher education and the MCDM areas.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44393799","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this study, Kernel test equating methods were compared under NEAT and NEC designs. In NEAT design, Kernel post-stratification and chain equating methods taking into account optimal and large bandwidths were compared. In the NEC design, gender and/or computer/tablet use was considered as a covariate, and Kernel test equating methods were performed by using these covariates and considering bandwidths. The study shows that, in the NEAT design, Kernel chain equating methods exhibit higher error than the post-stratification equating methods do since the lowest error in the NEC design was obtained from the Kernel equating method with large bandwidth through the computer/tablet variable. Kernel test equating results based on the NEC design, which considers gender and computer tablet use variables as a covariate separately, showed lower SEE than that of the NEC pattern, which takes these variables together as covariates. In terms of the bandwidth, when all methods are compared within the pattern used (i.e., NEAT and NEC), it has been seen that generally Kernel test equating with large bandwidth results in fewer errors than the Kernel test equating with optimal bandwidth. When the NEAT and NEC designs are compared generally, the NEAT design has a lower SEE than that of the NEC design.
{"title":"Comparison of Kernel equating methods under NEAT and NEC designs","authors":"Şeyma Nur Özsoy, Sevilay Kilmen","doi":"10.21449/ijate.981367","DOIUrl":"https://doi.org/10.21449/ijate.981367","url":null,"abstract":"In this study, Kernel test equating methods were compared under NEAT and NEC designs. In NEAT design, Kernel post-stratification and chain equating methods taking into account optimal and large bandwidths were compared. In the NEC design, gender and/or computer/tablet use was considered as a covariate, and Kernel test equating methods were performed by using these covariates and considering bandwidths. The study shows that, in the NEAT design, Kernel chain equating methods exhibit higher error than the post-stratification equating methods do since the lowest error in the NEC design was obtained from the Kernel equating method with large bandwidth through the computer/tablet variable. Kernel test equating results based on the NEC design, which considers gender and computer tablet use variables as a covariate separately, showed lower SEE than that of the NEC pattern, which takes these variables together as covariates. In terms of the bandwidth, when all methods are compared within the pattern used (i.e., NEAT and NEC), it has been seen that generally Kernel test equating with large bandwidth results in fewer errors than the Kernel test equating with optimal bandwidth. When the NEAT and NEC designs are compared generally, the NEAT design has a lower SEE than that of the NEC design.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42516583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
International Journal of Assessment Tools in Education (IJATE) is one of the educational journals that is indexed in major worldwide databases such as Web of Science (WoS) and ERIC. This study presents the bibliometric characteristics of articles published in IJATE between 2014 and 2021 through the bibliometric analyses. Harzing's “Publish or Perish software” was used to collect citation data from WoS and Google Scholar databases as a tool to analyze the impact of articles. Firstly, when contributing institutions are analyzed, especially in recent, it is seen that researchers from countries such as France and Kuwait have been contributing to the journal with publications produced through international collaboration. Moreover, when the average citation numbers per article is calculated, it is understood that Australia (13) and Canada (3.5) are the countries that contribute significantly to the visibility of the journal. Such a trend will contribute significantly to the international recognition of the journal soon. On the other hand, there is a statistically significant positive relationship (r=0.339; p<0.01) between usage count and the number of citations by WoS. Our results reveal that while the number of references used in the articles was in consistent with the literature, the average article title lengths (12±3) were slightly longer than the ideal length (10±3). The results will provide important contributions to editors, reviewers, and authors in the journey of IJATE from local to global. The findings can guide authors, the editors and referees and also serve as a potential roadmap for the future studies and journal.
《国际教育评估工具期刊》(International Journal of Assessment Tools in Education, IJATE)是被Web of Science (WoS)和ERIC等全球主要数据库收录的教育期刊之一。本研究通过文献计量学分析，呈现了2014 - 2021年间IJATE发表文章的文献计量学特征。使用Harzing的“Publish or Perish”软件，从WoS和谷歌Scholar数据库中收集引文数据，作为分析文章影响力的工具。首先，当对贡献机构进行分析时，特别是最近，可以看到来自法国和科威特等国家的研究人员通过国际合作出版的出版物为该杂志做出了贡献。此外，当计算每篇文章的平均引用数时，可以理解澳大利亚(13)和加拿大(3.5)是对期刊知名度做出重大贡献的国家。这一趋势将为期刊的国际认可做出重大贡献。另一方面，存在统计学上显著的正相关(r=0.339;WoS的使用次数与被引次数之间存在p<0.01)。我们的研究结果显示，虽然文章中引用的文献数与文献一致，但平均标题长度(12±3)略高于理想长度(10±3)。这些结果将在IJATE从本地走向全球的过程中为编辑、审稿人和作者提供重要的贡献。这些发现可以指导作者、编辑和审稿人，也可以作为未来研究和期刊的潜在路线图。
{"title":"The Bibliometric Journey of IJATE from Local to Global","authors":"O. Karamustafaoğlu, M. Orbay, İ. Kara","doi":"10.21449/ijate.1212539","DOIUrl":"https://doi.org/10.21449/ijate.1212539","url":null,"abstract":"International Journal of Assessment Tools in Education (IJATE) is one of the educational journals that is indexed in major worldwide databases such as Web of Science (WoS) and ERIC. This study presents the bibliometric characteristics of articles published in IJATE between 2014 and 2021 through the bibliometric analyses. Harzing's “Publish or Perish software” was used to collect citation data from WoS and Google Scholar databases as a tool to analyze the impact of articles. Firstly, when contributing institutions are analyzed, especially in recent, it is seen that researchers from countries such as France and Kuwait have been contributing to the journal with publications produced through international collaboration. Moreover, when the average citation numbers per article is calculated, it is understood that Australia (13) and Canada (3.5) are the countries that contribute significantly to the visibility of the journal. Such a trend will contribute significantly to the international recognition of the journal soon. On the other hand, there is a statistically significant positive relationship (r=0.339; p<0.01) between usage count and the number of citations by WoS. Our results reveal that while the number of references used in the articles was in consistent with the literature, the average article title lengths (12±3) were slightly longer than the ideal length (10±3). The results will provide important contributions to editors, reviewers, and authors in the journey of IJATE from local to global. The findings can guide authors, the editors and referees and also serve as a potential roadmap for the future studies and journal.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41406780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study aimed to develop a useful test to measure university students’ spatial abilities validly and reliably. Following a sequential explanatory mixed methods research design, first, qualitative methods were used to develop the trial items for the test; next, the psychometric properties of the test were analyzed through quantitative methods using data obtained from 456 university students. As a result, a multiple-choice spatial ability test with 27 items and five options was created, divided into three subtests: spatial relations, spatial visualization, and spatial orientation. The results suggested that scores obtained from the spatial ability test and its subtests are valid and reliable.
{"title":"Spatial ability test for university students: Development, validity and reliability studies","authors":"K. Açıkgül, S. Şad, Bilal Altay","doi":"10.21449/ijate.1102435","DOIUrl":"https://doi.org/10.21449/ijate.1102435","url":null,"abstract":"This study aimed to develop a useful test to measure university students’ spatial abilities validly and reliably. Following a sequential explanatory mixed methods research design, first, qualitative methods were used to develop the trial items for the test; next, the psychometric properties of the test were analyzed through quantitative methods using data obtained from 456 university students. As a result, a multiple-choice spatial ability test with 27 items and five options was created, divided into three subtests: spatial relations, spatial visualization, and spatial orientation. The results suggested that scores obtained from the spatial ability test and its subtests are valid and reliable.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47497688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Likert-type item is the most popular response format for collecting data in social, educational, and psychological studies through scales or questionnaires. However, there is no consensus on whether parametric or non-parametric tests should be preferred when analyzing Likert-type data. This study examined the statistical power of parametric and non-parametric tests when each Likert-type item was analyzed independently in survey studies. The main purpose of the study is to examine the statistical power of Wilcoxon-Mann-Whitney, Welch's t, and Student's t tests for Likert-type data, which are pairwise comparison tests. For this purpose, a Monte Carlo simulation study was conducted. The statistical significance of the selected tests was examined under the conditions of sample size, group size ratio, and effect size. The results showed that the Wilcoxon-Mann-Whitney test was superior to its counterparts, especially for small samples and unequal group sizes. However, the Student's t-test for Likert-type data had similar statistical power to the Wilcoxon-Mann-Whitney test under conditions of equal group sizes when the sample size was 200 or more. Consistent with the empirical results, practical recommendations were provided for researchers on what to consider when collecting and analyzing Likert-type data.
{"title":"The power and type I error of Wilcoxon-Mann-Whitney, Welch's t, and Student's t tests for Likert-type data","authors":"A. Şimşek","doi":"10.21449/ijate.1183622","DOIUrl":"https://doi.org/10.21449/ijate.1183622","url":null,"abstract":"Likert-type item is the most popular response format for collecting data in social, educational, and psychological studies through scales or questionnaires. However, there is no consensus on whether parametric or non-parametric tests should be preferred when analyzing Likert-type data. This study examined the statistical power of parametric and non-parametric tests when each Likert-type item was analyzed independently in survey studies. The main purpose of the study is to examine the statistical power of Wilcoxon-Mann-Whitney, Welch's t, and Student's t tests for Likert-type data, which are pairwise comparison tests. For this purpose, a Monte Carlo simulation study was conducted. The statistical significance of the selected tests was examined under the conditions of sample size, group size ratio, and effect size. The results showed that the Wilcoxon-Mann-Whitney test was superior to its counterparts, especially for small samples and unequal group sizes. However, the Student's t-test for Likert-type data had similar statistical power to the Wilcoxon-Mann-Whitney test under conditions of equal group sizes when the sample size was 200 or more. Consistent with the empirical results, practical recommendations were provided for researchers on what to consider when collecting and analyzing Likert-type data.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49125740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Latent Class and Latent Profile Models are widely used in psychological assessment settings, especially when individual differences are suspected to be related to unobserved class memberships, such as different personality types. This paper provides an easy-to-follow introduction and application of the methodology to the data collected as part of more extensive educational research investigating social-emotional competency profiles of preservice teachers (n=184) who responded to an Emotional Awareness Questionnaire. Suspected that there would be two or more latent emotional awareness sub-groups in the sample, a series of latent profile models was estimated. The results suggested three distinct emotional awareness profiles; namely, introverted, extroverted, and less sensitive to others' emotions, with proportions of 9%, 56%, and 35%, respectively. Subsequent analyses showed that preservice teachers with higher levels of emotionality, sociability, and well-being were more likely to be in the extroverted profile. The findings suggest that nearly half of the teachers in the sample could be expected to possess the most professionally desirable teacher profile. Nonetheless, it was noted that if timely diagnostic and tailored training or intervention programs were available, at least some of the preservice teachers in the less sensitive to others' profiles, and most of the preservice teachers in the introverted profile could be helped to self-observe the way which they tend to identify and regulate their emotions.
{"title":"Modeling unobserved heterogeneity using person-centered approaches: Latent profiles of preservice teachers' emotional awareness","authors":"Esra SÖZER BOZ, Derya Akbaş, Nilufer Kahraman","doi":"10.21449/ijate.1148460","DOIUrl":"https://doi.org/10.21449/ijate.1148460","url":null,"abstract":"Latent Class and Latent Profile Models are widely used in psychological assessment settings, especially when individual differences are suspected to be related to unobserved class memberships, such as different personality types. This paper provides an easy-to-follow introduction and application of the methodology to the data collected as part of more extensive educational research investigating social-emotional competency profiles of preservice teachers (n=184) who responded to an Emotional Awareness Questionnaire. Suspected that there would be two or more latent emotional awareness sub-groups in the sample, a series of latent profile models was estimated. The results suggested three distinct emotional awareness profiles; namely, introverted, extroverted, and less sensitive to others' emotions, with proportions of 9%, 56%, and 35%, respectively. Subsequent analyses showed that preservice teachers with higher levels of emotionality, sociability, and well-being were more likely to be in the extroverted profile. The findings suggest that nearly half of the teachers in the sample could be expected to possess the most professionally desirable teacher profile. Nonetheless, it was noted that if timely diagnostic and tailored training or intervention programs were available, at least some of the preservice teachers in the less sensitive to others' profiles, and most of the preservice teachers in the introverted profile could be helped to self-observe the way which they tend to identify and regulate their emotions.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46059654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The aim of this study is to adapt the Crick Learning for Resilient Agency (CLARA) to Turkish culture, and to examine the psychometric features of the Inventory according to both Classical Test Theory (CTT) and Item Response Theory (IRT). In this respect, it is a descriptive level survey design research. Two different study groups were formed in accordance with the purpose of the study. Lingual equivalence applications were performed on two separate groups, one of which consisted of English Language and Literature Department students and the other consisted of English Language instructors. 1054 students participated in the validity and reliability studies from 101 different undergraduate programs at Ankara University. Before testing the research questions, it was examined whether the assumptions of CTT and IRT were met. With the application data; the predicted item discrimination indices, ability levels, students’ scores forming their learning power profiles, and reliability coefficient values were found to be similar in both theories. It can be said that with CLARA-Tr, obtained by adapting CLARA, a valid and reliable tool has been provided to the Turkish literature to be used in future studies.
{"title":"A Comperative Adaptation of the Crick Learning for Resilient Agency (CLARA) with Classical Test Theory and Item Response Theory","authors":"H. Özdemir, Ömer Kutlu, Shaofu Huang, R. Crick","doi":"10.21449/ijate.1058145","DOIUrl":"https://doi.org/10.21449/ijate.1058145","url":null,"abstract":"The aim of this study is to adapt the Crick Learning for Resilient Agency (CLARA) to Turkish culture, and to examine the psychometric features of the Inventory according to both Classical Test Theory (CTT) and Item Response Theory (IRT). In this respect, it is a descriptive level survey design research. Two different study groups were formed in accordance with the purpose of the study. Lingual equivalence applications were performed on two separate groups, one of which consisted of English Language and Literature Department students and the other consisted of English Language instructors. 1054 students participated in the validity and reliability studies from 101 different undergraduate programs at Ankara University. Before testing the research questions, it was examined whether the assumptions of CTT and IRT were met. With the application data; the predicted item discrimination indices, ability levels, students’ scores forming their learning power profiles, and reliability coefficient values were found to be similar in both theories. It can be said that with CLARA-Tr, obtained by adapting CLARA, a valid and reliable tool has been provided to the Turkish literature to be used in future studies.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48977601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The purpose of this study was to fill the gap in current research on educational mobile phone use within the framework for the rational analysis of the mobile education (FRAME) model. The paper developed and validated the Mobile Phone Use in Academic Environment Scale (MPUAES) to measure both positive and negative aspects of educational use of mobile phones. The data was collected from all faculties and all grade levels of Middle East Technical University in Ankara. The inclusion criterion for the participation in the study was owning a smartphone. The exploratory and confirmatory factor analyses were run with two different groups in a total of 1887 undergraduate students. Three factors structure with 18 items were obtained, which were labeled as facilitator, distractor, and connectedness. These three factors explained 63.42% of the total variance. For confirmation of the factor structure, confirmatory factor analysis was performed with the second sample. The Cronbach alpha coefficient of each factor ranged between .90 and .74. To conclude, the findings of the study proposed that the scores obtained from the developed scale were valid and reliable in measuring undergraduate students’ mobile phone use in an academic environment.
{"title":"The development and validation of a scale measuring mobile phone use in an academic environment","authors":"Nehir YASAN AK, Soner Yıldırım","doi":"10.21449/ijate.946609","DOIUrl":"https://doi.org/10.21449/ijate.946609","url":null,"abstract":"The purpose of this study was to fill the gap in current research on educational mobile phone use within the framework for the rational analysis of the mobile education (FRAME) model. The paper developed and validated the Mobile Phone Use in Academic Environment Scale (MPUAES) to measure both positive and negative aspects of educational use of mobile phones. The data was collected from all faculties and all grade levels of Middle East Technical University in Ankara. The inclusion criterion for the participation in the study was owning a smartphone. The exploratory and confirmatory factor analyses were run with two different groups in a total of 1887 undergraduate students. Three factors structure with 18 items were obtained, which were labeled as facilitator, distractor, and connectedness. These three factors explained 63.42% of the total variance. For confirmation of the factor structure, confirmatory factor analysis was performed with the second sample. The Cronbach alpha coefficient of each factor ranged between .90 and .74. To conclude, the findings of the study proposed that the scores obtained from the developed scale were valid and reliable in measuring undergraduate students’ mobile phone use in an academic environment.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47901524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study aims to examine the effects of mixture item response theory (IRT) models on item parameter estimation and classification accuracy under different conditions. The manipulated variables of the simulation study are set as mixture IRT models (Rasch, 2PL, 3PL); sample size (600, 1000); the number of items (10, 30); the number of latent classes (2, 3); missing data type (complete, missing at random (MAR) and missing not at random (MNAR)), and the percentage of missing data (10%, 20%). Data were generated for each of the three mixture IRT models using the code written in R program. MplusAutomation package, which provides the automation of R and Mplus program, was used to analyze the data. The mean RMSE values for item difficulty, item discrimination, and guessing parameter estimation were determined. The mean RMSE values as to the Mixture Rasch model were found to be lower than those of the Mixture 2PL and Mixture 3PL models. Percentages of classification accuracy were also computed. It was noted that the Mixture Rasch model with 30 items, 2 classes, 1000 sample size, and complete data conditions had the highest classification accuracy percentage. Additionally, a factorial ANOVA was used to evaluate each factor's main effects and interaction effects.
{"title":"Investigation of the effect of parameter estimation and classification accuracy in mixture IRT models under different conditions","authors":"F. Saatçi̇oğlu, H. Atar","doi":"10.21449/ijate.1164590","DOIUrl":"https://doi.org/10.21449/ijate.1164590","url":null,"abstract":"This study aims to examine the effects of mixture item response theory (IRT) models on item parameter estimation and classification accuracy under different conditions. The manipulated variables of the simulation study are set as mixture IRT models (Rasch, 2PL, 3PL); sample size (600, 1000); the number of items (10, 30); the number of latent classes (2, 3); missing data type (complete, missing at random (MAR) and missing not at random (MNAR)), and the percentage of missing data (10%, 20%). Data were generated for each of the three mixture IRT models using the code written in R program. MplusAutomation package, which provides the automation of R and Mplus program, was used to analyze the data. The mean RMSE values for item difficulty, item discrimination, and guessing parameter estimation were determined. The mean RMSE values as to the Mixture Rasch model were found to be lower than those of the Mixture 2PL and Mixture 3PL models. Percentages of classification accuracy were also computed. It was noted that the Mixture Rasch model with 30 items, 2 classes, 1000 sample size, and complete data conditions had the highest classification accuracy percentage. Additionally, a factorial ANOVA was used to evaluate each factor's main effects and interaction effects.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2022-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49301384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：