Despite the unanimous agreement regarding the positive outcomes of learner engagement, theorists and researchers draw attention to the disparate conceptualizations and structural models of “engagement” construct. The present study, in this respect, attempts to contribute to the development of a theoretical framework by suggesting a multidimensional overarching model for assessing higher education learner engagement. Following the descriptive research design, the study reports the initial model construction and validation results. The findings show significant differences from the earlier conceptualizations indicating a five-dimension model: academic-functional, cognitive, meta-cognitive, collaborative-social, and collaborative- academic engagement. While metacognitive engagement indicators form a distinct but integral dimension in the construct, the social dimension displays an idiosyncratic structure, implying that the multidimensional nature of the engagement construct has a situated nature. Pedagogical implications are discussed based on the engagement model validated.
{"title":"Deconstructing Learner Engagement: An Expanded Construct Model for Higher Education Learners","authors":"Meral ŞEKER","doi":"10.21449/ijate.1215747","DOIUrl":"https://doi.org/10.21449/ijate.1215747","url":null,"abstract":"Despite the unanimous agreement regarding the positive outcomes of learner engagement, theorists and researchers draw attention to the disparate conceptualizations and structural models of “engagement” construct. The present study, in this respect, attempts to contribute to the development of a theoretical framework by suggesting a multidimensional overarching model for assessing higher education learner engagement. Following the descriptive research design, the study reports the initial model construction and validation results. The findings show significant differences from the earlier conceptualizations indicating a five-dimension model: academic-functional, cognitive, meta-cognitive, collaborative-social, and collaborative- academic engagement. While metacognitive engagement indicators form a distinct but integral dimension in the construct, the social dimension displays an idiosyncratic structure, implying that the multidimensional nature of the engagement construct has a situated nature. Pedagogical implications are discussed based on the engagement model validated.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136010391","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Consuming sports products and services incessantly without being able to restrain oneself is characterized as compulsive sports consumption. The aim of this study is to adapt the Compulsive Sport Consumption Scale (CSCS) developed in English by Aiken et al. (2018) into Turkish utilizing a scientific scale adaptation process. The CSCS consists of six items and is graded on a seven-point Likert scale ranging from strongly disagree to strongly agree. Higher CSCS levels are affiliated with psychological and behavioral constructs related to the effects of sports consumption, such as time, money, coping, and psychological and behavioral neglect. The scale has been tailored via a group of English and Turkish linguists, sports scientist, and psychometrist. Parallel analysis has been performed on account of inspecting the dimensionality of the scale, and many statistics such as unidimensional congruence, explained common variance, mean of item residual absolute loadings, and robust fit statistics have been used. In accordance with parallel analysis, the scale was unidimensional, and all other statistics supported that as well. The unidimensional adapted scale (CSCS-T) explained approximately 83% of the total variance. Additionally, internal consistency, composite reliability, and test-retest reliability have been examined to determine the measurement's reliability. Cronbach's Alpha was .958, McDonald's Omega was .958, and Pearson's product-moment correlation coefficient was .923 in the wake of the test-retest application. All of the findings propound that when investigating compulsive over-participation in sports consumption in Turkish-speaking populations, the CSCS-T can be used to acquire valid and reliable measures.
{"title":"Adaptation of compulsive sport consumption scale into Turkish culture: CSCS-T","authors":"Murat AYGÜN, Sait ÇÜM","doi":"10.21449/ijate.1263531","DOIUrl":"https://doi.org/10.21449/ijate.1263531","url":null,"abstract":"Consuming sports products and services incessantly without being able to restrain oneself is characterized as compulsive sports consumption. The aim of this study is to adapt the Compulsive Sport Consumption Scale (CSCS) developed in English by Aiken et al. (2018) into Turkish utilizing a scientific scale adaptation process. The CSCS consists of six items and is graded on a seven-point Likert scale ranging from strongly disagree to strongly agree. Higher CSCS levels are affiliated with psychological and behavioral constructs related to the effects of sports consumption, such as time, money, coping, and psychological and behavioral neglect. The scale has been tailored via a group of English and Turkish linguists, sports scientist, and psychometrist. Parallel analysis has been performed on account of inspecting the dimensionality of the scale, and many statistics such as unidimensional congruence, explained common variance, mean of item residual absolute loadings, and robust fit statistics have been used. In accordance with parallel analysis, the scale was unidimensional, and all other statistics supported that as well. The unidimensional adapted scale (CSCS-T) explained approximately 83% of the total variance. Additionally, internal consistency, composite reliability, and test-retest reliability have been examined to determine the measurement's reliability. Cronbach's Alpha was .958, McDonald's Omega was .958, and Pearson's product-moment correlation coefficient was .923 in the wake of the test-retest application. All of the findings propound that when investigating compulsive over-participation in sports consumption in Turkish-speaking populations, the CSCS-T can be used to acquire valid and reliable measures.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136010524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The aim of the study was to describe the validity and reliability of the Turkish version of Juvenile Arthritis Functional Assessment Report (JAFAR) in children/adolescents with Juvenile Idiopathic Arthritis (JIA). Sixty-nine children/adolescents with JIA were included in the study. JAFAR(TR)-Child and Parent forms were applied to the patients with JIA and to their parents for test retest at one-week intervals, the patients did not receive additional treatment and his/her pharmacological treatment did not change for that week. Test-retest reliability was evaluated by intraclass correlation coefficient (ICC), and internal consistency reliability of multi-item subscales was evaluated by calculating Cronbach's alpha coefficient. Correlations between JAFAR(TR)-Child and Parent with the Pediatric Quality of Life Inventory 3.0. Module Arthritis (PedsQL), the Childhood Health Assessment Questionnaire (CHAQ), and the Juvenile Arthritis Disease Activity Score (JADAS) were evaluated to determine construct validity. The ICC value for the test/retest reliability of JAFAR(TR)-Child was 0.963 and of JAFAR(TR)-Parent was 0.576. JAFAR(TR)-Child total score had low to moderate correlations with PedsQL Child (r=-0.34; p=0.004), CHAQ (r=0.40; p=0.001), and JADAS total score (r=0.42; p=0.000). JAFAR(TR)-Parent total score had moderate to high correlations with PedsQL Parent (r=-0.55; p=0.000), CHAQ (r=0.72; p=0.000) and JADAS total score (r=0.53; p= 0.000). The Turkish version of JAFAR was found to be clinically valid and reliable in JIA.
{"title":"The validity and reliability of the Juvenile Arthritis Functional Assessment Report (JAFAR) in children/adolescents with Juvenile Idiopathic Arthritis: The Turkish version study","authors":"Merve BALİ, Elif GUR KABUL, Bilge BAŞAKÇI ÇALIK, Gülçin OTAR YENER, Zahide EKİCİ TEKİN, Selcuk YUKSEL","doi":"10.21449/ijate.1295077","DOIUrl":"https://doi.org/10.21449/ijate.1295077","url":null,"abstract":"The aim of the study was to describe the validity and reliability of the Turkish version of Juvenile Arthritis Functional Assessment Report (JAFAR) in children/adolescents with Juvenile Idiopathic Arthritis (JIA). Sixty-nine children/adolescents with JIA were included in the study. JAFAR(TR)-Child and Parent forms were applied to the patients with JIA and to their parents for test retest at one-week intervals, the patients did not receive additional treatment and his/her pharmacological treatment did not change for that week. Test-retest reliability was evaluated by intraclass correlation coefficient (ICC), and internal consistency reliability of multi-item subscales was evaluated by calculating Cronbach's alpha coefficient. Correlations between JAFAR(TR)-Child and Parent with the Pediatric Quality of Life Inventory 3.0. Module Arthritis (PedsQL), the Childhood Health Assessment Questionnaire (CHAQ), and the Juvenile Arthritis Disease Activity Score (JADAS) were evaluated to determine construct validity. The ICC value for the test/retest reliability of JAFAR(TR)-Child was 0.963 and of JAFAR(TR)-Parent was 0.576. JAFAR(TR)-Child total score had low to moderate correlations with PedsQL Child (r=-0.34; p=0.004), CHAQ (r=0.40; p=0.001), and JADAS total score (r=0.42; p=0.000). JAFAR(TR)-Parent total score had moderate to high correlations with PedsQL Parent (r=-0.55; p=0.000), CHAQ (r=0.72; p=0.000) and JADAS total score (r=0.53; p= 0.000). The Turkish version of JAFAR was found to be clinically valid and reliable in JIA.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136010392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The field of curriculum is characterized by its porous and evolving boundaries, which are influenced by ongoing shifts in sociological, technological, scientific, and political domains. Given this dynamic context, the field necessitates continuous advancements to address these evolving trends. Consequently, its scope and prevailing research foci are subject to change, thereby shaping curricular adaptations. The primary objective of this study is to delineate the contemporary scope of curriculum studies by examining prevailing topics of discourse. Research articles published in two selected journals—Curriculum Inquiry and Journal of Curriculum Studies—were analyzed to achieve this. These journals were chosen for their alignment with the study's objective and were employed as primary data sources. A bibliometric analysis was conducted on data harvested from these publications, utilizing descriptive statistics through the Web of Science (WoS) system as an initial analytical step. Subsequently, VOSviewer software was employed for advanced bibliometric analyses. The study's findings offer both visual and descriptive insights into how the thematic focus within curriculum studies has shifted over time. Notably, recent discussions within the field underscore the exigency for democratic curriculum reforms. Moreover, the issues addressed by the selected journals closely align with current societal challenges.
课程领域的特点是其多孔性和不断变化的边界，受到社会学、技术、科学和政治领域不断变化的影响。鉴于这种动态环境，该领域需要不断进步以应对这些不断变化的趋势。因此，它的范围和主要的研究焦点可能会发生变化，从而形成课程适应。本研究的主要目的是通过考察话语的流行主题来描绘课程研究的当代范围。本文分析了发表在《课程探究》和《课程研究期刊》上的研究论文。选择这些期刊是因为它们与研究的目标一致，并被用作主要数据来源。对从这些出版物中收集的数据进行了文献计量学分析，通过科学网络(Web of Science, WoS)系统利用描述性统计作为初始分析步骤。随后，使用VOSviewer软件进行高级文献计量分析。这项研究的发现为课程研究的主题焦点如何随着时间的推移而变化提供了视觉和描述性的见解。值得注意的是，该领域最近的讨论强调了民主课程改革的迫切性。此外，所选期刊所讨论的问题与当前的社会挑战密切相关。
{"title":"A bibliometric journey into research trends in curriculum field: Analysis of two journals","authors":"Suat KAYA","doi":"10.21449/ijate.1278728","DOIUrl":"https://doi.org/10.21449/ijate.1278728","url":null,"abstract":"The field of curriculum is characterized by its porous and evolving boundaries, which are influenced by ongoing shifts in sociological, technological, scientific, and political domains. Given this dynamic context, the field necessitates continuous advancements to address these evolving trends. Consequently, its scope and prevailing research foci are subject to change, thereby shaping curricular adaptations. The primary objective of this study is to delineate the contemporary scope of curriculum studies by examining prevailing topics of discourse. Research articles published in two selected journals—Curriculum Inquiry and Journal of Curriculum Studies—were analyzed to achieve this. These journals were chosen for their alignment with the study's objective and were employed as primary data sources. A bibliometric analysis was conducted on data harvested from these publications, utilizing descriptive statistics through the Web of Science (WoS) system as an initial analytical step. Subsequently, VOSviewer software was employed for advanced bibliometric analyses. The study's findings offer both visual and descriptive insights into how the thematic focus within curriculum studies has shifted over time. Notably, recent discussions within the field underscore the exigency for democratic curriculum reforms. Moreover, the issues addressed by the selected journals closely align with current societal challenges.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136010394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Investigating the existence of items with differential item functioning (DIF) may provide more accurate comparisons of group differences in studies that aim to compare scores obtained in a test by groups with different characteristics. In the present study, a scale measuring critical thinking motivation that was adapted to the Turkish culture was applied to 817 participants, who were high school graduates, university students, and university graduates. The aim of the study was to examine whether the data collected from these participants had DIF or not. Hence, DIF analysis of the collected data was performed via the "lordif" function in the R "lordif" package. DIF was found to occur in twelve items, three of which were related to gender and nine to level of education. While it was revealed that the content of the items was the source of gender related DIF, the source of DIF related to level of education was found to be the language and expression of the items.
{"title":"Investigating the sources of differential item functioning: A sample critical thinking motivation scale","authors":"Fatma Betül KURNAZ, Hüseyin YILDIZ","doi":"10.21449/ijate.1279152","DOIUrl":"https://doi.org/10.21449/ijate.1279152","url":null,"abstract":"Investigating the existence of items with differential item functioning (DIF) may provide more accurate comparisons of group differences in studies that aim to compare scores obtained in a test by groups with different characteristics. In the present study, a scale measuring critical thinking motivation that was adapted to the Turkish culture was applied to 817 participants, who were high school graduates, university students, and university graduates. The aim of the study was to examine whether the data collected from these participants had DIF or not. Hence, DIF analysis of the collected data was performed via the \"lordif\" function in the R \"lordif\" package. DIF was found to occur in twelve items, three of which were related to gender and nine to level of education. While it was revealed that the content of the items was the source of gender related DIF, the source of DIF related to level of education was found to be the language and expression of the items.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136010396","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The aim of this study is to investigate the impact of online peer feedback in the Information Technologies and Software course on the improvement of collaborative problem-solving skills (CPS), which are considered essential skills for the 21st century. The impact of peer feedback on CPS was designed using a mixed-methods approach that combines quantitative and qualitative data in the research. The study employed a set of CPS tasks that were specifically designed to measure the target behaviors outlined in the 6th-grade Information Technologies and Software course curriculum. Additionally, the study made use of various instruments, including a peer feedback survey, a longitudinal rating scale for tracking the development of CPS, and a peer feedback interview protocol. As a result, a statistically significant difference was found between the CPS of the experimental and control groups. According to the results of the study, it can be expressed that the CPS and peer feedback skills of the students in the experimental group have improved and that they have a more positive attitude toward giving peer feedback and solving collaborative problems based on the results of the interview form.
{"title":"The impact of peer feedback on collaborative problem-solving skills in the online environment","authors":"Yeşim KARADAĞ, Seher YALÇIN","doi":"10.21449/ijate.1290901","DOIUrl":"https://doi.org/10.21449/ijate.1290901","url":null,"abstract":"The aim of this study is to investigate the impact of online peer feedback in the Information Technologies and Software course on the improvement of collaborative problem-solving skills (CPS), which are considered essential skills for the 21st century. The impact of peer feedback on CPS was designed using a mixed-methods approach that combines quantitative and qualitative data in the research. The study employed a set of CPS tasks that were specifically designed to measure the target behaviors outlined in the 6th-grade Information Technologies and Software course curriculum. Additionally, the study made use of various instruments, including a peer feedback survey, a longitudinal rating scale for tracking the development of CPS, and a peer feedback interview protocol. As a result, a statistically significant difference was found between the CPS of the experimental and control groups. According to the results of the study, it can be expressed that the CPS and peer feedback skills of the students in the experimental group have improved and that they have a more positive attitude toward giving peer feedback and solving collaborative problems based on the results of the interview form.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136011673","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The university environment provides a good context for entrepreneurship education. With the vigorous development of entrepreneurship education, educators and scholars have shown increasing interest in the significant role entrepreneurship education plays in higher education. As a result, the effectiveness of entrepreneurship education has quickly become a popular topic. However, it is often not easy to evaluate entrepreneurship education programs, which are designed for medium- and long-term outcomes. It is essential to develop alternative assessment tools that do not traditionally assess only knowledge. The study aims to adapt the multidimensional measurement tool for assessing university students' entrepreneurial skills, knowledge, attitudes, and mindsets. While the scale was translated into Turkish, face and content validity were proved. The data was gathered from 572 university students. Confirmatory factor analyses were employed to assess the construct validity of the measure. The Turkish Entrepreneurship Education Self-Efficiency Scale was obtained with three main dimensions and 38 items. Its Cronbach’s alpha, Spearman-Brown correlation, and composite reliability coefficients are 0.95, 0.86, and 0.98, respectively. Furthermore, the study found that the entrepreneurship education scores of the participants were significantly related to their gender, field of education, volunteering, work experience, experience of starting or running their own business, and entrepreneurship education. The effect size of these variables differs, and the experience with self-employment has the greatest influence on entrepreneurship education.
{"title":"Adaptation of an entrepreneurship education self-assessment scale at the tertiary level into Turkish","authors":"Ahmet ÇELİK, Ebru SOLMAZ","doi":"10.21449/ijate.1243812","DOIUrl":"https://doi.org/10.21449/ijate.1243812","url":null,"abstract":"The university environment provides a good context for entrepreneurship education. With the vigorous development of entrepreneurship education, educators and scholars have shown increasing interest in the significant role entrepreneurship education plays in higher education. As a result, the effectiveness of entrepreneurship education has quickly become a popular topic. However, it is often not easy to evaluate entrepreneurship education programs, which are designed for medium- and long-term outcomes. It is essential to develop alternative assessment tools that do not traditionally assess only knowledge. The study aims to adapt the multidimensional measurement tool for assessing university students' entrepreneurial skills, knowledge, attitudes, and mindsets. While the scale was translated into Turkish, face and content validity were proved. The data was gathered from 572 university students. Confirmatory factor analyses were employed to assess the construct validity of the measure. The Turkish Entrepreneurship Education Self-Efficiency Scale was obtained with three main dimensions and 38 items. Its Cronbach’s alpha, Spearman-Brown correlation, and composite reliability coefficients are 0.95, 0.86, and 0.98, respectively. Furthermore, the study found that the entrepreneurship education scores of the participants were significantly related to their gender, field of education, volunteering, work experience, experience of starting or running their own business, and entrepreneurship education. The effect size of these variables differs, and the experience with self-employment has the greatest influence on entrepreneurship education.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135109714","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
It is said that working on forgiveness in psychological counseling will significantly benefit the individual, taking into account the good consequences of forgiving on the individual. This study aimed to develop a measurement tool for determining self-efficacy to work on forgiveness in counseling (SSWOFIC). The most commonly regarded forgiveness process model, Enright's Forgiveness Process Model, served as the foundation for the creation of this measurement tool. 285 counselors provided information for the Exploratory Factor Analysis (EFA) and 258 counselors provided information for the Confirmatory Factor Analysis (CFA). For the content validity of the scale, eight specialists were contacted. EFA revealed a single factor structure with 41 items that accounted for 61.7% of the overall variation. It was found that all of the SSWOFIC's items were discriminative and had a high level of factor loading value in the pertinent factor. To ascertain if the structure identified by EFA was confirmed or not, CFA was carried out. The one-factor structure was confirmed, as evidenced by the resulting model's fit indices. The computed Cronbach's Alpha and McDonald's Omega reliability coefficients were 0.99, and the Split-Half method's results for the Guttman and Spearman-Brown coefficients were 0.96. The SSWOFIC results demonstrated the validity and reliability of the scale, which consists of a single component and 41 items. The established scale will make it possible to conduct studies to ascertain the level of self-efficacy of psychological counselors with regard to this matter and to examine this feature in terms of other variables.
{"title":"The development of a scale of self-efficacy to work on forgiveness in counseling","authors":"Meryem VURAL BATIK, Selda ÖRS ÖZDİL, Necla AFYONKALE TALAY","doi":"10.21449/ijate.1263121","DOIUrl":"https://doi.org/10.21449/ijate.1263121","url":null,"abstract":"It is said that working on forgiveness in psychological counseling will significantly benefit the individual, taking into account the good consequences of forgiving on the individual. This study aimed to develop a measurement tool for determining self-efficacy to work on forgiveness in counseling (SSWOFIC). The most commonly regarded forgiveness process model, Enright's Forgiveness Process Model, served as the foundation for the creation of this measurement tool. 285 counselors provided information for the Exploratory Factor Analysis (EFA) and 258 counselors provided information for the Confirmatory Factor Analysis (CFA). For the content validity of the scale, eight specialists were contacted. EFA revealed a single factor structure with 41 items that accounted for 61.7% of the overall variation. It was found that all of the SSWOFIC's items were discriminative and had a high level of factor loading value in the pertinent factor. To ascertain if the structure identified by EFA was confirmed or not, CFA was carried out. The one-factor structure was confirmed, as evidenced by the resulting model's fit indices. The computed Cronbach's Alpha and McDonald's Omega reliability coefficients were 0.99, and the Split-Half method's results for the Guttman and Spearman-Brown coefficients were 0.96. The SSWOFIC results demonstrated the validity and reliability of the scale, which consists of a single component and 41 items. The established scale will make it possible to conduct studies to ascertain the level of self-efficacy of psychological counselors with regard to this matter and to examine this feature in terms of other variables.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44970260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions. In our country, research on the application of measurement and evaluation tools in the computer environment for use with distance education is gaining momentum. A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers. Preparing a large pool of items also requires more effort in terms of time, effort, and cost. To overcome this problem, automatic item generation has been widely used by bringing together item development subject matter experts and computer technology. In the present research, the steps for implementing automatic item generation are explained through an example. In the research, which was based on the fundamental research method, first a total of 2560 items were generated using computer technology and SMEs in field of Turkish literature. In the second stage, 60 randomly selected items were examined. As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.
{"title":"Automatic item generation for online measurement and evaluation: Turkish literature items","authors":"Ayfer Sayin, Mark J. Gierl","doi":"10.21449/ijate.1249297","DOIUrl":"https://doi.org/10.21449/ijate.1249297","url":null,"abstract":"Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions. In our country, research on the application of measurement and evaluation tools in the computer environment for use with distance education is gaining momentum. A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers. Preparing a large pool of items also requires more effort in terms of time, effort, and cost. To overcome this problem, automatic item generation has been widely used by bringing together item development subject matter experts and computer technology. In the present research, the steps for implementing automatic item generation are explained through an example. In the research, which was based on the fundamental research method, first a total of 2560 items were generated using computer technology and SMEs in field of Turkish literature. In the second stage, 60 randomly selected items were examined. As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42439877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study aims to adapt the revised Metacognitive Awareness of Reading Strategies Inventory (MARSI- R) into Turkish. MARSI-R is a self-report instrument designed to assess students’ metacognitive awareness of reading strategies and perceived strategy use when reading school-related materials. 525 students (65% female, 35% male, Mage = 13 years old.) from multiple school types and degrees participated in this study. A stepwise validation procedure was used to translate and produce a Turkish version of the inventory. Evidence of structural and external aspects of validity for the inventory was collected. The 15-item inventory had a three-factor solution (global reading strategies, problem-solving strategies, and support reading strategies), as supported by confirmatory factor analysis. Turkish version scores were positively correlated with students' perceived reading ability, which provides evidence of MARSI-R's external validity. The coefficient of stability was calculated using data from 85 students who took the Turkish version of the MARSI-R twice in a five-week interval. The study’s overall results provided evidence of the reliability and validity of the inventory. According to the results presented in this study, the Turkish version of the inventory can be implemented to assess the students’ metacognitive awareness of reading strategies and perceived strategy use. The findings show that the adapted inventory can be used to obtain valid and reliable results for Turkish lower and upper secondary school students.
{"title":"The validity and reliability of the Turkish version of revised metacognitive awareness of reading strategies inventory","authors":"Rabia Börekci̇, Caner Börekci","doi":"10.21449/ijate.1238250","DOIUrl":"https://doi.org/10.21449/ijate.1238250","url":null,"abstract":"This study aims to adapt the revised Metacognitive Awareness of Reading Strategies Inventory (MARSI- R) into Turkish. MARSI-R is a self-report instrument designed to assess students’ metacognitive awareness of reading strategies and perceived strategy use when reading school-related materials. 525 students (65% female, 35% male, Mage = 13 years old.) from multiple school types and degrees participated in this study. A stepwise validation procedure was used to translate and produce a Turkish version of the inventory. Evidence of structural and external aspects of validity for the inventory was collected. The 15-item inventory had a three-factor solution (global reading strategies, problem-solving strategies, and support reading strategies), as supported by confirmatory factor analysis. Turkish version scores were positively correlated with students' perceived reading ability, which provides evidence of MARSI-R's external validity. The coefficient of stability was calculated using data from 85 students who took the Turkish version of the MARSI-R twice in a five-week interval. The study’s overall results provided evidence of the reliability and validity of the inventory. According to the results presented in this study, the Turkish version of the inventory can be implemented to assess the students’ metacognitive awareness of reading strategies and perceived strategy use. The findings show that the adapted inventory can be used to obtain valid and reliable results for Turkish lower and upper secondary school students.","PeriodicalId":42417,"journal":{"name":"International Journal of Assessment Tools in Education","volume":null,"pages":null},"PeriodicalIF":0.9,"publicationDate":"2023-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44613498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：