Pub Date : 2021-04-01DOI: 10.3102/0034654320985611
Becca Merrill
Teacher working conditions (TWCs) are, in many ways, student learning conditions. Furthermore, they have also been linked to teacher retention. These connections make TWCs important to understand; yet there is no accepted construct definition delineating and defining what TWCs are. Through a systematic review and narrative synthesis of literature from the United States, I define TWCs and organize the topics that emerged from the literature into a catalog of TWCs. After defining what TWCs are, I employ findings from the narrative synthesis to discuss what TWCs are not. Additionally, I document sources of variation in operationalizing TWCs as well as areas of homogeneity in how researchers study TWCs. I find that researchers agree on the underlying concept of TWCs, vary widely in how they decompose the concept, and overwhelmingly use survey methods to study TWCs. Last, I offer three suggestions to consider in future research.
{"title":"Configuring a Construct Definition of Teacher Working Conditions in the United States: A Systematic Narrative Review of Researcher Concepts","authors":"Becca Merrill","doi":"10.3102/0034654320985611","DOIUrl":"https://doi.org/10.3102/0034654320985611","url":null,"abstract":"Teacher working conditions (TWCs) are, in many ways, student learning conditions. Furthermore, they have also been linked to teacher retention. These connections make TWCs important to understand; yet there is no accepted construct definition delineating and defining what TWCs are. Through a systematic review and narrative synthesis of literature from the United States, I define TWCs and organize the topics that emerged from the literature into a catalog of TWCs. After defining what TWCs are, I employ findings from the narrative synthesis to discuss what TWCs are not. Additionally, I document sources of variation in operationalizing TWCs as well as areas of homogeneity in how researchers study TWCs. I find that researchers agree on the underlying concept of TWCs, vary widely in how they decompose the concept, and overwhelmingly use survey methods to study TWCs. Last, I offer three suggestions to consider in future research.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"163 - 203"},"PeriodicalIF":11.2,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41486191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-04-01DOI: 10.3102/0034654321990721
Rachelle Esterhazy, T. de Lange, S. Bastiansen, Anne Line Wittek
Over the past decades, peer review of teaching has become commonplace at many universities around the world. Though research on the topic is expanding, much of the literature is composed of qualitative studies that offer relevant empirical findings but often have limited foundations in theory. Using a framework synthesis approach, we synthesize the empirical findings of 48 qualitative articles on peer review of teaching into a comprehensive conceptual framework drawing on sociocultural perspectives of learning. We propose the term “collegial faculty development” (CFD) to encompass all practices that support faculty in developing their teaching quality by drawing on the expertise of their colleagues. Our framework conceptualizes the main elements of CFD and shows how different contextual, individual, and relational factors shape the way CFD unfolds. Based on these theoretical considerations, we discuss issues of intersubjectivity, materiality, and temporality as potential avenues for further research.
{"title":"Moving Beyond Peer Review of Teaching: A Conceptual Framework for Collegial Faculty Development","authors":"Rachelle Esterhazy, T. de Lange, S. Bastiansen, Anne Line Wittek","doi":"10.3102/0034654321990721","DOIUrl":"https://doi.org/10.3102/0034654321990721","url":null,"abstract":"Over the past decades, peer review of teaching has become commonplace at many universities around the world. Though research on the topic is expanding, much of the literature is composed of qualitative studies that offer relevant empirical findings but often have limited foundations in theory. Using a framework synthesis approach, we synthesize the empirical findings of 48 qualitative articles on peer review of teaching into a comprehensive conceptual framework drawing on sociocultural perspectives of learning. We propose the term “collegial faculty development” (CFD) to encompass all practices that support faculty in developing their teaching quality by drawing on the expertise of their colleagues. Our framework conceptualizes the main elements of CFD and shows how different contextual, individual, and relational factors shape the way CFD unfolds. Based on these theoretical considerations, we discuss issues of intersubjectivity, materiality, and temporality as potential avenues for further research.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"237 - 271"},"PeriodicalIF":11.2,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45396149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-17DOI: 10.3102/0034654321998072
Sonja Krämer, J. Möller, Friederike Zimmermann
This article presents a meta-analysis on cognitive (e.g., academic performance) and psychosocial outcomes (e.g., self-concept, well-being) among students with general learning difficulties and their peers without learning difficulties in inclusive versus segregated educational settings. In total, we meta-analyzed k = 40 studies with 428 effect sizes and a total sample of N = 11,987 students. We found a significant small to medium positive effect for cognitive outcomes of students with general learning difficulties in inclusive versus segregated settings (d = 0.35) and no effect on psychosocial outcomes (d = 0.00). Students without general learning difficulties did not differ cognitively (d = −0.14) or psychosocially (d = 0.06) from their counterparts in segregated settings. We examined several moderators (e.g., design, diagnosis, type of outcome). We discuss possible selection effects as well as implications for future research and practice.
{"title":"Inclusive Education of Students With General Learning Difficulties: A Meta-Analysis","authors":"Sonja Krämer, J. Möller, Friederike Zimmermann","doi":"10.3102/0034654321998072","DOIUrl":"https://doi.org/10.3102/0034654321998072","url":null,"abstract":"This article presents a meta-analysis on cognitive (e.g., academic performance) and psychosocial outcomes (e.g., self-concept, well-being) among students with general learning difficulties and their peers without learning difficulties in inclusive versus segregated educational settings. In total, we meta-analyzed k = 40 studies with 428 effect sizes and a total sample of N = 11,987 students. We found a significant small to medium positive effect for cognitive outcomes of students with general learning difficulties in inclusive versus segregated settings (d = 0.35) and no effect on psychosocial outcomes (d = 0.00). Students without general learning difficulties did not differ cognitively (d = −0.14) or psychosocially (d = 0.06) from their counterparts in segregated settings. We examined several moderators (e.g., design, diagnosis, type of outcome). We discuss possible selection effects as well as implications for future research and practice.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"432 - 478"},"PeriodicalIF":11.2,"publicationDate":"2021-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45900425","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-09DOI: 10.3102/0034654321997918
Jane Lee, T. Sanders, D. Antczak, Rhiannon B. Parker, M. Noetel, P. Parker, C. Lonsdale
The internet has become the chosen medium for professional learning. Completing professional learning can improve work performance; however, many individuals who begin online courses do not complete them. It is not well understood which influences keep individuals engaged in online professional learning. We address these issues with a systematic review. Our review of 51 studies and 9,583 participants includes a narrative synthesis and a meta-analysis that examined influences on user engagement in online professional learning. We found that course design and employers’ provision of time to complete learning are key for engaging learners. Other important influences were learners’ reasons for learning (e.g., intrinsic value and perceived usefulness), access to learning support, and opportunities for interaction during the learning experience.
{"title":"Influences on User Engagement in Online Professional Learning: A Narrative Synthesis and Meta-Analysis","authors":"Jane Lee, T. Sanders, D. Antczak, Rhiannon B. Parker, M. Noetel, P. Parker, C. Lonsdale","doi":"10.3102/0034654321997918","DOIUrl":"https://doi.org/10.3102/0034654321997918","url":null,"abstract":"The internet has become the chosen medium for professional learning. Completing professional learning can improve work performance; however, many individuals who begin online courses do not complete them. It is not well understood which influences keep individuals engaged in online professional learning. We address these issues with a systematic review. Our review of 51 studies and 9,583 participants includes a narrative synthesis and a meta-analysis that examined influences on user engagement in online professional learning. We found that course design and employers’ provision of time to complete learning are key for engaging learners. Other important influences were learners’ reasons for learning (e.g., intrinsic value and perceived usefulness), access to learning support, and opportunities for interaction during the learning experience.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"518 - 576"},"PeriodicalIF":11.2,"publicationDate":"2021-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43063113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-08DOI: 10.3102/0034654321998074
May Irene Furenes, N. Kucirkova, A. Bus
This meta-analysis examines the inconsistent findings across experimental studies that compared children’s learning outcomes with digital and paper books. We quantitatively reviewed 39 studies reported in 30 articles (n = 1,812 children) and compared children’s story comprehension and vocabulary learning in relation to medium (reading on paper versus on-screen), design enhancements in digital books, the presence of a dictionary, and adult support for children aged between 1 and 8 years. The comparison of digital versus paper books that only differed by digitization showed lower comprehension scores for digital books. Adults’ mediation during print books’ reading was more effective than the enhancements in digital books read by children independently. However, with story-congruent enhancements, digital books outperformed paper books. An embedded dictionary had no or negative effect on children’s story comprehension but positively affected children’s vocabulary learning. Findings are discussed in relation to the cognitive load theory and practical design implications.
{"title":"A Comparison of Children’s Reading on Paper Versus Screen: A Meta-Analysis","authors":"May Irene Furenes, N. Kucirkova, A. Bus","doi":"10.3102/0034654321998074","DOIUrl":"https://doi.org/10.3102/0034654321998074","url":null,"abstract":"This meta-analysis examines the inconsistent findings across experimental studies that compared children’s learning outcomes with digital and paper books. We quantitatively reviewed 39 studies reported in 30 articles (n = 1,812 children) and compared children’s story comprehension and vocabulary learning in relation to medium (reading on paper versus on-screen), design enhancements in digital books, the presence of a dictionary, and adult support for children aged between 1 and 8 years. The comparison of digital versus paper books that only differed by digitization showed lower comprehension scores for digital books. Adults’ mediation during print books’ reading was more effective than the enhancements in digital books read by children independently. However, with story-congruent enhancements, digital books outperformed paper books. An embedded dictionary had no or negative effect on children’s story comprehension but positively affected children’s vocabulary learning. Findings are discussed in relation to the cognitive load theory and practical design implications.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"483 - 517"},"PeriodicalIF":11.2,"publicationDate":"2021-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48704832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-04DOI: 10.3102/0034654321998075
S. Fikrat-Wevers, R. van Steensel, L. Arends
The aim of this meta-analysis was to investigate effects of family literacy programs on the emergent literacy skills of children from low socioeconomic status families (0–6) and to establish which program, sample, study, and measurement characteristics moderate program effects. Outcomes of 48 (quasi-)experimental studies covering 42 different programs revealed a medium average effect of Cohen’s d = 0.50 on immediate posttests and a marginal average effect of Cohen’s d = 0.16 on follow-up measures. Together, effects of different moderator variables indicate that children benefit from targeted programs that focus on a limited set of activities and skills and that are restricted to one (training) context. Additionally, we found larger effects in experimental studies and when researcher-developed tests were used. Our outcomes not only provide guidelines for program developers but also call for more longitudinal research that examines how positive short-term changes as a consequence of program participation can be sustained over time.
{"title":"Effects of Family Literacy Programs on the Emergent Literacy Skills of Children From Low-SES Families: A Meta-Analysis","authors":"S. Fikrat-Wevers, R. van Steensel, L. Arends","doi":"10.3102/0034654321998075","DOIUrl":"https://doi.org/10.3102/0034654321998075","url":null,"abstract":"The aim of this meta-analysis was to investigate effects of family literacy programs on the emergent literacy skills of children from low socioeconomic status families (0–6) and to establish which program, sample, study, and measurement characteristics moderate program effects. Outcomes of 48 (quasi-)experimental studies covering 42 different programs revealed a medium average effect of Cohen’s d = 0.50 on immediate posttests and a marginal average effect of Cohen’s d = 0.16 on follow-up measures. Together, effects of different moderator variables indicate that children benefit from targeted programs that focus on a limited set of activities and skills and that are restricted to one (training) context. Additionally, we found larger effects in experimental studies and when researcher-developed tests were used. Our outcomes not only provide guidelines for program developers but also call for more longitudinal research that examines how positive short-term changes as a consequence of program participation can be sustained over time.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"577 - 613"},"PeriodicalIF":11.2,"publicationDate":"2021-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45158827","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-03-04DOI: 10.3102/0034654321995255
Rebecca A. Cruz, A. R. Firestone, Janelle E. Rodl
A full canon of empirical literature shows that students who are African American, Latinx, or American Indian/Alaskan Native, and students who are male, diagnosed with disabilities, or from low socioeconomic backgrounds are more likely to experience exclusionary discipline practices in U.S. schools. Though there is a growing commitment to mitigating discipline disparities through alternative programming, it is clear that disproportionality in the application of harmful discipline practices persists. The purpose of this literature synthesis was to examine the effectiveness of empirically studied school-based interventions in reducing disproportionality in discipline practices. We analyzed articles that assessed both prevention and intervention program effects using at least one outcome variable representing exclusionary discipline, either in the form of office discipline referrals or suspension/expulsion rates. Included studies used experimental, quasi-experimental, or observational research designs that disaggregated student outcomes by race, ethnicity, gender, disability, or other sociodemographic categories. We identified 20 articles meeting inclusion criteria, four of which provided direct evidence of disproportionality reduction using interaction terms. Results indicate limited evidence that available programs reduce discipline disparities and that common programs may function as a protective factor for White and female students while failing to do so for marginalized students. Findings identify promising areas for future research.
{"title":"Disproportionality Reduction in Exclusionary School Discipline: A Best-Evidence Synthesis","authors":"Rebecca A. Cruz, A. R. Firestone, Janelle E. Rodl","doi":"10.3102/0034654321995255","DOIUrl":"https://doi.org/10.3102/0034654321995255","url":null,"abstract":"A full canon of empirical literature shows that students who are African American, Latinx, or American Indian/Alaskan Native, and students who are male, diagnosed with disabilities, or from low socioeconomic backgrounds are more likely to experience exclusionary discipline practices in U.S. schools. Though there is a growing commitment to mitigating discipline disparities through alternative programming, it is clear that disproportionality in the application of harmful discipline practices persists. The purpose of this literature synthesis was to examine the effectiveness of empirically studied school-based interventions in reducing disproportionality in discipline practices. We analyzed articles that assessed both prevention and intervention program effects using at least one outcome variable representing exclusionary discipline, either in the form of office discipline referrals or suspension/expulsion rates. Included studies used experimental, quasi-experimental, or observational research designs that disaggregated student outcomes by race, ethnicity, gender, disability, or other sociodemographic categories. We identified 20 articles meeting inclusion criteria, four of which provided direct evidence of disproportionality reduction using interaction terms. Results indicate limited evidence that available programs reduce discipline disparities and that common programs may function as a protective factor for White and female students while failing to do so for marginalized students. Findings identify promising areas for future research.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"397 - 431"},"PeriodicalIF":11.2,"publicationDate":"2021-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43046188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-02-22DOI: 10.3102/0034654321995243
Elisabeth H. Kim, C. Flack, Katharine S. Parham, Priscilla Wohlstetter
Career and technical education (CTE) has become increasingly popular in U.S. secondary schools, but equity has not always been a focus of federal legislation or state and local policies and programs. This literature review of trends in CTE research between 1998 and 2019 uses a novel equity framework to examine whether and how secondary CTE programs affect educational equity. A total of 123 sources were reviewed. Findings revealed that CTE research most commonly addresses access and participation, measured by high school graduation rates and GPA. Few studies disaggregate outcome measures by student subgroups to better assess equity. Furthermore, a dearth of large-scale, comparative, and longitudinal research limits generalizability. Most extant research on secondary CTE programs in the United States examines a single state, district, or school. This article identifies promising policies and practices for enhancing equity in CTE conveyed by extant literature and recommends important directions for future research.
{"title":"Equity in Secondary Career and Technical Education in the United States: A Theoretical Framework and Systematic Literature Review","authors":"Elisabeth H. Kim, C. Flack, Katharine S. Parham, Priscilla Wohlstetter","doi":"10.3102/0034654321995243","DOIUrl":"https://doi.org/10.3102/0034654321995243","url":null,"abstract":"Career and technical education (CTE) has become increasingly popular in U.S. secondary schools, but equity has not always been a focus of federal legislation or state and local policies and programs. This literature review of trends in CTE research between 1998 and 2019 uses a novel equity framework to examine whether and how secondary CTE programs affect educational equity. A total of 123 sources were reviewed. Findings revealed that CTE research most commonly addresses access and participation, measured by high school graduation rates and GPA. Few studies disaggregate outcome measures by student subgroups to better assess equity. Furthermore, a dearth of large-scale, comparative, and longitudinal research limits generalizability. Most extant research on secondary CTE programs in the United States examines a single state, district, or school. This article identifies promising policies and practices for enhancing equity in CTE conveyed by extant literature and recommends important directions for future research.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"356 - 396"},"PeriodicalIF":11.2,"publicationDate":"2021-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47109487","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-02-06DOI: 10.3102/0034654321991228
Amedee Marchand Martella, J. Yatcilla, R. Martella, N. Marchand-Martella, Zafer Ozen, T. Karatas, Helen Park, Alexandra M Simpson, Jeffrey D. Karpicke
When previous research is cited incorrectly, misinformation can infiltrate scientific discourse and undermine scholarly knowledge. One of the more damaging citation issues involves incorrectly citing article content (called quotation errors); therefore, investigating quotation accuracy is an important research endeavor. One field where quotation accuracy is needed is in the learning sciences given its impact on pedagogy. An integral article in pedagogical discussions surrounding how to teach at the college level is the meta-analysis on active learning by Freeman et al. The Freeman et al. meta-analysis compared active learning to traditional lecture in terms of its effects on student learning and has been important in national initiatives on STEM (science, technology, engineering, and mathematics) reform. Given its influence coupled with the impact quotation errors could have in scientific discourse, we used citation context analysis to analyze whether assertions in the citing text that related to the efficacy of lecture and active learning were supported by what was explicitly stated in the cited meta-analysis. Assertions were analyzed under supported, unsupported, or irrelevant for purposes of study categories. The most prevalent supported category related to active learning being more effective than lecture; the most prevalent unsupported category related to the effectiveness of specific activities/approaches other than the general approach of active learning. Overall, the percentage of supported assertions was 47.67%, and the percentage of unsupported assertions was 26.01%. Furthermore, the percentage of articles containing at least one unsupported assertion was 34.77%. Proactive measures are needed to reduce the incidence of quotation errors to ensure robust scientific integrity.
{"title":"Quotation Accuracy Matters: An Examination of How an Influential Meta-Analysis on Active Learning Has Been Cited","authors":"Amedee Marchand Martella, J. Yatcilla, R. Martella, N. Marchand-Martella, Zafer Ozen, T. Karatas, Helen Park, Alexandra M Simpson, Jeffrey D. Karpicke","doi":"10.3102/0034654321991228","DOIUrl":"https://doi.org/10.3102/0034654321991228","url":null,"abstract":"When previous research is cited incorrectly, misinformation can infiltrate scientific discourse and undermine scholarly knowledge. One of the more damaging citation issues involves incorrectly citing article content (called quotation errors); therefore, investigating quotation accuracy is an important research endeavor. One field where quotation accuracy is needed is in the learning sciences given its impact on pedagogy. An integral article in pedagogical discussions surrounding how to teach at the college level is the meta-analysis on active learning by Freeman et al. The Freeman et al. meta-analysis compared active learning to traditional lecture in terms of its effects on student learning and has been important in national initiatives on STEM (science, technology, engineering, and mathematics) reform. Given its influence coupled with the impact quotation errors could have in scientific discourse, we used citation context analysis to analyze whether assertions in the citing text that related to the efficacy of lecture and active learning were supported by what was explicitly stated in the cited meta-analysis. Assertions were analyzed under supported, unsupported, or irrelevant for purposes of study categories. The most prevalent supported category related to active learning being more effective than lecture; the most prevalent unsupported category related to the effectiveness of specific activities/approaches other than the general approach of active learning. Overall, the percentage of supported assertions was 47.67%, and the percentage of unsupported assertions was 26.01%. Furthermore, the percentage of articles containing at least one unsupported assertion was 34.77%. Proactive measures are needed to reduce the incidence of quotation errors to ensure robust scientific integrity.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"272 - 308"},"PeriodicalIF":11.2,"publicationDate":"2021-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43099058","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results. Ten years have passed since the guidelines for reporting multilevel studies were initially published. This study reviewed new advancements in MLM and revisited the reporting practice in MLM in the past decade. A total of 301 articles from 19 journals representing different subdisciplines in education and psychology were included in the systematic review. The results showed improvement in some areas of the reporting practices, such as the number of models tested, centering of predictors, missing data treatment, software, and estimates of variance components. However, poor practices persist in terms of model specification, description of a missing mechanism, power analysis, assumption checking, model comparisons, and effect sizes. Updates on the guidelines for reporting multilevel studies and recommendations for future methodological research in MLM are presented.
{"title":"Reporting Practice in Multilevel Modeling: A Revisit After 10 Years","authors":"Wen Luo, Haoran Li, E. Baek, Siqi Chen, Kwok Hap Lam, Brandie Semma","doi":"10.3102/0034654321991229","DOIUrl":"https://doi.org/10.3102/0034654321991229","url":null,"abstract":"Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results. Ten years have passed since the guidelines for reporting multilevel studies were initially published. This study reviewed new advancements in MLM and revisited the reporting practice in MLM in the past decade. A total of 301 articles from 19 journals representing different subdisciplines in education and psychology were included in the systematic review. The results showed improvement in some areas of the reporting practices, such as the number of models tested, centering of predictors, missing data treatment, software, and estimates of variance components. However, poor practices persist in terms of model specification, description of a missing mechanism, power analysis, assumption checking, model comparisons, and effect sizes. Updates on the guidelines for reporting multilevel studies and recommendations for future methodological research in MLM are presented.","PeriodicalId":21145,"journal":{"name":"Review of Educational Research","volume":"91 1","pages":"311 - 355"},"PeriodicalIF":11.2,"publicationDate":"2021-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43520436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：