Stephanie K Van Stee, Qinghua Yang, Stephen A. Rains
{"title":"沟通元分析中统计报告实践不足及其后果的实证研究","authors":"Stephanie K Van Stee, Qinghua Yang, Stephen A. Rains","doi":"10.1080/19312458.2022.2088713","DOIUrl":null,"url":null,"abstract":"ABSTRACT Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":6.3000,"publicationDate":"2022-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Empirical Investigation of Inadequate Statistical Reporting Practices in Communication Meta-Analyses and Their Consequences\",\"authors\":\"Stephanie K Van Stee, Qinghua Yang, Stephen A. Rains\",\"doi\":\"10.1080/19312458.2022.2088713\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.\",\"PeriodicalId\":47552,\"journal\":{\"name\":\"Communication Methods and Measures\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2022-06-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Communication Methods and Measures\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://doi.org/10.1080/19312458.2022.2088713\",\"RegionNum\":1,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMMUNICATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Communication Methods and Measures","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1080/19312458.2022.2088713","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMMUNICATION","Score":null,"Total":0}
An Empirical Investigation of Inadequate Statistical Reporting Practices in Communication Meta-Analyses and Their Consequences
ABSTRACT Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.
期刊介绍:
Communication Methods and Measures aims to achieve several goals in the field of communication research. Firstly, it aims to bring attention to and showcase developments in both qualitative and quantitative research methodologies to communication scholars. This journal serves as a platform for researchers across the field to discuss and disseminate methodological tools and approaches.
Additionally, Communication Methods and Measures seeks to improve research design and analysis practices by offering suggestions for improvement. It aims to introduce new methods of measurement that are valuable to communication scientists or enhance existing methods. The journal encourages submissions that focus on methods for enhancing research design and theory testing, employing both quantitative and qualitative approaches.
Furthermore, the journal is open to articles devoted to exploring the epistemological aspects relevant to communication research methodologies. It welcomes well-written manuscripts that demonstrate the use of methods and articles that highlight the advantages of lesser-known or newer methods over those traditionally used in communication.
In summary, Communication Methods and Measures strives to advance the field of communication research by showcasing and discussing innovative methodologies, improving research practices, and introducing new measurement methods.