Matt C. Howard, Melanie Boudreaux, Joshua Cogswell, Kelly G. Manix, Matthew T. Oglesby
{"title":"A literature review of model fit and model comparisons with confirmatory factor analysis: Formalizing the informal in organizational science","authors":"Matt C. Howard, Melanie Boudreaux, Joshua Cogswell, Kelly G. Manix, Matthew T. Oglesby","doi":"10.1111/apps.12592","DOIUrl":null,"url":null,"abstract":"<p>Researchers often stray from recommendations provided by simulation studies when conducting confirmatory factor analysis (CFA), causing unwieldy applications of the analysis and diminished confidence in published results. We introduce three particularly important informal practices associated with (1) alternative interpretations of model fit, (2) the use of inadvisable combinations of fit indices, and (3) the failure to conduct effective model comparisons. We then review over 2000 CFAs in premier organizational science journals. Our results support that researchers widely engage in all three informal practices. To address this tension, we (1) formalize modern interpretations of model fit by providing percentile ranges of indices in published articles, such that researchers can make relative and continuous assessments of model fit. We (2) emphasize the importance of assessing multiple recommended fit indices together to provide complete depictions of model soundness. Lastly, we (3) demonstrate the necessity to perform appropriate model comparisons, including the assessment of more complex models.</p>","PeriodicalId":48289,"journal":{"name":"Applied Psychology-An International Review-Psychologie Appliquee-Revue Internationale","volume":"74 1","pages":""},"PeriodicalIF":4.9000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Psychology-An International Review-Psychologie Appliquee-Revue Internationale","FirstCategoryId":"102","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/apps.12592","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, APPLIED","Score":null,"Total":0}
引用次数: 0
Abstract
Researchers often stray from recommendations provided by simulation studies when conducting confirmatory factor analysis (CFA), causing unwieldy applications of the analysis and diminished confidence in published results. We introduce three particularly important informal practices associated with (1) alternative interpretations of model fit, (2) the use of inadvisable combinations of fit indices, and (3) the failure to conduct effective model comparisons. We then review over 2000 CFAs in premier organizational science journals. Our results support that researchers widely engage in all three informal practices. To address this tension, we (1) formalize modern interpretations of model fit by providing percentile ranges of indices in published articles, such that researchers can make relative and continuous assessments of model fit. We (2) emphasize the importance of assessing multiple recommended fit indices together to provide complete depictions of model soundness. Lastly, we (3) demonstrate the necessity to perform appropriate model comparisons, including the assessment of more complex models.
期刊介绍:
"Applied Psychology: An International Review" is the esteemed official journal of the International Association of Applied Psychology (IAAP), a venerable organization established in 1920 that unites scholars and practitioners in the field of applied psychology. This peer-reviewed journal serves as a global platform for the scholarly exchange of research findings within the diverse domain of applied psychology.
The journal embraces a wide array of topics within applied psychology, including organizational, cross-cultural, educational, health, counseling, environmental, traffic, and sport psychology. It particularly encourages submissions that enhance the understanding of psychological processes in various applied settings and studies that explore the impact of different national and cultural contexts on psychological phenomena.