The impact (or lack thereof) of analysis choice on conclusions with Likert data from the Many Analysts Religion Project

Abstract

factor analysis with ordinal data. Psychological Methods, 9(4), 466. https://doi.org/10.1037/1082-989X.9.4.466 Flora, D. B., LaBrish, C., & Chalmers, R. P. (2012). Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Frontiers in Psychology, 3, 55. https://doi.org/10.3389/fpsyg.2012. 00055 Hoogeveen, S., Sarafoglou, A., Aczel, B., Aditya, Y., Alayan, A. J., Allen, P. J., Altay, S., Alzahawi, S., Amir, Y., Anthony, F.-V., Appiah, O. K., Atkinson, Q. D., Baimel, A., Balkaya-Ince, M., Balsamo, M., Banker, S., Bartoš, F., Becerra, M., Beffara, B., Beitner, J., Bendixen, T.,...Wagenmakers, E.-J. (2022). A many-analysts approach to the relation between religiosity and well-being. Religion, Brain & Behavior. https://doi.org/10.1080/ 2153599X.2022.2070255 Lodder, P., Denollet, J., Emons, W. H., Nefs, G., Pouwer, F., Speight, J., & Wicherts, J. M. (2019). Modeling interactions between latent variables in research on Type D personality: A monte carlo simulation and clinical study of depression and anxiety. Multivariate Behavioral Research, 54(5), 637–665. https://doi.org/10.1080/ 00273171.2018.1562863 Lodder, P., Emons, W. H., Denollet, J., & Wicherts, J. M. (2021). Latent logistic interaction modeling: A simulation and empirical illustration of Type D personality. Structural Equation Modeling: A Multidisciplinary Journal, 28(3), 440–462. https://doi.org/10.1080/10705511.2020.1838905 Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5(1), 27–48. https://doi.org/10.1146/annurev.clinpsy.032408.153553 Rhemtulla, M., Brosseau-Liard, PÉ, & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354. https://doi.org/10.1037/a0029315 Spearman, C. (1904). The proof and measurement of association between two things. The American Journal of Psychology, 15(1), 72–101. https://doi.org/10.2307/1412159 Wicherts, J. M., Veldkamp, C. L., Augusteijn, H. E., Bakker, M., Van Aert, R., & Van Assen, M. A. (2016). Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in Psychology, 7, 1832. doi:10.3389/fpsyg.2016.01832