{"title":"Sources of Inconsistency in the Measurement of Religious Affiliation: Evidence from a Survey Experiment and Cognitive Interviews","authors":"Philip S Brenner, Jill LaPlante, Tracy L Reed?","doi":"10.1093/socrel/srad048","DOIUrl":null,"url":null,"abstract":"Abstract Research has argued that estimates of the percentage of Americans without a religious affiliation may be influenced by a measurement artifact caused by the poor reliability of conventional survey questions. Using a question-order experiment and cognitive interviews, we assess religious affiliation measures like those commonly used on surveys. A filter question and a full question presenting a list of religious affiliations as response options are asked in a random order. Findings suggest that nominally religious respondents have higher odds of reporting an affiliation to the full question than the filter. They describe nominal or residual religious affiliations, highlighting the role of family connections and religious pasts in their affiliation reports. Conversely, highly religious and nonreligious respondents are, respectively, only slightly and not at all influenced by question characteristics. Findings suggest that using a filter question before a full question avoids this source of inconsistency and yields better data quality.","PeriodicalId":47440,"journal":{"name":"Sociology of Religion","volume":"28 1","pages":"0"},"PeriodicalIF":2.4000,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sociology of Religion","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/socrel/srad048","RegionNum":1,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"RELIGION","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract Research has argued that estimates of the percentage of Americans without a religious affiliation may be influenced by a measurement artifact caused by the poor reliability of conventional survey questions. Using a question-order experiment and cognitive interviews, we assess religious affiliation measures like those commonly used on surveys. A filter question and a full question presenting a list of religious affiliations as response options are asked in a random order. Findings suggest that nominally religious respondents have higher odds of reporting an affiliation to the full question than the filter. They describe nominal or residual religious affiliations, highlighting the role of family connections and religious pasts in their affiliation reports. Conversely, highly religious and nonreligious respondents are, respectively, only slightly and not at all influenced by question characteristics. Findings suggest that using a filter question before a full question avoids this source of inconsistency and yields better data quality.
期刊介绍:
Sociology of Religion, the official journal of the Association for the Sociology of Religion, is published quarterly for the purpose of advancing scholarship in the sociological study of religion. The journal publishes original (not previously published) work of exceptional quality and interest without regard to substantive focus, theoretical orientation, or methodological approach. Although theoretically ambitious, empirically grounded articles are the core of what we publish, we also welcome agenda setting essays, comments on previously published works, critical reflections on the research act, and interventions into substantive areas or theoretical debates intended to push the field ahead. Sociology of Religion has published work by renowned scholars from Nancy Ammerman to Robert Wuthnow. Robert Bellah, Niklas Luhmann, Talcott Parsons, and Pitirim Sorokin all published in the pages of this journal. More recently, articles published in Sociology of Religion have won the ASA Religion Section’s Distinguished Article Award (Rhys Williams in 2000) and the Society for the Scientific Study of Religion’s Distinguished Article Award (Matthew Lawson in 2000 and Fred Kniss in 1998). Building on this legacy, Sociology of Religion aspires to be the premier English-language publication for sociological scholarship on religion and an essential source for agenda-setting work in the field.