Sociological Methods & Research最新文献

英文中文

Why Measurement Invariance is Important in Comparative Research. A Response to Welzel et al. (2021) 为什么测量不变性在比较研究中很重要。对Welzel等人的回应（2021）

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-04-21 DOI: 10.1177/00491241221091755

B. Meuleman, Tomasz Żółtak, A. Pokropek, E. Davidov, B. Muthén, Daniel L. Oberski, J. Billiet, Peter Schmidt

Welzel et al. (2021) claim that non-invariance of instruments is inconclusive and inconsequential in the field for cross-cultural value measurement. In this response, we contend that several key arguments on which Welzel et al. (2021) base their critique of invariance testing are conceptually and statistically incorrect. First, Welzel et al. (2021) claim that value measurement follows a formative rather than reflective logic. Yet they do not provide sufficient theoretical arguments for this conceptualization, nor do they discuss the disadvantages of this approach for validation of instruments. Second, their claim that strong inter-item correlations cannot be retrieved when means are close to the endpoint of scales ignores the existence of factor-analytic approaches for ordered-categorical indicators. Third, Welzel et al. (2021) propose that rather than of relying on invariance tests, comparability can be assessed by studying the connection with theoretically related constructs. However, their proposal ignores that external validation through nomological linkages hinges on the assumption of comparability. By means of two examples, we illustrate that violating the assumptions of measurement invariance can distort conclusions substantially. Following the advice of Welzel et al. (2021) implies discarding a tool that has proven to be very useful for comparativists.

Welzel等人（2021）声称，在跨文化价值测量领域，工具的非不变性是不确定的，也是无关紧要的。在这一回应中，我们认为Welzel等人（2021）对不变性测试的批评所基于的几个关键论点在概念上和统计上都是不正确的。首先，Welzel等人（2021）声称，价值衡量遵循形成性而非反思性逻辑。然而，他们没有为这种概念化提供足够的理论论据，也没有讨论这种方法在文书验证方面的缺点。其次，他们声称，当均值接近量表的终点时，无法检索到强的项目间相关性，这忽略了有序分类指标的因素分析方法的存在。第三，Welzel等人（2021）提出，与其依赖不变性检验，不如通过研究与理论相关结构的联系来评估可比性。然而，他们的建议忽略了通过法理联系进行的外部验证取决于可比性的假设。通过两个例子，我们说明了违反测量不变性的假设会严重扭曲结论。遵循Welzel等人的建议。（2021）意味着放弃一种已被证明对比较主义者非常有用的工具。

{"title":"Why Measurement Invariance is Important in Comparative Research. A Response to Welzel et al. (2021)","authors":"B. Meuleman, Tomasz Żółtak, A. Pokropek, E. Davidov, B. Muthén, Daniel L. Oberski, J. Billiet, Peter Schmidt","doi":"10.1177/00491241221091755","DOIUrl":"https://doi.org/10.1177/00491241221091755","url":null,"abstract":"Welzel et al. (2021) claim that non-invariance of instruments is inconclusive and inconsequential in the field for cross-cultural value measurement. In this response, we contend that several key arguments on which Welzel et al. (2021) base their critique of invariance testing are conceptually and statistically incorrect. First, Welzel et al. (2021) claim that value measurement follows a formative rather than reflective logic. Yet they do not provide sufficient theoretical arguments for this conceptualization, nor do they discuss the disadvantages of this approach for validation of instruments. Second, their claim that strong inter-item correlations cannot be retrieved when means are close to the endpoint of scales ignores the existence of factor-analytic approaches for ordered-categorical indicators. Third, Welzel et al. (2021) propose that rather than of relying on invariance tests, comparability can be assessed by studying the connection with theoretically related constructs. However, their proposal ignores that external validation through nomological linkages hinges on the assumption of comparability. By means of two examples, we illustrate that violating the assumptions of measurement invariance can distort conclusions substantially. Following the advice of Welzel et al. (2021) implies discarding a tool that has proven to be very useful for comparativists.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"52 1","pages":"1401 - 1419"},"PeriodicalIF":6.3,"publicationDate":"2022-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46916158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Against the Mainstream: On the Limitations of Non-Invariance Diagnostics: Response to Fischer et al. and Meuleman et al. 反对主流:论非不变诊断的局限性:对Fischer等人与Meuleman等人的回应。

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-04-07 DOI: 10.1177/00491241221091754

C. Welzel, S. Kruse, Lennart Brunkert

Our original 2021 SMR article “Non-Invariance? An Overstated Problem with Misconceived Causes” disputes the conclusiveness of non-invariance diagnostics in diverse cross-cultural settings. Our critique targets the increasingly fashionable use of Multi-Group Confirmatory Factor Analysis (MGCFA), especially in its mainstream version. We document—both by mathematical proof and an empirical illustration—that non-invariance is an arithmetic artifact of group mean disparity on closed-ended scales. Precisely this arti-factualness renders standard non-invariance markers inconclusive of measurement inequivalence under group-mean diversity. Using the Emancipative Values Index (EVI), OA-Section 3 of our original article demonstrates that such artifactual non-invariance is inconsequential for multi-item constructs’ cross-cultural performance in nomological terms, that is, explanatory power and predictive quality. Given these limitations of standard non-invariance diagnostics, we challenge the unquestioned authority of invariance tests as a tool of measurement validation. Our critique provoked two teams of authors to launch counter-critiques. We are grateful to the two comments because they give us a welcome opportunity to restate our position in greater clarity. Before addressing the comments one by one, we reformulate our key propositions more succinctly.

我们2021年SMR的原创文章《非不变性？一个有错误原因的过度陈述问题》对非不变性诊断在不同跨文化环境中的结论性提出了质疑。我们的批评针对的是越来越流行的多组确证因子分析（MGCFA）的使用，尤其是在其主流版本中。我们通过数学证明和经验说明证明，非不变性是封闭尺度上群平均视差的算术伪影。正是这种人为的事实性使得标准的非不变性标记在群均值多样性下的测量不等价性是不确定的。利用解放价值指数（EVI），OA在我们原文章的第3节中证明，这种人为的非不变性对于多项目结构在法理方面的跨文化表现，即解释力和预测质量来说是无关紧要的。鉴于标准非不变性诊断的这些局限性，我们对不变性测试作为测量验证工具的权威性提出了质疑。我们的批评激起了两个作者团队的反批评。我们感谢这两项评论，因为它们给了我们一个更明确地重申我们立场的机会。在逐一讨论这些意见之前，我们更简洁地重新表述了我们的主要主张。

{"title":"Against the Mainstream: On the Limitations of Non-Invariance Diagnostics: Response to Fischer et al. and Meuleman et al.","authors":"C. Welzel, S. Kruse, Lennart Brunkert","doi":"10.1177/00491241221091754","DOIUrl":"https://doi.org/10.1177/00491241221091754","url":null,"abstract":"Our original 2021 SMR article “Non-Invariance? An Overstated Problem with Misconceived Causes” disputes the conclusiveness of non-invariance diagnostics in diverse cross-cultural settings. Our critique targets the increasingly fashionable use of Multi-Group Confirmatory Factor Analysis (MGCFA), especially in its mainstream version. We document—both by mathematical proof and an empirical illustration—that non-invariance is an arithmetic artifact of group mean disparity on closed-ended scales. Precisely this arti-factualness renders standard non-invariance markers inconclusive of measurement inequivalence under group-mean diversity. Using the Emancipative Values Index (EVI), OA-Section 3 of our original article demonstrates that such artifactual non-invariance is inconsequential for multi-item constructs’ cross-cultural performance in nomological terms, that is, explanatory power and predictive quality. Given these limitations of standard non-invariance diagnostics, we challenge the unquestioned authority of invariance tests as a tool of measurement validation. Our critique provoked two teams of authors to launch counter-critiques. We are grateful to the two comments because they give us a welcome opportunity to restate our position in greater clarity. Before addressing the comments one by one, we reformulate our key propositions more succinctly.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"52 1","pages":"1438 - 1455"},"PeriodicalIF":6.3,"publicationDate":"2022-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41829124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Abductive Coding: Theory Building and Qualitative (Re)Analysis 溯因编码:理论建构与定性(再)分析

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-02-14 DOI: 10.1177/00491241211067508

L. Vila‐Henninger, C. Dupuy, Virginie Van Ingelgom, M. Caprioli, Ferdinand Teuber, Damien Pennetreau, Margherita Bussi, Cal Le Gall

Qualitative secondary analysis has generated heated debate regarding the epistemology of qualitative research. We argue that shifting to an abductive approach provides a fruitful avenue for qualitative secondary analysts who are oriented towards theory-building. However, the concrete implementation of abduction remains underdeveloped—especially for coding. We address this key gap by outlining a set of tactics for abductive analysis that can be applied for qualitative analysis. Our approach applies Timmermans and Tavory's ( Timmermans and Tavory 2012 ; Tavory and Timmermans 2014 ) three stages of abduction in three steps for qualitative (secondary) analysis: Generating an Abductive Codebook, Abductive Data Reduction through Code Equations, and In-Depth Abductive Qualitative Analysis. A key contribution of our article is the development of “code equations”—defined as the combination of codes to operationalize phenomena that span individual codes. Code equations are an important resource for abduction and other qualitative approaches that leverage qualitative data to build theory.

定性二次分析引起了关于定性研究认识论的激烈争论。我们认为，转向溯因方法为面向理论建设的定性二级分析师提供了富有成效的途径。然而，绑架的具体实现仍然不发达，特别是在编码方面。我们通过概述一套可用于定性分析的溯因分析策略来解决这一关键差距。我们的方法采用Timmermans和Tavory的(Timmermans and Tavory 2012;Tavory和Timmermans 2014)定性(二级)分析的三个阶段:生成溯因代码本，通过代码方程进行溯因数据简化，以及深入溯因定性分析。我们文章的一个关键贡献是“代码方程”的发展——定义为代码的组合，以实现跨越单个代码的现象。代码方程是溯因法和其他利用定性数据构建理论的定性方法的重要资源。

{"title":"Abductive Coding: Theory Building and Qualitative (Re)Analysis","authors":"L. Vila‐Henninger, C. Dupuy, Virginie Van Ingelgom, M. Caprioli, Ferdinand Teuber, Damien Pennetreau, Margherita Bussi, Cal Le Gall","doi":"10.1177/00491241211067508","DOIUrl":"https://doi.org/10.1177/00491241211067508","url":null,"abstract":"Qualitative secondary analysis has generated heated debate regarding the epistemology of qualitative research. We argue that shifting to an abductive approach provides a fruitful avenue for qualitative secondary analysts who are oriented towards theory-building. However, the concrete implementation of abduction remains underdeveloped—especially for coding. We address this key gap by outlining a set of tactics for abductive analysis that can be applied for qualitative analysis. Our approach applies Timmermans and Tavory's ( Timmermans and Tavory 2012 ; Tavory and Timmermans 2014 ) three stages of abduction in three steps for qualitative (secondary) analysis: Generating an Abductive Codebook, Abductive Data Reduction through Code Equations, and In-Depth Abductive Qualitative Analysis. A key contribution of our article is the development of “code equations”—defined as the combination of codes to operationalize phenomena that span individual codes. Code equations are an important resource for abduction and other qualitative approaches that leverage qualitative data to build theory.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":" ","pages":""},"PeriodicalIF":6.3,"publicationDate":"2022-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46997816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 28

In Search of a Comparable Measure of Generalized Individual Religiosity in the World Values Survey 在世界价值观调查中寻找广义个人宗教信仰的可比衡量标准

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-02-09 DOI: 10.1177/00491241221077239

A. Remizova, M. Rudnev, E. Davidov

Individual religiosity measures are used by researchers to describe and compare individuals and societies. However, the cross-cultural comparability of the measures has often been questioned but rarely empirically tested. In the current study, we examined the cross-national measurement invariance properties of generalized individual religiosity in the sixth wave of the World Values Survey. For the analysis, we used multiple group confirmatory factor analysis and alignment. Our results demonstrated that a theoretically driven measurement model was not invariant across all countries. We suggested four unidimensional measurement models and four overlapping groups of countries in which these measurement models demonstrated approximate invariance. The indicators that covered praying practices, importance of religion, and confidence in its institutions were more cross-nationally invariant than other indicators.

研究人员使用个人宗教信仰测量来描述和比较个人和社会。然而，这些措施的跨文化可比性经常受到质疑，但很少经过实证检验。在当前的研究中，我们在第六波世界价值观调查中检验了广义个人宗教信仰的跨国家测量不变性。在分析中，我们使用了多组验证性因素分析和比对。我们的研究结果表明，理论驱动的测量模型并非在所有国家都是不变的。我们提出了四个一维测量模型和四个重叠的国家组，这些测量模型在这些国家组中表现出近似不变性。与其他指标相比，涵盖祈祷实践、宗教重要性和对其机构的信心的指标在全国范围内更为不变。

引用次数: 8

Visual Design and Cognition in List-Style Open-Ended Questions in Web Probing 网页探究中开放式问题的视觉设计与认知

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-02-08 DOI: 10.1177/00491241221077241

Katharina Meitinger, Tanja Kunz

Previous research reveals that the visual design of open-ended questions should match the response task so that respondents can infer the expected response format. Based on a web survey including specific probes in a list-style open-ended question format, we experimentally tested the effects of varying numbers of answer boxes on several indicators of response quality. Our results showed that using multiple small answer boxes instead of one large box had a positive impact on the number and variety of themes mentioned, as well as on the conciseness of responses to specific probes. We found no effect on the relevance of themes and the risk of item non-response. Based on our findings, we recommend using multiple small answer boxes instead of one large box to convey the expected response format and improve response quality in specific probes. This study makes a valuable contribution to the field of web probing, extends the concept of response quality in list-style open-ended questions, and provides a deeper understanding of how visual design features affect cognitive response processes in web surveys.

以往的研究表明，开放式问题的视觉设计应该与回答任务相匹配，以便被调查者能够推断出预期的回答格式。基于一项包含列表式开放式问题格式的特定探针的网络调查，我们实验测试了不同数量的答案框对几个响应质量指标的影响。我们的研究结果表明，使用多个小的回答框而不是一个大的回答框对提到的主题的数量和种类以及对特定问题的回答的简洁性都有积极的影响。我们发现对主题的相关性和项目无反应的风险没有影响。根据我们的研究结果，我们建议使用多个小的回答框而不是一个大的回答框来传达预期的回答格式，并提高特定探针的回答质量。本研究对网络探索领域做出了重要贡献，扩展了列表式开放式问题中回答质量的概念，并对视觉设计特征如何影响网络调查中的认知反应过程提供了更深入的理解。

引用次数: 0

Comparing Single- and Multiple-Question Designs of Measuring Family Income in China Family Panel Studies 中国家庭面板研究中衡量家庭收入的单题与多题设计比较

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-02-08 DOI: 10.1177/00491241221077238

Qiong Wu, Li-na Gu

Family income questions in general purpose surveys are usually collected with either a single-question summary design or a multiple-question disaggregation design. It is unclear how estimates from the two approaches agree with each other. The current paper takes advantage of a large-scale survey that has collected family income with both methods. With data from 14,222 urban and rural families in the 2018 wave of the nationally representative China Family Panel Studies, we compare the two estimates, and further evaluate factors that might contribute to the discrepancy. We find that the two estimates are loosely matched in only a third of all families, and most of the matched families have a simple income structure. Although the mean of the multiple-question estimate is larger than that of the single-question estimate, the pattern is not monotonic. At lower percentiles up till the median, the single-question estimate is larger, whereas the multiple-question estimate is larger at higher percentiles. Larger family sizes and more income sources contribute to higher likelihood of inconsistent estimates from the two designs. Families with wage income as the main income source have the highest likelihood of giving consistent estimates compared with all other families. In contrast, families with agricultural income or property income as the main source tend to have very high probability of larger single-question estimates. Omission of certain income components and rounding can explain over half of the inconsistencies with higher multiple-question estimates and a quarter of the inconsistencies with higher single-question estimates.

一般目的调查中的家庭收入问题通常采用单题摘要设计或多题分类设计。目前尚不清楚这两种方法的估计如何相互一致。本文利用了一项大规模的调查，用这两种方法收集了家庭收入。利用2018年具有全国代表性的中国家庭面板研究(China Family Panel Studies)中来自14222个城乡家庭的数据，我们比较了这两种估计，并进一步评估了可能导致差异的因素。我们发现，只有三分之一的家庭的两种估计是松散匹配的，而大多数匹配的家庭的收入结构都很简单。虽然多题估计的平均值大于单题估计的平均值，但其模式并非单调的。从较低的百分位数到中位数，单题估计值更大，而在较高的百分位数，多题估计值更大。较大的家庭规模和更多的收入来源导致两种设计的估计不一致的可能性更高。与所有其他家庭相比，以工资收入为主要收入来源的家庭给出一致估计的可能性最高。相比之下，以农业收入或财产性收入为主要来源的家庭往往有很高的概率得到更大的单题估计。某些收入成分的遗漏和四舍五入可以解释超过一半的与较高的多题估计不一致和四分之一的与较高的单题估计不一致。

{"title":"Comparing Single- and Multiple-Question Designs of Measuring Family Income in China Family Panel Studies","authors":"Qiong Wu, Li-na Gu","doi":"10.1177/00491241221077238","DOIUrl":"https://doi.org/10.1177/00491241221077238","url":null,"abstract":"Family income questions in general purpose surveys are usually collected with either a single-question summary design or a multiple-question disaggregation design. It is unclear how estimates from the two approaches agree with each other. The current paper takes advantage of a large-scale survey that has collected family income with both methods. With data from 14,222 urban and rural families in the 2018 wave of the nationally representative China Family Panel Studies, we compare the two estimates, and further evaluate factors that might contribute to the discrepancy. We find that the two estimates are loosely matched in only a third of all families, and most of the matched families have a simple income structure. Although the mean of the multiple-question estimate is larger than that of the single-question estimate, the pattern is not monotonic. At lower percentiles up till the median, the single-question estimate is larger, whereas the multiple-question estimate is larger at higher percentiles. Larger family sizes and more income sources contribute to higher likelihood of inconsistent estimates from the two designs. Families with wage income as the main income source have the highest likelihood of giving consistent estimates compared with all other families. In contrast, families with agricultural income or property income as the main source tend to have very high probability of larger single-question estimates. Omission of certain income components and rounding can explain over half of the inconsistencies with higher multiple-question estimates and a quarter of the inconsistencies with higher single-question estimates.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":" ","pages":""},"PeriodicalIF":6.3,"publicationDate":"2022-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47384693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Do Different Devices Perform Equally Well with Different Numbers of Scale Points and Response Formats? A test of measurement invariance and reliability 不同的设备在不同的评分点和响应格式下表现一样好吗?测量不变性和可靠性的检验

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-02-07 DOI: 10.1177/00491241221077237

Natalja Menold, V. Toepoel

Research on mixed devices in web surveys is in its infancy. Using a randomized experiment, we investigated device effects (desktop PC, tablet and mobile phone) for six response formats and four different numbers of scale points. N = 5,077 members of an online access panel participated in the experiment. An exact test of measurement invariance and Composite Reliability were investigated. The results provided full data comparability for devices and formats, with the exception of continuous Visual Analog Scale (VAS), but limited comparability for different numbers of scale points. There were device effects on reliability when looking at the interactions with formats and number of scale points. VAS, use of mobile phones and five point scales consistently gained lower reliability. We suggest technically less demanding implementations as well as a unified design for mixed-device surveys.

对网络调查中混合设备的研究尚处于起步阶段。使用随机实验，我们研究了六种响应格式和四个不同数量的量表点的设备效应（台式电脑、平板电脑和手机）。N = 5077名在线访问小组成员参与了这项实验。研究了测量不变性和复合可靠性的精确检验。除连续视觉模拟量表（VAS）外，结果为设备和格式提供了完整的数据可比性，但不同数量的量表点的可比性有限。当观察与标度点的格式和数量的交互时，设备会对可靠性产生影响。VAS、使用手机和五点量表的可靠性一直较低。我们建议在技术上要求较低的实现方式，以及针对混合设备调查的统一设计。

引用次数: 2

What's to Like? Facebook as a Tool for Survey Data Collection. 喜欢什么?Facebook作为调查数据收集的工具。

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-02-01 DOI: 10.1177/0049124119882477

Daniel Schneider, Kristen Harknett

In this paper, we explore the use of Facebook targeted advertisements for the collection of survey data. We illustrate the potential of survey sampling and recruitment on Facebook through the example of building a large employee-employer linked dataset as part of The Shift Project. We describe the workflow process of targeting, creating, and purchasing survey recruitment advertisements on Facebook. We address concerns about sample selectivity, and apply post-stratification weighting techniques to adjust for differences between our sample and that of "gold-standard" data sources. We then compare univariate and multi-variate relationships in the Shift data against the Current Population Survey and the National Longitudinal Survey of Youth-1997. Finally, we provide an example of the utility of the firm-level nature of the data by showing how firm-level gender composition is related to wages. We conclude by discussing some important remaining limitations of the Facebook approach, as well as highlighting some unique strengths of the Facebook targeting advertisement approach, including the ability for rapid data collection in response to research opportunities, rich and flexible sample targeting capabilities, and low cost, and we suggest broader applications of this technique.

在本文中，我们探讨了使用Facebook定向广告来收集调查数据。作为the Shift项目的一部分，我们通过建立一个大型雇员-雇主关联数据集的例子，说明了在Facebook上进行调查抽样和招聘的潜力。我们描述了在Facebook上定位、创建和购买调查招聘广告的工作流程。我们解决了对样本选择性的关注，并应用后分层加权技术来调整样本与“金标准”数据源之间的差异。然后，我们将Shift数据中的单变量和多变量关系与当前人口调查和1997年全国青年纵向调查进行比较。最后，我们通过展示企业层面的性别构成如何与工资相关，提供了一个企业层面数据效用的例子。最后，我们讨论了Facebook方法的一些重要的局限性，并强调了Facebook定向广告方法的一些独特优势，包括响应研究机会的快速数据收集能力，丰富而灵活的样本定位能力，以及低成本，我们建议更广泛地应用该技术。

{"title":"What's to Like? Facebook as a Tool for Survey Data Collection.","authors":"Daniel Schneider, Kristen Harknett","doi":"10.1177/0049124119882477","DOIUrl":"https://doi.org/10.1177/0049124119882477","url":null,"abstract":"<p><p>In this paper, we explore the use of Facebook targeted advertisements for the collection of survey data. We illustrate the potential of survey sampling and recruitment on Facebook through the example of building a large employee-employer linked dataset as part of The Shift Project. We describe the workflow process of targeting, creating, and purchasing survey recruitment advertisements on Facebook. We address concerns about sample selectivity, and apply post-stratification weighting techniques to adjust for differences between our sample and that of \"gold-standard\" data sources. We then compare univariate and multi-variate relationships in the Shift data against the Current Population Survey and the National Longitudinal Survey of Youth-1997. Finally, we provide an example of the utility of the firm-level nature of the data by showing how firm-level gender composition is related to wages. We conclude by discussing some important remaining limitations of the Facebook approach, as well as highlighting some unique strengths of the Facebook targeting advertisement approach, including the ability for rapid data collection in response to research opportunities, rich and flexible sample targeting capabilities, and low cost, and we suggest broader applications of this technique.</p>","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"51 1","pages":"108-140"},"PeriodicalIF":6.3,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/0049124119882477","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9407478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 85

Moving Beyond Linear Regression: Implementing and Interpreting Quantile Regression Models With Fixed Effects 超越线性回归:具有固定效应的分位数回归模型的实现与解释

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-02-01 DOI: 10.1177/00491241211036165

Fernando Rios-Avila, Michelle Lee Maroto

Quantile regression (QR) provides an alternative to linear regression (LR) that allows for the estimation of relationships across the distribution of an outcome. However, as highlighted in recent research on the motherhood penalty across the wage distribution, different procedures for conditional and unconditional quantile regression (CQR, UQR) often result in divergent findings that are not always well understood. In light of such discrepancies, this paper reviews how to implement and interpret a range of LR, CQR, and UQR models with fixed effects. It also discusses the use of Quantile Treatment Effect (QTE) models as an alternative to overcome some of the limitations of CQR and UQR models. We then review how to interpret results in the presence of fixed effects based on a replication of Budig and Hodges’s work on the motherhood penalty using NLSY79 data.

分位数回归(QR)提供了一种替代线性回归(LR)的方法，可以估计结果分布之间的关系。然而，正如最近关于工资分配中母性惩罚的研究所强调的那样，条件分位数回归和无条件分位数回归(CQR, UQR)的不同程序往往导致不同的结果，这些结果并不总是很好地理解。针对这些差异，本文回顾了如何实现和解释一系列具有固定效果的LR、CQR和UQR模型。它还讨论了使用分位数治疗效应(QTE)模型来克服CQR和UQR模型的一些局限性。然后，我们回顾了如何在固定效应存在的情况下解释基于Budig和Hodges使用NLSY79数据复制母性惩罚的工作的结果。

引用次数: 0

Updating a Time-Series of Survey Questions: The Case of Abortion Attitudes in the General Social Survey 更新时间序列调查问题:综合社会调查中的堕胎态度个案

IF 6.3 2区社会学 Q1 SOCIAL SCIENCES, MATHEMATICAL METHODS

Sociological Methods & Research

Pub Date : 2022-01-27 DOI: 10.1177/00491241211043140

Sarah K. Cowan, M. Hout, Stuart Perrett

Long-running surveys need a systematic way to reflect social change and to keep items relevant to respondents, especially when they ask about controversial subjects, or they threaten the items’ validity. We propose a protocol for updating measures that preserves content and construct validity. First, substantive experts articulate the current and anticipated future terms of debate. Then survey experts use this substantive input and their knowledge of existing measures to develop and pilot a large battery of new items. Third, researchers analyze the pilot data to select items for the survey of record. Finally, the items appear on the survey-of-record, available to the whole user community. Surveys-of-record have procedures for changing content that determine if the new items appear just once or become part of the core. We provide the example of developing new abortion attitude measures in the General Social Survey. Current questions ask whether abortion should be legal under varying circumstances. The new abortion items ask about morality, access, state policy, and interpersonal dynamics. They improve content and construct validity and add new insights into Americans’ abortion attitudes.

长期调查需要一种系统的方式来反映社会变化，并保持项目与受访者的相关性，尤其是当他们询问有争议的主题时，或者当他们威胁到项目的有效性时。我们提出了一个用于更新度量的协议，该协议保留了内容和结构的有效性。首先，实质性专家阐明了当前和预期的未来辩论条件。然后，调查专家利用这一实质性投入和他们对现有措施的了解，开发和试行一大批新项目。第三，研究人员分析试点数据，选择项目进行记录调查。最后，这些项目出现在记录的调查中，可供整个用户社区使用。记录调查有更改内容的程序，以确定新项目是只出现一次还是成为核心的一部分。我们在综合社会调查中提供了制定新的堕胎态度措施的例子。目前的问题是，在不同的情况下堕胎是否合法。新的堕胎项目询问道德、准入、国家政策和人际关系动态。它们改善了内容和结构的有效性，并为美国人的堕胎态度增添了新的见解。

{"title":"Updating a Time-Series of Survey Questions: The Case of Abortion Attitudes in the General Social Survey","authors":"Sarah K. Cowan, M. Hout, Stuart Perrett","doi":"10.1177/00491241211043140","DOIUrl":"https://doi.org/10.1177/00491241211043140","url":null,"abstract":"Long-running surveys need a systematic way to reflect social change and to keep items relevant to respondents, especially when they ask about controversial subjects, or they threaten the items’ validity. We propose a protocol for updating measures that preserves content and construct validity. First, substantive experts articulate the current and anticipated future terms of debate. Then survey experts use this substantive input and their knowledge of existing measures to develop and pilot a large battery of new items. Third, researchers analyze the pilot data to select items for the survey of record. Finally, the items appear on the survey-of-record, available to the whole user community. Surveys-of-record have procedures for changing content that determine if the new items appear just once or become part of the core. We provide the example of developing new abortion attitude measures in the General Social Survey. Current questions ask whether abortion should be legal under varying circumstances. The new abortion items ask about morality, access, state policy, and interpersonal dynamics. They improve content and construct validity and add new insights into Americans’ abortion attitudes.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":" ","pages":""},"PeriodicalIF":6.3,"publicationDate":"2022-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41519369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

首页上一页

下一页尾页

类型

全部化学•材料生命科学医学物理工程技术环境•农林材料科学地球科学法学管理学化学环境科学与生态学计算机科学教育学经济学农林科学人文科学生物学数学物理与天体物理心理学综合性期刊其他工业工程理学历史学农学文学信息工程

数据库

全部 ACS Publications Elsevier ieeexplore Springer The Royal Society of Chemistry Wiley

期刊

Sociological Methods & Research

全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.

﹀