首页 > 最新文献

Survey Research Methods最新文献

英文 中文
How to Reconstruct a Trend when Survey Questions Have Changed Over Time. 当调查问题随时间变化时,如何重建趋势。
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2021-04-10 DOI: 10.18148/SRM/2021.V15I1.7725
T. Jonge, Akiko Kamesaka, R. Veenhoven
Many trend studies draw on survey data and compare responses to questions on the same topic that has been asked over time. A problem with such studies is that the questions often do not remain identical, due to changes in phrasing and response formats. We present ways to deal with this problem using trend data on life satisfaction in Japan as an illustrative case. Life satisfaction has been measured in the Life in Nation survey in Japan since 1958 and the question used has been changed several times. We looked at three methods published by scholars who tried to reconstruct a main trend in life satisfaction from these broken time-series, coming to different conclusions. In this paper we discuss their methods and present two new techniques for dealing with changes in survey questions on the same topic.
许多趋势研究利用调查数据,并比较对同一主题的问题的回答,这些问题一直被问到。这种研究的一个问题是,由于措辞和回答格式的变化,问题往往不保持相同。我们以日本的生活满意度趋势数据为例,提出了处理这一问题的方法。自1958年以来,日本的“国民生活调查”(Life in Nation survey)就开始测量生活满意度,所使用的问题已经改变了几次。我们研究了学者们发表的三种方法,他们试图从这些破碎的时间序列中重建生活满意度的主要趋势,得出了不同的结论。在本文中,我们讨论了他们的方法,并提出了两种新的技术来处理同一主题的调查问题的变化。
{"title":"How to Reconstruct a Trend when Survey Questions Have Changed Over Time.","authors":"T. Jonge, Akiko Kamesaka, R. Veenhoven","doi":"10.18148/SRM/2021.V15I1.7725","DOIUrl":"https://doi.org/10.18148/SRM/2021.V15I1.7725","url":null,"abstract":"Many trend studies draw on survey data and compare responses to questions on the same topic that has been asked over time. A problem with such studies is that the questions often do not remain identical, due to changes in phrasing and response formats. We present ways to deal with this problem using trend data on life satisfaction in Japan as an illustrative case. Life satisfaction has been measured in the Life in Nation survey in Japan since 1958 and the question used has been changed several times. We looked at three methods published by scholars who tried to reconstruct a main trend in life satisfaction from these broken time-series, coming to different conclusions. In this paper we discuss their methods and present two new techniques for dealing with changes in survey questions on the same topic.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"15 1","pages":"101-113"},"PeriodicalIF":4.8,"publicationDate":"2021-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42254915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Have You Ever Seen the Rain? It Looks Like It's Going to Rain! 你见过雨吗?看起来要下雨了!
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2021-04-10 DOI: 10.18148/SRM/2021.V15I1.7782
R. Becker
This empirical study examines, whether the weather situations during the different seasons in which panel surveys are carried out have an impact on the timing and extent of survey participation. Based on considerations regarding the panellists’ habits and their assessment of a participation's benefits and costs compared to alternative action, it is assumed that ‘pleasant’ weather diverts them from immediately completing the questionnaire while ‘unpleasant’ weather results in a higher degree of participation right after survey launch. The results of event history analysis based on longitudinal data from a multi-wave panel confirm these assumptions. Additionally, there seems to be an interaction between the season and the weather situation: ‘Pleasant’ weather in spring results in a lower participation rate compared to surveys in summer while, given the same weather situation, the participation rate is higher in autumn. Finally, it is evident that regardless of the season, heavy rainfall at the beginning of the field period is most beneficial for conducting an online survey in terms of both rapid response and high participation rates.
本实证研究考察了在不同季节进行小组调查的天气情况是否对调查参与的时间和程度有影响。考虑到小组成员的习惯以及他们对参与的收益和成本的评估,与其他行动相比,我们假设“宜人”的天气使他们不会立即完成问卷,而“不宜人”的天气导致调查启动后更高程度的参与。基于多波面板纵向数据的事件历史分析结果证实了这些假设。此外,季节和天气情况之间似乎存在相互作用:与夏季相比,春季“宜人”的天气导致参与率较低,而在相同的天气情况下,秋季的参与率较高。最后,很明显,无论季节如何,从快速反应和高参与率的角度来看,实地期开始时的强降雨对进行在线调查最有利。
{"title":"Have You Ever Seen the Rain? It Looks Like It's Going to Rain!","authors":"R. Becker","doi":"10.18148/SRM/2021.V15I1.7782","DOIUrl":"https://doi.org/10.18148/SRM/2021.V15I1.7782","url":null,"abstract":"This empirical study examines, whether the weather situations during the different seasons in which panel surveys are carried out have an impact on the timing and extent of survey participation. Based on considerations regarding the panellists’ habits and their assessment of a participation's benefits and costs compared to alternative action, it is assumed that ‘pleasant’ weather diverts them from immediately completing the questionnaire while ‘unpleasant’ weather results in a higher degree of participation right after survey launch. The results of event history analysis based on longitudinal data from a multi-wave panel confirm these assumptions. Additionally, there seems to be an interaction between the season and the weather situation: ‘Pleasant’ weather in spring results in a lower participation rate compared to surveys in summer while, given the same weather situation, the participation rate is higher in autumn. Finally, it is evident that regardless of the season, heavy rainfall at the beginning of the field period is most beneficial for conducting an online survey in terms of both rapid response and high participation rates.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"15 1","pages":"27-41"},"PeriodicalIF":4.8,"publicationDate":"2021-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48920501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recent Methodological Advances in Panel Data Collection, Analysis, and Application: 面板数据收集、分析和应用方法的最新进展:
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2021-04-09 DOI: 10.18148/SRM/2021.V15I1.7902
Tobias Wolbring, S. Zinn
SRM wants to publish a Special Issue on "Recent Methodological Advances in Panel Data Collection, Analysis, and Application". This call for papers expands on the papers searched and the policies used.
SRM希望出版一期关于“面板数据收集、分析和应用的最新方法学进展”的特刊。本次论文征集对搜索到的论文和使用的政策进行了扩展。
{"title":"Recent Methodological Advances in Panel Data Collection, Analysis, and Application:","authors":"Tobias Wolbring, S. Zinn","doi":"10.18148/SRM/2021.V15I1.7902","DOIUrl":"https://doi.org/10.18148/SRM/2021.V15I1.7902","url":null,"abstract":"SRM wants to publish a Special Issue on \"Recent Methodological Advances in Panel Data Collection, Analysis, and Application\". This call for papers expands on the papers searched and the policies used.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"15 1","pages":""},"PeriodicalIF":4.8,"publicationDate":"2021-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43790428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
행복 측정의 프라이밍 효과와 프레이밍 효과 幸福测定的预估效果与预估效果
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-11-30 DOI: 10.20997/sr.21.4.4
Seonga Kim, Hae-Kun Jung
{"title":"행복 측정의 프라이밍 효과와 프레이밍 효과","authors":"Seonga Kim, Hae-Kun Jung","doi":"10.20997/sr.21.4.4","DOIUrl":"https://doi.org/10.20997/sr.21.4.4","url":null,"abstract":"","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"22 1","pages":""},"PeriodicalIF":4.8,"publicationDate":"2020-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84271257","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Comparability of Measures in the Ageism Module of the Fourth Round of the European Social Survey, 2008-2009 2008-2009年第四轮欧洲社会调查中年龄歧视模块测量方法的可比性
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-10-10 DOI: 10.18148/SRM/2020.V14I4.7369
Daniel Seddig, D. Maskileyson, E. Davidov
Age is an important dimension that is used by people to categorize others. Age-based discrimination is directed toward specific age groups (young and old). In spite of their importance, attitudes toward the elderly have hardly been studied from a cross-country perspective. The fourth round of the European Social Survey (ESS) from 2008-2009 offers, for the first time, the opportunity to study ageism and attitudes toward age groups from a cross-country perspective (European Social Survey Round 4 Data, 2008). However, this opportunity also bears the risk of drawing wrong conclusions, if the scales measuring ageism are not comparable across the countries under study. Such comparisons require measurement equivalence across countries. In the current study, utilizing ESS fourth round data from 29 European countries we examine the cross-country measurement equivalence properties of two concepts that are measured by multiple indicators in the module: (1) competence and warmth and (2) experience of age discrimination. We test for measurement equivalence using two analytical methods: multi-group confirmatory factor analysis (MGCFA) and the alignment optimization. Our findings suggest that cross-country comparisons of these measures are trustworthy. We briefly discuss cross-country differences in competence and warmth and experience of age discrimination. Finally, we underline the importance of testing the cross-group equivalence of measurement instruments before using them in different groups (such as countries) so that meaningful substantive conclusions can be drawn.
年龄是人们用来对他人进行分类的一个重要维度。基于年龄的歧视针对特定年龄组(年轻人和老年人)。尽管对老年人的态度很重要,但几乎没有从跨国的角度来研究。2008-2009年第四轮欧洲社会调查首次提供了从跨国角度研究年龄歧视和对年龄组的态度的机会(欧洲社会调查第四轮数据,2008年)。然而,如果衡量年龄歧视的量表在所研究的国家之间不具有可比性,那么这个机会也有得出错误结论的风险。这种比较需要各国之间的计量等效性。在当前的研究中,利用来自29个欧洲国家的ESS第四轮数据,我们检验了两个概念的跨国测量等效性,这两个概念由模块中的多个指标来衡量:(1)能力和热情;(2)年龄歧视经历。我们使用两种分析方法测试测量等效性:多组验证性因素分析(MGCFA)和比对优化。我们的研究结果表明,对这些指标进行跨国比较是值得信赖的。我们简要讨论了能力、热情和年龄歧视经历方面的跨国差异。最后,我们强调,在不同群体(如国家)使用计量工具之前,必须测试计量工具的跨群体等效性,以便得出有意义的实质性结论。
{"title":"The Comparability of Measures in the Ageism Module of the Fourth Round of the European Social Survey, 2008-2009","authors":"Daniel Seddig, D. Maskileyson, E. Davidov","doi":"10.18148/SRM/2020.V14I4.7369","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7369","url":null,"abstract":"Age is an important dimension that is used by people to categorize others. Age-based discrimination is directed toward specific age groups (young and old). In spite of their importance, attitudes toward the elderly have hardly been studied from a cross-country perspective. The fourth round of the European Social Survey (ESS) from 2008-2009 offers, for the first time, the opportunity to study ageism and attitudes toward age groups from a cross-country perspective (European Social Survey Round 4 Data, 2008). However, this opportunity also bears the risk of drawing wrong conclusions, if the scales measuring ageism are not comparable across the countries under study. Such comparisons require measurement equivalence across countries. In the current study, utilizing ESS fourth round data from 29 European countries we examine the cross-country measurement equivalence properties of two concepts that are measured by multiple indicators in the module: (1) competence and warmth and (2) experience of age discrimination. We test for measurement equivalence using two analytical methods: multi-group confirmatory factor analysis (MGCFA) and the alignment optimization. Our findings suggest that cross-country comparisons of these measures are trustworthy. We briefly discuss cross-country differences in competence and warmth and experience of age discrimination. Finally, we underline the importance of testing the cross-group equivalence of measurement instruments before using them in different groups (such as countries) so that meaningful substantive conclusions can be drawn.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"351-364"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45117803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Measurement Equivalence of Subjective Well-Being Scales under the Presence of Acquiescent Response Style for the Racially and Ethnically Diverse Older Population in the United States 美国不同种族和民族老年人口默认反应风格下主观幸福感量表的测量等效性
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-10-10 DOI: 10.18148/SRM/2020.V14I4.7413
Sunghee Lee, E. Vásquez, L. Ryan, Jacqui Smith
Objectives. While valid assessment of subjective well-being (SWB) is at the forefront of ageing research, literature increasingly reports cross-cultural measurement invariance on scales designed to capture SWB. This study examines measurement properties of well-established SWB scales and their comparability between older Hispanics and Whites in the US. Methods. We examined measurement properties of the satisfaction with life (SWL), purpose in life (PIL)and positive affect (PAF) scales using multigroup confirmatory factor analysis (CFA) and multigroup hierarchical CFA on three subgroups in the Health and Retirement Study: non-Hispanic Whites, Hispanics interviewed in English and Hispanics interviewed in Spanish. We also examined acquiescence response style in measurement invariance testing. Results. SWL was the only scale that provided reasonable measurement invariance. However, it lacked comparability in its measurement validity, with much lower validity for Hispanics than Whites. Measurement invariance was observed lower across all models when fitted on the data restricted to respondents with a tendency to acquiesce than the counterpart. Discussion. Our analysis offers evidence that the traditional measurement invariance test is not effective under the presence of response style for measurement instruments that use the Likert-type response scales. Research into cross-cultural differences in conceptualization of SWB and methodology to measure SWB is likely to improve our ability to accurately understand SWB with the increasingly diverse population.
目标。虽然主观幸福感(SWB)的有效评估处于老龄化研究的前沿,但文献越来越多地报道了用于捕获主观幸福感的量表的跨文化测量不变性。本研究考察了公认的主观幸福感量表的测量特性及其在美国老年西班牙裔和白人之间的可比性。方法。我们使用多组验证性因子分析(CFA)和多组分层CFA对健康与退休研究中的三个亚组:非西班牙裔白人、用英语访谈的西班牙裔和用西班牙语访谈的西班牙裔进行了生活满意度(SWL)、生活目的(PIL)和积极影响(PAF)量表的测量特性进行了检验。我们还在测量不变性测试中考察了默认反应方式。结果。SWL是唯一提供合理测量不变性的量表。然而,其测量效度缺乏可比性,西班牙裔的效度远低于白人。测量不变性在所有模型中观察到较低,当拟合的数据仅限于具有默认倾向的应答者时。讨论。我们的分析提供了证据,证明传统的测量不变性检验在使用李克特型反应量表的测量仪器的反应风格存在下是无效的。研究主观幸福感概念和衡量主观幸福感的方法的跨文化差异,可能会提高我们准确理解主观幸福感的能力,因为人口越来越多样化。
{"title":"Measurement Equivalence of Subjective Well-Being Scales under the Presence of Acquiescent Response Style for the Racially and Ethnically Diverse Older Population in the United States","authors":"Sunghee Lee, E. Vásquez, L. Ryan, Jacqui Smith","doi":"10.18148/SRM/2020.V14I4.7413","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7413","url":null,"abstract":"Objectives. While valid assessment of subjective well-being (SWB) is at the forefront of ageing research, literature increasingly reports cross-cultural measurement invariance on scales designed to capture SWB. This study examines measurement properties of well-established SWB scales and their comparability between older Hispanics and Whites in the US. Methods. We examined measurement properties of the satisfaction with life (SWL), purpose in life (PIL)and positive affect (PAF) scales using multigroup confirmatory factor analysis (CFA) and multigroup hierarchical CFA on three subgroups in the Health and Retirement Study: non-Hispanic Whites, Hispanics interviewed in English and Hispanics interviewed in Spanish. We also examined acquiescence response style in measurement invariance testing. Results. SWL was the only scale that provided reasonable measurement invariance. However, it lacked comparability in its measurement validity, with much lower validity for Hispanics than Whites. Measurement invariance was observed lower across all models when fitted on the data restricted to respondents with a tendency to acquiesce than the counterpart. Discussion. Our analysis offers evidence that the traditional measurement invariance test is not effective under the presence of response style for measurement instruments that use the Likert-type response scales. Research into cross-cultural differences in conceptualization of SWB and methodology to measure SWB is likely to improve our ability to accurately understand SWB with the increasingly diverse population.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"417-437"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45428510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Revisiting the Middleton Alienation Scale: In Search of a Cross-Culturally Valid Instrument 重新审视米德尔顿异化量表:寻找一种跨文化有效的工具
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-10-10 DOI: 10.18148/SRM/2020.V14I4.7421
Ekaterina I. Lytkina
The article contributes to the issue how to deal with measurement non-variance. I address a well-established scale by Middleton (1963) which was created to measure alienation. However, unlike commonly treated in literature, there is evidence that the scale is two-dimensional, and consists of the measures of anomie and alienation. I use the data from two datasets, where the scale was most recently applied, World Values Survey (2011), and Euromodule (1999-2002), for a set of diverse countries representing Western, post-communist, and Eastern societies. The datasets are analyzed separately. Results of confirmatory factor analysis followed by multigroup comparisons give evidence that for a set of countries the two-dimensional scale is applicable or preferable. Full measurement invariance is reached for Russia and Kazakhstan in the World Values Survey, and Slovenia, Switzerland, Germany, Austria, Turkey, and South Korea in the Euromodule. Approximate measurement invariance using Bayesian statistics enabled to reach approximate scalar invariance in Russia and Kazakhstan in the World Values Survey and in Slovenia, and Switzerland in the Euromodule dataset. Additionally, to be sure that the two dimensions are indeed distinct, I used a set of indicators to predict each of the factors.
本文对如何处理度量非方差问题做出了贡献。我谈到了米德尔顿(1963)为衡量异化而创建的一个公认的量表。然而,与文献中通常处理的不同,有证据表明,尺度是二维的,由失范和异化的衡量标准组成。我使用了两个数据集的数据,最近应用了该量表,即世界价值观调查(2011年)和欧洲模块(1999-2002年),用于代表西方、后共产主义和东方社会的一组不同国家。数据集分别进行分析。验证性因素分析和多组比较的结果表明,对于一组国家来说,二维量表是适用的或更可取的。在世界价值调查中,俄罗斯和哈萨克斯坦以及在欧洲模块中的斯洛文尼亚、瑞士、德国、奥地利、土耳其和韩国都达到了完全的测量不变性。使用贝叶斯统计的近似测量不变性使俄罗斯和哈萨克斯坦在世界价值调查中以及斯洛文尼亚和瑞士在Euromodule数据集中达到近似标量不变性。此外,为了确保这两个维度确实是不同的,我使用了一组指标来预测每一个因素。
{"title":"Revisiting the Middleton Alienation Scale: In Search of a Cross-Culturally Valid Instrument","authors":"Ekaterina I. Lytkina","doi":"10.18148/SRM/2020.V14I4.7421","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7421","url":null,"abstract":"The article contributes to the issue how to deal with measurement non-variance. I address a well-established scale by Middleton (1963) which was created to measure alienation. However, unlike commonly treated in literature, there is evidence that the scale is two-dimensional, and consists of the measures of anomie and alienation. I use the data from two datasets, where the scale was most recently applied, World Values Survey (2011), and Euromodule (1999-2002), for a set of diverse countries representing Western, post-communist, and Eastern societies. The datasets are analyzed separately. Results of confirmatory factor analysis followed by multigroup comparisons give evidence that for a set of countries the two-dimensional scale is applicable or preferable. Full measurement invariance is reached for Russia and Kazakhstan in the World Values Survey, and Slovenia, Switzerland, Germany, Austria, Turkey, and South Korea in the Euromodule. Approximate measurement invariance using Bayesian statistics enabled to reach approximate scalar invariance in Russia and Kazakhstan in the World Values Survey and in Slovenia, and Switzerland in the Euromodule dataset. Additionally, to be sure that the two dimensions are indeed distinct, I used a set of indicators to predict each of the factors.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"365-397"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45622289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating the Relative Impact of Different Sources of Measurement Non-Equivalence in Comparative Surveys. An Illustration with Scale Format, Data Collection Mode and Cross-National Variations 比较调查中不同计量来源非等效性的相对影响研究。比例尺格式、数据采集模式和跨国差异的图解
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-10-10 DOI: 10.18148/SRM/2020.V14I4.7416
C. Roberts, Oriane Sarrasin, M. E. Staehli
Different factors are known to affect the comparability of multinational, multicultural and multiregional (‘3MC’) survey data. These include factors relevant to the design of the questionnaire in different contexts (such as cultural differences in how a concept is understood, inaccurate or approximate translations of concepts, and variant adaptations to question formats). Others include factors relating to the survey design in general and how it is implemented across contexts (such as sample design, choice of mode(s), and contact strategies). Together, they contribute item, method and construct biases that can affect the invariance of composite measures. While research to date has looked at the effects of these factors on measurement invariance individually, there have been few attempts to compare them directly and assess their relative impact. To illustrate how this can be done, the present paper tests for measurement invariance in a subjective wellbeing measure across question formats, modes, languages, and countries, combining European Social Survey data from designed and natural experiments (resulting from the use of variant question formulations and translations) from Germany, Switzerland and France. Overall, we find translation errors, language and culture to be bigger sources of non-equivalence than question format and mode. The findings have implications for both survey designers making decisions about optimal resource allocation in the design of 3MC studies, as well as for comparative analysts interested in comparing countries with shared languages and interpreting cross-group differences.
已知不同因素会影响多国、多文化和多地区(“3MC”)调查数据的可比性。其中包括在不同背景下与问卷设计相关的因素(如理解概念的文化差异、概念的不准确或近似翻译以及对问题格式的变体改编)。其他因素包括与调查设计有关的一般因素以及如何在不同背景下实施调查设计(如样本设计、模式选择和联系策略)。它们共同贡献了可以影响复合测度不变性的项目、方法和构造偏差。虽然迄今为止的研究已经单独研究了这些因素对测量不变性的影响,但很少有人尝试直接比较它们并评估它们的相对影响。为了说明如何做到这一点,本文结合来自德国、瑞士和法国的设计和自然实验(使用变体问题公式和翻译)的欧洲社会调查数据,测试了主观幸福感测量在问题格式、模式、语言和国家之间的测量不变性。总的来说,我们发现翻译错误、语言和文化是比问题形式和模式更大的不对等来源。这些发现对调查设计者在设计3MC研究时做出最佳资源分配的决定,以及对有兴趣比较使用共同语言的国家和解释跨群体差异的比较分析师都有意义。
{"title":"Investigating the Relative Impact of Different Sources of Measurement Non-Equivalence in Comparative Surveys. An Illustration with Scale Format, Data Collection Mode and Cross-National Variations","authors":"C. Roberts, Oriane Sarrasin, M. E. Staehli","doi":"10.18148/SRM/2020.V14I4.7416","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7416","url":null,"abstract":"Different factors are known to affect the comparability of multinational, multicultural and multiregional (‘3MC’) survey data. These include factors relevant to the design of the questionnaire in different contexts (such as cultural differences in how a concept is understood, inaccurate or approximate translations of concepts, and variant adaptations to question formats). Others include factors relating to the survey design in general and how it is implemented across contexts (such as sample design, choice of mode(s), and contact strategies). Together, they contribute item, method and construct biases that can affect the invariance of composite measures. While research to date has looked at the effects of these factors on measurement invariance individually, there have been few attempts to compare them directly and assess their relative impact. To illustrate how this can be done, the present paper tests for measurement invariance in a subjective wellbeing measure across question formats, modes, languages, and countries, combining European Social Survey data from designed and natural experiments (resulting from the use of variant question formulations and translations) from Germany, Switzerland and France. Overall, we find translation errors, language and culture to be bigger sources of non-equivalence than question format and mode. The findings have implications for both survey designers making decisions about optimal resource allocation in the design of 3MC studies, as well as for comparative analysts interested in comparing countries with shared languages and interpreting cross-group differences.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"399-415"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43346034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Valid vs. Invalid Straightlining: The Complex Relationship Between Straightlining and Data Quality 有效与无效直线化:直线化与数据质量之间的复杂关系
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-09-25 DOI: 10.18148/SRM/2020.V14I5.7641
K. Reuning, E. Plutzer
Straightlining – the tendency to give the same response to a series of grouped questions – can be the result of satisficing respondents. As a result, many survey practitioners use straightlining as one, and sometimes the only, indicator of data quality. Respondents identified as straightliners are often removed from the data set on the assumption that their answers are meaningless. In this paper we show that these practices are based on a logical fallacy and demonstrate that in many common survey formats, the incidence of straightlining can be increased by improving the validity and the reliability of survey questions. We take initial steps in investigating the complexities and challenges of data analysis by providing a formal definition of valid straightlining and leverage that definition in a series of Monte Carlo simulations to better understand the conditions that give rise to valid straightlining. Although it remains for future work to distinguish valid from invalid straightliners, our formal definition of the concept and our simulation methods augment the tools survey analysts employ in assessing the prevalence of low effort respondents in survey data sets. The paper thereby takes initial steps toward sounder methods of classifying straightliners as optimizers or satisficers.
直截了当——倾向于对一系列分组问题做出相同的回答——可能是让受访者满意的结果。因此,许多调查从业者将直线作为数据质量的一个指标,有时也是唯一的指标。被认定为直接了当的受访者通常会被从数据集中删除,因为他们认为自己的答案毫无意义。在本文中,我们证明了这些做法是基于逻辑谬误的,并证明在许多常见的调查格式中,可以通过提高调查问题的有效性和可靠性来增加直线的发生率。我们通过提供有效直线的正式定义来调查数据分析的复杂性和挑战,并在一系列蒙特卡洛模拟中利用该定义来更好地理解产生有效直线的条件。尽管区分有效直线和无效直线还有待于未来的工作,但我们对概念的正式定义和模拟方法增强了调查分析师在评估调查数据集中低努力受访者的普遍性时使用的工具。因此,本文朝着将直线机分类为优化器或满足器的更合理方法迈出了初步的步伐。
{"title":"Valid vs. Invalid Straightlining: The Complex Relationship Between Straightlining and Data Quality","authors":"K. Reuning, E. Plutzer","doi":"10.18148/SRM/2020.V14I5.7641","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I5.7641","url":null,"abstract":"Straightlining – the tendency to give the same response to a series of grouped questions – can be the result of satisficing respondents. As a result, many survey practitioners use straightlining as one, and sometimes the only, indicator of data quality. Respondents identified as straightliners are often removed from the data set on the assumption that their answers are meaningless. In this paper we show that these practices are based on a logical fallacy and demonstrate that in many common survey formats, the incidence of straightlining can be increased by improving the validity and the reliability of survey questions. We take initial steps in investigating the complexities and challenges of data analysis by providing a formal definition of valid straightlining and leverage that definition in a series of Monte Carlo simulations to better understand the conditions that give rise to valid straightlining. Although it remains for future work to distinguish valid from invalid straightliners, our formal definition of the concept and our simulation methods augment the tools survey analysts employ in assessing the prevalence of low effort respondents in survey data sets. The paper thereby takes initial steps toward sounder methods of classifying straightliners as optimizers or satisficers.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"439-459"},"PeriodicalIF":4.8,"publicationDate":"2020-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47079818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Helpful Reminders? Health Survey Participation and Doctor’s Visits among Aging Adults 有用的提醒?老年人健康调查参与与就诊
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-09-25 DOI: 10.18148/SRM/2020.V14I5.7642
J. Caputo, M. Dańko, H. Brønnum-Hansen, A. Oksuzyan
Objectives: Longitudinal surveys are an important source of information about the health of aging populations. While there is growing concern about how participating in these studies affects participants, assessments of survey participation effects on objectively measured behaviors are scarce. Methods: We used register-linked data from the Danish component of the Survey of Health, Aging and Retirement in Europe, a rotating, biennial panel survey of adults aged 50+, to assess whether survey participation is associated with changes in self-reported and actual doctor’s visits. New respondents were added during the second wave, allowing us to compare doctor’s visits between groups who entered the survey at different times. Results: Age-related increases in neither self-reported nor register-recorded doctor’s visits significantly differed between the two rotating samples. Discussion: Our findings add to literature about survey participation effects, suggesting that they may not be present for either self-reported or objective measures of this important health behavior.
目的:纵向调查是了解老龄人口健康状况的重要信息来源。尽管人们越来越担心参与这些研究对参与者的影响,但很少评估调查参与对客观测量行为的影响。方法:我们使用了欧洲健康、老龄化和退休调查丹麦部分的注册关联数据,这是一项针对50岁以上成年人的两年一次的轮流小组调查,以评估参与调查是否与自我报告和实际医生就诊的变化有关。在第二波调查中增加了新的受访者,使我们能够比较不同时间参加调查的各组的医生就诊情况。结果:在两个轮换样本中,与年龄相关的自报和登记医生就诊次数的增加都没有显著差异。讨论:我们的发现增加了关于调查参与效应的文献,表明它们可能不存在于对这一重要健康行为的自我报告或客观测量中。
{"title":"Helpful Reminders? Health Survey Participation and Doctor’s Visits among Aging Adults","authors":"J. Caputo, M. Dańko, H. Brønnum-Hansen, A. Oksuzyan","doi":"10.18148/SRM/2020.V14I5.7642","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I5.7642","url":null,"abstract":"Objectives: Longitudinal surveys are an important source of information about the health of aging populations. While there is growing concern about how participating in these studies affects participants, assessments of survey participation effects on objectively measured behaviors are scarce. \u0000Methods: We used register-linked data from the Danish component of the Survey of Health, Aging and Retirement in Europe, a rotating, biennial panel survey of adults aged 50+, to assess whether survey participation is associated with changes in self-reported and actual doctor’s visits. New respondents were added during the second wave, allowing us to compare doctor’s visits between groups who entered the survey at different times. \u0000Results: Age-related increases in neither self-reported nor register-recorded doctor’s visits significantly differed between the two rotating samples. \u0000Discussion: Our findings add to literature about survey participation effects, suggesting that they may not be present for either self-reported or objective measures of this important health behavior.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"487-497"},"PeriodicalIF":4.8,"publicationDate":"2020-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48614771","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Survey Research Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1