首页 > 最新文献

Survey Research Methods最新文献

英文 中文
The Benefits of Conversational Interviewing Depend on Who Asks the Questions and the Types of Questions They Ask 对话式面试的好处取决于提问的人以及提问的类型
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-09-25 DOI: 10.18148/SRM/2020.V14I5.7617
F. Hubbard, F. Conrad, Christopher Antoun
By clarifying the meaning of survey questions, interviewers help assure that respondents and researchers interpret questions the same way. This practice is at the heart of conversational interviewing and has been shown to improve response accuracy relative to standardized interviewing. This research investigates two issues: (1) Does conversational interviewing lead to improved response quality for opinion questions as it does for factual questions? and (2) Are some interviewers better suited to conduct conversational interviews than others?  490 respondents in the University of Michigan Surveys of Consumers participated in standardized telephone interviews after which they were re-asked five factual and five opinion questions. These questions were re-administered in conversational interviews for half the respondents; for the remaining half they were re-administered in standardized interviews. Interviewers also completed a nonverbal sensitivity questionnaire. Using response change between the two administrations of each question to measure response quality, the conversational technique improved quality while increasing interview duration. The comprehension benefits of conversational interviewing were no greater for opinion than factual questions. Moreover, interviewers low in nonverbal sensitivity more often gave definitions before respondents were able to speak, but this did not affect data quality (response change).  Taken togetherthese results suggest that conversational interviewing can beeffectively administered by a range of professional interviewers,although those who are more attuned to respondents' comprehensionwill be more efficient, and the technique will equally benefit thequality of responses to questions about objective and subjectivephenomena.
通过澄清调查问题的含义,访谈者有助于确保受访者和研究人员以相同的方式解释问题。这种做法是谈话式面试的核心,与标准化面试相比,它可以提高回答的准确性。本研究调查了两个问题:(1)对话式面试是否能像对待事实问题一样,提高观点问题的回答质量?以及(2)是否有些面试官比其他人更适合进行对话式面试?密歇根大学消费者调查中的490名受访者参加了标准化的电话采访,之后他们被重新询问了五个事实问题和五个意见问题。这些问题在对话式访谈中被重新回答了一半的受访者;对于剩下的一半,他们在标准化访谈中进行了重新管理。采访者还完成了一份非语言敏感性问卷。利用两个行政部门对每个问题的回答变化来衡量回答质量,对话技术在增加面试时长的同时提高了质量。对话式访谈对观点的理解益处并不比事实问题更大。此外,非语言敏感性低的受访者往往在受访者能够说话之前给出定义,但这并不影响数据质量(反应变化)。总之,这些结果表明,对话式面试可以由一系列专业面试官进行有效的管理,尽管那些更适应受访者理解的人会更有效率,而且这种技术同样有利于提高对客观和主观名词问题的回答质量。
{"title":"The Benefits of Conversational Interviewing Depend on Who Asks the Questions and the Types of Questions They Ask","authors":"F. Hubbard, F. Conrad, Christopher Antoun","doi":"10.18148/SRM/2020.V14I5.7617","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I5.7617","url":null,"abstract":"By clarifying the meaning of survey questions, interviewers help assure that respondents and researchers interpret questions the same way. This practice is at the heart of conversational interviewing and has been shown to improve response accuracy relative to standardized interviewing. This research investigates two issues: (1) Does conversational interviewing lead to improved response quality for opinion questions as it does for factual questions? and (2) Are some interviewers better suited to conduct conversational interviews than others?  490 respondents in the University of Michigan Surveys of Consumers participated in standardized telephone interviews after which they were re-asked five factual and five opinion questions. These questions were re-administered in conversational interviews for half the respondents; for the remaining half they were re-administered in standardized interviews. Interviewers also completed a nonverbal sensitivity questionnaire. Using response change between the two administrations of each question to measure response quality, the conversational technique improved quality while increasing interview duration. The comprehension benefits of conversational interviewing were no greater for opinion than factual questions. Moreover, interviewers low in nonverbal sensitivity more often gave definitions before respondents were able to speak, but this did not affect data quality (response change).  Taken togetherthese results suggest that conversational interviewing can beeffectively administered by a range of professional interviewers,although those who are more attuned to respondents' comprehensionwill be more efficient, and the technique will equally benefit thequality of responses to questions about objective and subjectivephenomena.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"515-531"},"PeriodicalIF":4.8,"publicationDate":"2020-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42567724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Collecting biomarkers and biological samples in Australian primary schools: Insights from the field 在澳大利亚小学收集生物标志物和生物样本:来自该领域的见解
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-09-25 DOI: 10.18148/SRM/2020.V14I5.7647
M. Truong
There are increasing efforts to incorporate biology into our study of the social determinants of health.  While there is increasing utilisation of biosocial methods in child health and health disparities research, protocols for collecting biomeasures in community contexts involving children are underdeveloped. This paper is based on the Speak Out Against Racism (SOAR) project which collected anthropometric, blood pressure and biosamples (buccal swabs and saliva) from a diverse sample of 124 children (aged 10-12) at 3 public schools. Students participated in hands-on science tutorials that provided an overview of the study protocol and goals. This paper describes the methods employed, as well as the practical and ethical considerations necessary for biomeasure data collection within schools. This study discusses the feasibility of collecting biological data in school settings, including the considerable preparation and resources required for recruitment, planning and data collection. Lessons learned and suggestions to inform future research and practice in this area are discussed.
越来越多的人努力将生物学纳入我们对健康的社会决定因素的研究中。虽然在儿童健康和健康差异研究中越来越多地使用生物社会方法,但在涉及儿童的社区环境中收集生物测量的协议还不完善。本文基于“大声反对种族主义”(SOAR)项目,该项目从3所公立学校的124名儿童(10-12岁)的不同样本中收集了人体测量、血压和生物样本(口腔拭子和唾液)。学生们参加了实践科学教程,其中概述了学习方案和目标。本文介绍了学校内生物测量数据收集所采用的方法,以及必要的实践和伦理考虑。本研究讨论了在学校环境中收集生物数据的可行性,包括招聘、规划和数据收集所需的大量准备和资源。讨论了在这一领域的研究和实践中吸取的经验教训和提出的建议。
{"title":"Collecting biomarkers and biological samples in Australian primary schools: Insights from the field","authors":"M. Truong","doi":"10.18148/SRM/2020.V14I5.7647","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I5.7647","url":null,"abstract":"There are increasing efforts to incorporate biology into our study of the social determinants of health.  While there is increasing utilisation of biosocial methods in child health and health disparities research, protocols for collecting biomeasures in community contexts involving children are underdeveloped. This paper is based on the Speak Out Against Racism (SOAR) project which collected anthropometric, blood pressure and biosamples (buccal swabs and saliva) from a diverse sample of 124 children (aged 10-12) at 3 public schools. Students participated in hands-on science tutorials that provided an overview of the study protocol and goals. This paper describes the methods employed, as well as the practical and ethical considerations necessary for biomeasure data collection within schools. This study discusses the feasibility of collecting biological data in school settings, including the considerable preparation and resources required for recruitment, planning and data collection. Lessons learned and suggestions to inform future research and practice in this area are discussed.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"477-486"},"PeriodicalIF":4.8,"publicationDate":"2020-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43094238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
"A Methodological Review on Analyzing the Effect of National Basic Livelihood Security Program" 《国家基本生活保障计划效果分析的方法论述评》
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-08-31 DOI: 10.20997/sr.21.3.7
Wonjin Lee
{"title":"\"A Methodological Review on Analyzing the Effect of National Basic Livelihood Security Program\"","authors":"Wonjin Lee","doi":"10.20997/sr.21.3.7","DOIUrl":"https://doi.org/10.20997/sr.21.3.7","url":null,"abstract":"","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"15 1","pages":""},"PeriodicalIF":4.8,"publicationDate":"2020-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85535101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic Coding of Open-ended Questions into Multiple Classes: Whether and How to Use Double Coded Data 开放式问题的多类自动编码:是否以及如何使用双编码数据
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-08-10 DOI: 10.18148/SRM/2020.V14I3.7639
Zhoushanyue He, Matthias Schonlau
Responses to open-ended questions in surveys are usually coded into pre-specified classes, manually or automatically using a statistical learning algorithm. Automatic coding of open-ended responses relies on a set of manually coded responses, based on which a statistical learning model is fitted. In this paper, we investigate whether and how double coding can help improve the automatic classification of open-ended responses. We evaluate four strategies for training the statistical algorithm on double coded data, using experiments on simulated and real data. We find that, when the data are already double-coded (i.e. double coding does not incur additional costs), double coding where an expert resolves intercoder disagreement leads to the greatest classification accuracy. However, when we have a fixed budget for manually coding, single coding is preferable if the coding error rate is anticipated to be less than about 35% to 45%.
调查中对开放式问题的回答通常被编码到预先指定的类别中,手动或自动使用统计学习算法。开放式回答的自动编码依赖于一组手动编码的回答,在此基础上拟合统计学习模型。在本文中,我们研究了双重编码是否以及如何有助于改进开放式回答的自动分类。我们使用模拟和真实数据上的实验,评估了在双编码数据上训练统计算法的四种策略。我们发现,当数据已经被双重编码时(即双重编码不会产生额外的成本),专家解决码间分歧的双重编码会带来最大的分类精度。然而,当我们有固定的手动编码预算时,如果编码错误率预计小于约35%至45%,则单次编码是优选的。
{"title":"Automatic Coding of Open-ended Questions into Multiple Classes: Whether and How to Use Double Coded Data","authors":"Zhoushanyue He, Matthias Schonlau","doi":"10.18148/SRM/2020.V14I3.7639","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I3.7639","url":null,"abstract":"Responses to open-ended questions in surveys are usually coded into pre-specified classes, manually or automatically using a statistical learning algorithm. Automatic coding of open-ended responses relies on a set of manually coded responses, based on which a statistical learning model is fitted. In this paper, we investigate whether and how double coding can help improve the automatic classification of open-ended responses. We evaluate four strategies for training the statistical algorithm on double coded data, using experiments on simulated and real data. We find that, when the data are already double-coded (i.e. double coding does not incur additional costs), double coding where an expert resolves intercoder disagreement leads to the greatest classification accuracy. However, when we have a fixed budget for manually coding, single coding is preferable if the coding error rate is anticipated to be less than about 35% to 45%.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"267-287"},"PeriodicalIF":4.8,"publicationDate":"2020-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46333020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Designing Better Questions for Complex Concepts with Reflective Indicators 用反射指标为复杂概念设计更好的问题
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-08-10 DOI: 10.18148/SRM/2020.V14I3.7613
W. Saris, I. Gallhofer
There are many concepts in the social sciences that are measured using multiple indicators. Such concepts have been called by Blalock (1968) concepts-by-postulation because one needs a theoretical argument to define them. Within the set of concepts-by-postulation, a distinction has been made between concepts with reflective indicators and concepts with formative indicators. This distinction refers to the assumption whether the latent concepts determine the observed indicators (reflective) or that the indicators together determine the latent concept of interest (formative). Blalock complained that developing measurement procedures for complex concepts, researchers think mainly about questions not about concepts that these questions measure. In this way, the questions used contain unique components which reduce the quality of the composite score based on these questions as measure for the complex concept of interest. Saris and Gallhofer have shown how alternative formulated questions can be developed to measure so-called concepts-by-intuition. In this paper, we will show that the same procedure can be used to avoid unique components in the measurement of complex concepts with reflective indicators and that in this way the quality of the composite score for complex concepts can considerably be increased.
社会科学中有许多概念是用多个指标来衡量的。这些概念被Blalock(1968)称为假设概念,因为人们需要一个理论论据来定义它们。在一套假设概念中,对具有反射性指标的概念和具有形成性指标的概念进行了区分。这种区别指的是这样一种假设,即潜在概念决定观察到的指标(反思性),还是这些指标共同决定潜在的兴趣概念(形成性)。Blalock抱怨说,在为复杂概念开发测量程序时,研究人员主要考虑的是问题,而不是这些问题所测量的概念。通过这种方式,所使用的问题包含独特的成分,从而降低了基于这些问题的综合分数的质量,这些问题是对复杂的兴趣概念的衡量。Saris和Gallhofer展示了如何开发替代性公式化问题来衡量所谓的直觉概念。在本文中,我们将表明,可以使用相同的程序来避免具有反射性指标的复杂概念测量中的独特成分,并且通过这种方式,复杂概念的综合得分的质量可以大大提高。
{"title":"Designing Better Questions for Complex Concepts with Reflective Indicators","authors":"W. Saris, I. Gallhofer","doi":"10.18148/SRM/2020.V14I3.7613","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I3.7613","url":null,"abstract":"There are many concepts in the social sciences that are measured using multiple indicators. Such concepts have been called by Blalock (1968) concepts-by-postulation because one needs a theoretical argument to define them. Within the set of concepts-by-postulation, a distinction has been made between concepts with reflective indicators and concepts with formative indicators. This distinction refers to the assumption whether the latent concepts determine the observed indicators (reflective) or that the indicators together determine the latent concept of interest (formative). Blalock complained that developing measurement procedures for complex concepts, researchers think mainly about questions not about concepts that these questions measure. In this way, the questions used contain unique components which reduce the quality of the composite score based on these questions as measure for the complex concept of interest. Saris and Gallhofer have shown how alternative formulated questions can be developed to measure so-called concepts-by-intuition. In this paper, we will show that the same procedure can be used to avoid unique components in the measurement of complex concepts with reflective indicators and that in this way the quality of the composite score for complex concepts can considerably be increased.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"253-266"},"PeriodicalIF":4.8,"publicationDate":"2020-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41878165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Memory Effects in Repeated Survey Questions: Reviving the Empirical Investigation of the Independent Measurements Assumption 重复调查问题中的记忆效应:独立测量假设的实证研究
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-07-10 DOI: 10.18148/SRM/2020.V14I3.7579
Hannah Schwarz, M. Revilla, Wiebke Weber
It is common to repeat survey questions in the social sciences, for example to estimate test-retest reliability or in pretest-posttest experimental designs. An underlying assumption is that the repetition of questions leads to independent measurements. Critics point to respondents’ memory as a source of bias for the resulting estimates. Yet there is little empirical evidence showing how large memory effects are within the same survey and none showing whether memory effects can be decreased through purposeful intervention during a survey. We aim to address both of these points based on data from a lab-based web survey containing an experiment. We repeated one of the initial questions at the end of the survey (on average 127 questions later) and asked respondents if they recall their previous answer and to reproduce it. Furthermore, we compared respondents’ memory of previously given responses between two experimental groups: A control group, where regular survey questions were asked in between repetitions and a treatment group which, additionally, received a memory interference task aimed at decreasing memory. We found that, after an average 20-minute interval, 60% of the respondents were able to correctly reproduce their previous answer, of which we estimated 17% to do so due to memory. We did not observe a decrease in memory as time intervals between repetitions become longer. This indicates a serious challenge to using repeated questions within the same survey. Moreover, the tested memory interference task did not reduce respondents’ recall of their previously given answer or the memory effect.
在社会科学中,重复调查问题是很常见的,例如评估测试-再测试的可靠性或在测试前-测试后的实验设计中。一个基本的假设是,问题的重复会导致独立的测量。批评者指出,受访者的记忆力是由此得出的估计存在偏见的原因。然而,几乎没有实证证据表明在同一项调查中记忆效应有多大,也没有证据表明在调查中是否可以通过有目的的干预来减少记忆效应。我们的目标是基于一项包含实验的基于实验室的网络调查的数据来解决这两个问题。在调查结束时,我们重复了最初的一个问题(平均127个问题之后),并询问受访者是否记得以前的答案并重复。此外,我们比较了两个实验组的受访者对以前给出的答案的记忆:对照组和治疗组,对照组在重复之间定期提出调查问题,并且另外接收到旨在减少存储器的存储器干扰任务。我们发现,在平均20分钟的时间间隔后,60%的受访者能够正确地重现他们之前的答案,其中我们估计17%的人是因为记忆。我们没有观察到随着重复之间的时间间隔变长,记忆力下降。这表明在同一调查中使用重复问题是一个严峻的挑战。此外,测试的记忆干扰任务并没有减少受访者对之前给出的答案的回忆或记忆效应。
{"title":"Memory Effects in Repeated Survey Questions: Reviving the Empirical Investigation of the Independent Measurements Assumption","authors":"Hannah Schwarz, M. Revilla, Wiebke Weber","doi":"10.18148/SRM/2020.V14I3.7579","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I3.7579","url":null,"abstract":"It is common to repeat survey questions in the social sciences, for example to estimate test-retest reliability or in pretest-posttest experimental designs. An underlying assumption is that the repetition of questions leads to independent measurements. Critics point to respondents’ memory as a source of bias for the resulting estimates. Yet there is little empirical evidence showing how large memory effects are within the same survey and none showing whether memory effects can be decreased through purposeful intervention during a survey. We aim to address both of these points based on data from a lab-based web survey containing an experiment. We repeated one of the initial questions at the end of the survey (on average 127 questions later) and asked respondents if they recall their previous answer and to reproduce it. Furthermore, we compared respondents’ memory of previously given responses between two experimental groups: A control group, where regular survey questions were asked in between repetitions and a treatment group which, additionally, received a memory interference task aimed at decreasing memory. We found that, after an average 20-minute interval, 60% of the respondents were able to correctly reproduce their previous answer, of which we estimated 17% to do so due to memory. We did not observe a decrease in memory as time intervals between repetitions become longer. This indicates a serious challenge to using repeated questions within the same survey. Moreover, the tested memory interference task did not reduce respondents’ recall of their previously given answer or the memory effect.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"325-344"},"PeriodicalIF":4.8,"publicationDate":"2020-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41990406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
The More Similar, the Better? 越相似越好?
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-07-10 DOI: 10.18148/SRM/2020.V14I3.7621
F. Bittmann
Previous research shows that sociodemographic (mis)matches between respondents and interviewers can affect unit and item nonresponse in survey situations. The current paper attempts to deepen the understanding of these findings and investigates the effect of matching with regard to gender and age on item nonresponse, reluctance to answer items and the probability that a third person is interfering with the interview. Using multilevel European Social Survey data from 23 countries, it is demonstrated that some constellations of matching improve data quality significantly. The results corroborate and extend previous findings and underline that sociodemographic matching has the potential to enhance data quality in face to face situations.
先前的研究表明,受访者和访谈者之间的社会人口统计匹配会影响调查情境中单位和项目的无反应。本文试图加深对这些发现的理解,并调查性别和年龄匹配对项目无反应、不愿回答项目以及第三人干扰面试的可能性的影响。使用来自23个国家的多层次欧洲社会调查数据表明,一些匹配星座显著提高了数据质量。研究结果证实并扩展了先前的研究结果,并强调社会人口统计匹配有可能在面对面的情况下提高数据质量。
{"title":"The More Similar, the Better?","authors":"F. Bittmann","doi":"10.18148/SRM/2020.V14I3.7621","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I3.7621","url":null,"abstract":"Previous research shows that sociodemographic (mis)matches between respondents and interviewers can affect unit and item nonresponse in survey situations. The current paper attempts to deepen the understanding of these findings and investigates the effect of matching with regard to gender and age on item nonresponse, reluctance to answer items and the probability that a third person is interfering with the interview. Using multilevel European Social Survey data from 23 countries, it is demonstrated that some constellations of matching improve data quality significantly. The results corroborate and extend previous findings and underline that sociodemographic matching has the potential to enhance data quality in face to face situations.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"301-323"},"PeriodicalIF":4.8,"publicationDate":"2020-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45370009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Response Patterns in a Multi-day Diary Survey: Implications for Adaptive Survey Design 多日日记调查中的反应模式:对适应性调查设计的启示
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-07-10 DOI: 10.18148/SRM/2020.V14I3.7465
Mengyao Hu, Edmundo Roberto Melipillán, B. West, John A. Kirlin, Ilse Paniagua
In multi-day diary surveys, respondents make participation decisions every day. Some respondents remain committed throughout, whereas others drop out after the first few days or in the later days of the survey, leading to item nonresponse. Such item nonresponse at the day level can introduce nonresponse and underreporting error, reduce statistical power and bias survey estimates. Despite its critical influence on survey data quality, the important issue of day-level item nonresponse in diary surveys has received surprisingly little attention. This study evaluates different response patterns in a seven-day diary survey and considers how these patterns might inform adaptive designs for future diary surveys. We analyzed data from the U.S. National Household Food Acquisition and Purchase Survey (FoodAPS), a nationally representative survey designed to collect comprehensive data on household food purchases and acquisitions during one-week time periods. In total, there were 4,826 households with 14,317 individuals that responded to the survey. To evaluate how response patterns differed across respondents and across the diary period, we employed a latent class growth analysis (LCGA), which enables the identification of different groups of respondents based on their reporting patterns. Our analysis identified five classes of respondents, ranging from highly-motivated respondents to those exhibiting minimal effort. We also compared the identified classes in terms of covariate profiles and distributions on key FoodAPS outcomes. Respondents who showed low-motivated response patterns were found to record fewer events in the diary for the key variables. To inform adaptive designs in future diary data collections, we examined respondent characteristics that were known before the diary portion of the survey and significantly associated with class membership. Several respondent characteristics (e.g., low education) and paradata features (e.g., longer initial interviews) were linked with the probability of having low-motivation response patterns. Our findings have implications for future designs of multi-day diary surveys.
在多日日记调查中,受访者每天都要做出参与决策。一些受访者在整个过程中保持忠诚,而另一些人在调查的前几天或后几天退出,导致项目无回应。这种日水平的项目无反应会导致无反应和少报错误,降低统计效力和调查估计的偏差。尽管它对调查数据质量有重要影响,但日记调查中日水平项目无反应的重要问题却很少受到关注。本研究评估了7天日记调查中的不同反应模式,并考虑了这些模式如何为未来日记调查的适应性设计提供信息。我们分析了来自美国全国家庭食品采购调查(FoodAPS)的数据,这是一项具有全国代表性的调查,旨在收集一周时间内家庭食品采购和采购的综合数据。共有4826户家庭和14317人参与了调查。为了评估不同受访者和日记期间的反应模式差异,我们采用了潜在类别增长分析(LCGA),该分析能够根据受访者的报告模式识别不同的受访者群体。我们的分析确定了五类受访者,从高度积极的受访者到表现出最小努力的受访者。我们还比较了已确定的类别的协变量概况和主要FoodAPS结果的分布。研究发现,表现出低动机反应模式的受访者在日记中记录的关键变量事件较少。为了在未来的日记数据收集中为适应性设计提供信息,我们检查了在调查日记部分之前已知的、与班级成员显著相关的受访者特征。一些被调查者特征(例如,低教育程度)和悖论特征(例如,较长的初次访谈)与低动机反应模式的可能性有关。我们的发现对未来多日日记调查的设计具有启示意义。
{"title":"Response Patterns in a Multi-day Diary Survey: Implications for Adaptive Survey Design","authors":"Mengyao Hu, Edmundo Roberto Melipillán, B. West, John A. Kirlin, Ilse Paniagua","doi":"10.18148/SRM/2020.V14I3.7465","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I3.7465","url":null,"abstract":"In multi-day diary surveys, respondents make participation decisions every day. Some respondents remain committed throughout, whereas others drop out after the first few days or in the later days of the survey, leading to item nonresponse. Such item nonresponse at the day level can introduce nonresponse and underreporting error, reduce statistical power and bias survey estimates. Despite its critical influence on survey data quality, the important issue of day-level item nonresponse in diary surveys has received surprisingly little attention. This study evaluates different response patterns in a seven-day diary survey and considers how these patterns might inform adaptive designs for future diary surveys. We analyzed data from the U.S. National Household Food Acquisition and Purchase Survey (FoodAPS), a nationally representative survey designed to collect comprehensive data on household food purchases and acquisitions during one-week time periods. In total, there were 4,826 households with 14,317 individuals that responded to the survey. To evaluate how response patterns differed across respondents and across the diary period, we employed a latent class growth analysis (LCGA), which enables the identification of different groups of respondents based on their reporting patterns. Our analysis identified five classes of respondents, ranging from highly-motivated respondents to those exhibiting minimal effort. We also compared the identified classes in terms of covariate profiles and distributions on key FoodAPS outcomes. Respondents who showed low-motivated response patterns were found to record fewer events in the diary for the key variables. To inform adaptive designs in future diary data collections, we examined respondent characteristics that were known before the diary portion of the survey and significantly associated with class membership. Several respondent characteristics (e.g., low education) and paradata features (e.g., longer initial interviews) were linked with the probability of having low-motivation response patterns. Our findings have implications for future designs of multi-day diary surveys.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"289-300"},"PeriodicalIF":4.8,"publicationDate":"2020-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41933852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Survey Research Methods during the COVID-19 Crisis COVID-19危机期间的调查研究方法
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-06-04 DOI: 10.18148/SRM/2020.V14I2.7769
U. Kohler
Good things take time—this saying is certainly a firm part of the scientific belief system. Scientists prefer valid and reliable evidence to rapid results, and they are therefore open to running additional checks to rule out yet another artifact hypothesis, and patiently bear the challenges of lengthy reviewing processes. It is our implicit understanding that all this serves well in the joint effort of scientists to approximate the truth, at least in the long run. In these rapidly changing times, our belief system is challenged. The COVID-19 crisis created an enormous demand for rapid research results—and rightly so. Policymakers have every reason to demand scientific evidence to make informed decisions. What else should they be asking for? Journalists also have every reason to demand scientific evidence in order to efficiently evaluate and report on policymakers’decisions. And last but not least, everyday people also have every reason to insist that the harsh restrictions of their personal freedoms are at least this: evidence based. In the current situation the demand for scientific evidence is targeted predominantly at medical and epidemiological research—again with good reasons, since we are confronted with a pandemic disease. However, it is our firm conviction that survey research can and should contribute to scientific discovery in the realm of the COVID-19 crisis. Most obviously, because epidemiologists use survey research methods to estimate SARS-CoV-2 prevalence and incidence. But there are other reasons, as well. The various non-pharmacological interventions (NPIs) such as stay-home or shelter-in-place orders, rules for social distancing etc.that restrict people’s everyday lives not only affect their behavior, but also their attitudes and values. The way people react to the NPIs affect the NPI’s probability of success, and their effects on the economy and society as a whole. There are an enormous number of research questions currently being
好事需要时间——这句话无疑是科学信仰体系中坚定的一部分。科学家们更喜欢有效可靠的证据,而不是快速的结果,因此他们愿意进行额外的检查,以排除另一个人工假设,并耐心地承受漫长审查过程的挑战。这是我们隐含的理解,所有这些都很好地服务于科学家的共同努力,至少从长远来看是接近真理的。在这个瞬息万变的时代,我们的信仰体系受到了挑战。COVID-19危机对快速研究成果产生了巨大需求,这是理所当然的。决策者完全有理由要求科学证据来做出明智的决定。他们还应该要求什么?记者也完全有理由要求科学证据,以便有效地评估和报道决策者的决定。最后但并非最不重要的是,普通人也有充分的理由坚持认为,对他们个人自由的严厉限制至少是基于证据的。在目前情况下,对科学证据的需求主要针对医学和流行病学研究——同样有充分的理由,因为我们面临的是一种大流行疾病。然而,我们坚信,调查研究能够而且应该为COVID-19危机领域的科学发现做出贡献。最明显的是,因为流行病学家使用调查研究方法来估计SARS-CoV-2的患病率和发病率。但也有其他原因。限制人们日常生活的各种非药物干预措施(npi),如呆在家里或原地避难令、社交距离规则等,不仅影响他们的行为,还影响他们的态度和价值观。人们对NPI的反应方式影响着NPI的成功概率,以及它们对整个经济和社会的影响。目前有大量的研究问题
{"title":"Survey Research Methods during the COVID-19 Crisis","authors":"U. Kohler","doi":"10.18148/SRM/2020.V14I2.7769","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I2.7769","url":null,"abstract":"Good things take time—this saying is certainly a firm part of the scientific belief system. Scientists prefer valid and reliable evidence to rapid results, and they are therefore open to running additional checks to rule out yet another artifact hypothesis, and patiently bear the challenges of lengthy reviewing processes. It is our implicit understanding that all this serves well in the joint effort of scientists to approximate the truth, at least in the long run. In these rapidly changing times, our belief system is challenged. The COVID-19 crisis created an enormous demand for rapid research results—and rightly so. Policymakers have every reason to demand scientific evidence to make informed decisions. What else should they be asking for? Journalists also have every reason to demand scientific evidence in order to efficiently evaluate and report on policymakers’decisions. And last but not least, everyday people also have every reason to insist that the harsh restrictions of their personal freedoms are at least this: evidence based. In the current situation the demand for scientific evidence is targeted predominantly at medical and epidemiological research—again with good reasons, since we are confronted with a pandemic disease. However, it is our firm conviction that survey research can and should contribute to scientific discovery in the realm of the COVID-19 crisis. Most obviously, because epidemiologists use survey research methods to estimate SARS-CoV-2 prevalence and incidence. But there are other reasons, as well. The various non-pharmacological interventions (NPIs) such as stay-home or shelter-in-place orders, rules for social distancing etc.that restrict people’s everyday lives not only affect their behavior, but also their attitudes and values. The way people react to the NPIs affect the NPI’s probability of success, and their effects on the economy and society as a whole. There are an enormous number of research questions currently being","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"93-94"},"PeriodicalIF":4.8,"publicationDate":"2020-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45556071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Effects of the COVID-19 crisis on survey fieldwork: Experience and lessons from two major supplements to the U.S. Panel Study of Income Dynamics. COVID-19 危机对实地调查工作的影响:美国收入动态面板研究》的两个主要补充项目的经验和教训。
IF 4.8 2区 社会学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2020-06-04 DOI: 10.18148/srm/2020.v14i2.7752
Narayan Sastry, Katherine McGonagle, Paula Fomby

Two major supplements to the Panel Study of Income Dynamics (PSID) were in the field during the COVID-19 outbreak in the United States: the 2019 waves of the PSID Child Development Supplement (CDS-19) and the PSID Transition into Adulthood Supplement (TAS-19). Both CDS-19 and TAS-19 abruptly terminated all face-to-face fieldwork and, for TAS-19, shifted interviewers from working in a centralized call center to working from their homes. Overall, COVID-19 had a net negative effect on response rates in CDS-19 and terminated all home visits that represented an important study component. For TAS-19, the overall effect of Covid-19 was uncertain, but negative. The costs were high of adapting to COVID-19 and providing paid time-off benefits to staff affected by the pandemic. Longitudinal surveys, such as CDS, TAS, and PSID, that span the pandemic will provide valuable information on its life course and intergenerational consequences, making ongoing data collection of vital importance.

在美国爆发 COVID-19 期间,收入动态面板研究(PSID)的两个主要补充项目都在实地进行:2019 年的 PSID 儿童发展补充项目(CDS-19)和 PSID 成年过渡期补充项目(TAS-19)。CDS-19和TAS-19都突然终止了所有面对面的实地调查,对于TAS-19,访问员从在集中的呼叫中心工作转为在家中工作。总体而言,COVID-19 对 CDS-19 的应答率产生了净负面影响,并终止了所有家访,而家访是研究的重要组成部分。对 TAS-19 而言,Covid-19 的总体影响并不确定,但却是负面的。适应 COVID-19 和为受大流行病影响的员工提供带薪休假福利的成本很高。纵向调查,如 CDS、TAS 和 PSID,将提供有关大流行病生命过程和代际后果的宝贵信息,因此持续的数据收集至关重要。
{"title":"Effects of the COVID-19 crisis on survey fieldwork: Experience and lessons from two major supplements to the U.S. Panel Study of Income Dynamics.","authors":"Narayan Sastry, Katherine McGonagle, Paula Fomby","doi":"10.18148/srm/2020.v14i2.7752","DOIUrl":"10.18148/srm/2020.v14i2.7752","url":null,"abstract":"<p><p>Two major supplements to the Panel Study of Income Dynamics (PSID) were in the field during the COVID-19 outbreak in the United States: the 2019 waves of the PSID Child Development Supplement (CDS-19) and the PSID Transition into Adulthood Supplement (TAS-19). Both CDS-19 and TAS-19 abruptly terminated all face-to-face fieldwork and, for TAS-19, shifted interviewers from working in a centralized call center to working from their homes. Overall, COVID-19 had a net negative effect on response rates in CDS-19 and terminated all home visits that represented an important study component. For TAS-19, the overall effect of Covid-19 was uncertain, but negative. The costs were high of adapting to COVID-19 and providing paid time-off benefits to staff affected by the pandemic. Longitudinal surveys, such as CDS, TAS, and PSID, that span the pandemic will provide valuable information on its life course and intergenerational consequences, making ongoing data collection of vital importance.</p>","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 2","pages":"241-245"},"PeriodicalIF":4.8,"publicationDate":"2020-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8168972/pdf/nihms-1633552.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38987301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
期刊
Survey Research Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1