首页 > 最新文献

Field Methods最新文献

英文 中文
Comparing Readability Measures and Computer‐assisted Question Evaluation Tools for Self‐administered Survey Questions 自我管理调查问题的可读性测量和计算机辅助问题评估工具的比较
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-10-14 DOI: 10.1177/1525822x221124469
Rachel Stenger, Kristen Olson, Jolene D Smyth
Questionnaire designers use readability measures to ensure that questions can be understood by the target population. The most common measure is the Flesch-Kincaid Grade level, but other formulas exist. This article compares six different readability measures across 150 questions in a self-administered questionnaire, finding notable variation in calculated readability across measures. Some question formats, including those that are part of a battery, require important decisions that have large effects on the estimated readability of survey items. Other question evaluation tools, such as the Question Understanding Aid (QUAID) and the Survey Quality Predictor (SQP), may identify similar problems in questions, making readability measures less useful. We find little overlap between QUAID, SQP, and the readability measures, and little differentiation in the tools’ prediction of item nonresponse rates. Questionnaire designers are encouraged to use multiple question evaluation tools and develop readability measures specifically for survey questions.
问卷设计者使用可读性措施来确保问题能够被目标人群理解。最常见的衡量标准是Flesch-Kincaid等级,但也存在其他公式。本文在一份自填问卷中对150个问题的六种不同可读性指标进行了比较,发现不同指标的计算可读性存在显著差异。一些问题格式,包括那些属于一组的格式,需要做出对调查项目的估计可读性有很大影响的重要决定。其他问题评估工具,如问题理解辅助工具(QUAID)和调查质量预测工具(SQP),可能会发现问题中的类似问题,从而降低可读性度量的用处。我们发现QUAID、SQP和可读性度量之间几乎没有重叠,工具对项目无应答率的预测也几乎没有差异。鼓励问卷设计者使用多个问题评估工具,并专门针对调查问题制定可读性措施。
{"title":"Comparing Readability Measures and Computer‐assisted Question Evaluation Tools for Self‐administered Survey Questions","authors":"Rachel Stenger, Kristen Olson, Jolene D Smyth","doi":"10.1177/1525822x221124469","DOIUrl":"https://doi.org/10.1177/1525822x221124469","url":null,"abstract":"Questionnaire designers use readability measures to ensure that questions can be understood by the target population. The most common measure is the Flesch-Kincaid Grade level, but other formulas exist. This article compares six different readability measures across 150 questions in a self-administered questionnaire, finding notable variation in calculated readability across measures. Some question formats, including those that are part of a battery, require important decisions that have large effects on the estimated readability of survey items. Other question evaluation tools, such as the Question Understanding Aid (QUAID) and the Survey Quality Predictor (SQP), may identify similar problems in questions, making readability measures less useful. We find little overlap between QUAID, SQP, and the readability measures, and little differentiation in the tools’ prediction of item nonresponse rates. Questionnaire designers are encouraged to use multiple question evaluation tools and develop readability measures specifically for survey questions.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2022-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42385232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Can Recall Data Be Trusted? Evaluating Reliability of Interview Data on Traditional Multilingualism in Highland Daghestan 召回数据是否可信?达赫斯坦高原传统多语采访数据的可靠性评价
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-10-01 DOI: 10.1177/1525822X221115844
Michael Daniel, Alexey Koshevoy, I. Schurov, N. Dobrushina
In this article, we address the issue of reliability of quantitative data on multilingualism of the past obtained as recall data. More specifically, we investigate whether the interviewees’ assessments of the language repertoires of their late relatives (indirect data) provide results that are quantitatively similar to those obtained from the people of the same age range themselves (direct data). The empirical data we use come from an ongoing field study of traditional multilingualism in Daghestan (Russia). We trained machine learning models to see whether they can detect differences in indirect and direct data. We conclude that our indirect quantitative data on L2 other than Russian are essentially similar to direct data, while there may be a small but systematic underestimation when reporting others’ knowledge of Russian.
在这篇文章中,我们讨论了作为回忆数据获得的过去使用多种语言的定量数据的可靠性问题。更具体地说,我们调查了受访者对其已故亲属语言库的评估(间接数据)是否提供了与同年龄段的人自己获得的结果(直接数据)在数量上相似的结果。我们使用的实证数据来自于正在进行的对达赫斯坦(俄罗斯)传统多语制的实地研究。我们训练了机器学习模型,看看它们是否能够检测间接数据和直接数据的差异。我们得出的结论是,我们关于除俄语以外的第二语言的间接定量数据与直接数据基本相似,而在报告他人对俄语的了解时,可能存在小规模但系统性的低估。
{"title":"Can Recall Data Be Trusted? Evaluating Reliability of Interview Data on Traditional Multilingualism in Highland Daghestan","authors":"Michael Daniel, Alexey Koshevoy, I. Schurov, N. Dobrushina","doi":"10.1177/1525822X221115844","DOIUrl":"https://doi.org/10.1177/1525822X221115844","url":null,"abstract":"In this article, we address the issue of reliability of quantitative data on multilingualism of the past obtained as recall data. More specifically, we investigate whether the interviewees’ assessments of the language repertoires of their late relatives (indirect data) provide results that are quantitatively similar to those obtained from the people of the same age range themselves (direct data). The empirical data we use come from an ongoing field study of traditional multilingualism in Daghestan (Russia). We trained machine learning models to see whether they can detect differences in indirect and direct data. We conclude that our indirect quantitative data on L2 other than Russian are essentially similar to direct data, while there may be a small but systematic underestimation when reporting others’ knowledge of Russian.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"288 - 302"},"PeriodicalIF":1.7,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48799728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The Issue of Noncompliance in Attention Check Questions: False Positives in Instructed Response Items 注意检查问题的不服从问题:指示反应项目的误报
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-09-30 DOI: 10.1177/1525822X221115830
Henning Silber, Joss Roßmann, Tobias Gummer
Attention checks detect inattentiveness by instructing respondents to perform a specific task. However, while respondents may correctly process the task, they may choose to not comply with the instructions. We investigated the issue of noncompliance in attention checks in two web surveys. In Study 1, we measured respondents’ attitudes toward attention checks and their self-reported compliance. In Study 2, we experimentally varied the reasons given to respondents for conducting the attention check. Our results showed that while most respondents understand why attention checks are conducted, a nonnegligible proportion of respondents evaluated them as controlling or annoying. Most respondents passed the attention check; however, among those who failed the test, 61% seem to have failed the task deliberately. These findings reinforce that noncompliance is a serious concern with attention check instruments. The results of our experiment showed that more respondents passed the attention check if a comprehensible reason was given.
注意力检查通过指示受访者执行特定任务来检测注意力不集中。然而,尽管受访者可以正确处理任务,但他们可能会选择不遵守指示。我们在两次网络调查中调查了注意力检查中的违规问题。在研究1中,我们测量了受访者对注意力检查的态度以及他们自我报告的依从性。在研究2中,我们通过实验改变了受访者进行注意力检查的原因。我们的研究结果表明,虽然大多数受访者理解为什么要进行注意力检查,但不可忽略的比例的受访者认为他们控制欲强或令人讨厌。大多数受访者通过了注意力检查;然而,在那些没有通过测试的人中,61%的人似乎是故意不及格的。这些发现强化了不遵守是注意力检查工具的一个严重问题。我们的实验结果表明,如果给出了一个可以理解的原因,更多的受访者通过了注意力检查。
{"title":"The Issue of Noncompliance in Attention Check Questions: False Positives in Instructed Response Items","authors":"Henning Silber, Joss Roßmann, Tobias Gummer","doi":"10.1177/1525822X221115830","DOIUrl":"https://doi.org/10.1177/1525822X221115830","url":null,"abstract":"Attention checks detect inattentiveness by instructing respondents to perform a specific task. However, while respondents may correctly process the task, they may choose to not comply with the instructions. We investigated the issue of noncompliance in attention checks in two web surveys. In Study 1, we measured respondents’ attitudes toward attention checks and their self-reported compliance. In Study 2, we experimentally varied the reasons given to respondents for conducting the attention check. Our results showed that while most respondents understand why attention checks are conducted, a nonnegligible proportion of respondents evaluated them as controlling or annoying. Most respondents passed the attention check; however, among those who failed the test, 61% seem to have failed the task deliberately. These findings reinforce that noncompliance is a serious concern with attention check instruments. The results of our experiment showed that more respondents passed the attention check if a comprehensible reason was given.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"346 - 360"},"PeriodicalIF":1.7,"publicationDate":"2022-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47430637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A Comparison of Three Designs for List-style Open-ended Questions in Web Surveys 三种网络调查问卷开放式问题设计的比较
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-09-29 DOI: 10.1177/1525822X221115831
Tanja Kunz, Katharina Meitinger
Although list-style open-ended questions generally help us gain deeper insights into respondents’ thoughts, opinions, and behaviors, the quality of responses is often compromised. We tested a dynamic and a follow-up design to motivate respondents to give higher quality responses than with a static design, but without overburdening them. Our results showed that a follow-up design achieved longer responses with more themes and theme areas than a static design. In contrast, the dynamic design produced the shortest answers with the fewest themes and theme areas. No differences in item nonresponse and only minor differences in additional response burden were found among the three list-style designs. Our study shows that design features and timing are crucial to clarify the desired response format and motivate respondents to give high-quality answers to list-style open-ended questions.
虽然列表式开放式问题通常有助于我们更深入地了解受访者的想法、观点和行为,但回答的质量往往会受到影响。我们测试了动态设计和后续设计,以激励受访者给出比静态设计更高质量的回答,但不会给他们带来过重的负担。我们的研究结果表明,与静态设计相比,后续设计在更多主题和主题区域上获得了更长时间的回应。相比之下,动态设计产生的答案最短,主题和主题区域最少。三种表式设计在项目无反应上无差异,在附加反应负担上差异较小。我们的研究表明,设计特征和时间对于明确期望的回答格式和激励受访者对列表式开放式问题给出高质量的答案至关重要。
{"title":"A Comparison of Three Designs for List-style Open-ended Questions in Web Surveys","authors":"Tanja Kunz, Katharina Meitinger","doi":"10.1177/1525822X221115831","DOIUrl":"https://doi.org/10.1177/1525822X221115831","url":null,"abstract":"Although list-style open-ended questions generally help us gain deeper insights into respondents’ thoughts, opinions, and behaviors, the quality of responses is often compromised. We tested a dynamic and a follow-up design to motivate respondents to give higher quality responses than with a static design, but without overburdening them. Our results showed that a follow-up design achieved longer responses with more themes and theme areas than a static design. In contrast, the dynamic design produced the shortest answers with the fewest themes and theme areas. No differences in item nonresponse and only minor differences in additional response burden were found among the three list-style designs. Our study shows that design features and timing are crucial to clarify the desired response format and motivate respondents to give high-quality answers to list-style open-ended questions.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"303 - 317"},"PeriodicalIF":1.7,"publicationDate":"2022-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41497024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Conditional Pop-up Reminders Reduce Incidence of Rounding in Web Surveys 有条件的弹出提醒减少了网络调查中舍入的发生率
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-09-29 DOI: 10.1177/1525822X221115829
Rainer Schnell, Sarah Redlich, A. Göritz
Frequency of behaviors or amounts of variables of interest are essential topics in many surveys. The use of heuristics might cause rounded answers, resulting in the increased occurrence of end-digits (called heaping or digit-preference). For web surveys (or CASI), we propose using a conditional prompt as input validation if digits indicating heaping are entered. We report an experiment, where respondents in an online access panel (n = 2,590) were randomly assigned to one of three groups: (1) no input validation; (2) conditional input validation if rounding was presumed; and (3) input validation every time a numerical value was entered. Conditional input validation reduces heaping for variables with high proportions of heaped values. Unconditional input validation seems to be less effective.
行为的频率或感兴趣的变量的数量是许多调查中的重要主题。启发式的使用可能会导致四舍五入的答案,导致末尾数字的出现增加(称为堆积或数字偏好)。对于网络调查(或CASI),如果输入了表示堆积的数字,我们建议使用条件提示作为输入验证。我们报告了一项实验,在线访问面板中的受访者(n=2590)被随机分配到三组中的一组:(1)无输入验证;(2) 假设四舍五入的条件输入验证;以及(3)每次输入数值时的输入验证。条件输入验证减少了具有高比例堆积值的变量的堆积。无条件输入验证似乎效果较差。
{"title":"Conditional Pop-up Reminders Reduce Incidence of Rounding in Web Surveys","authors":"Rainer Schnell, Sarah Redlich, A. Göritz","doi":"10.1177/1525822X221115829","DOIUrl":"https://doi.org/10.1177/1525822X221115829","url":null,"abstract":"Frequency of behaviors or amounts of variables of interest are essential topics in many surveys. The use of heuristics might cause rounded answers, resulting in the increased occurrence of end-digits (called heaping or digit-preference). For web surveys (or CASI), we propose using a conditional prompt as input validation if digits indicating heaping are entered. We report an experiment, where respondents in an online access panel (n = 2,590) were randomly assigned to one of three groups: (1) no input validation; (2) conditional input validation if rounding was presumed; and (3) input validation every time a numerical value was entered. Conditional input validation reduces heaping for variables with high proportions of heaped values. Unconditional input validation seems to be less effective.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"334 - 345"},"PeriodicalIF":1.7,"publicationDate":"2022-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48387016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Critical Approach to Interviewing Academic Elites: Access, Trust, and Power 采访学术精英的关键方法:接触、信任和权力
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-09-27 DOI: 10.1177/1525822X221114226
Yali Liu, L. Buckingham
To date, research on elite interviews has primarily focused on political or business settings in European and Anglo-American contexts. In this study, we examine the procedures involved in conducting elite interviews in academic settings, drawing on fieldwork with 53 senior scholars at 10 universities across five regions of northern China. We provide a detailed, critically reflective account of strategies to gain access, develop trust, and manage the power imbalance. Our account reveals the importance of the researcher’s professional identity in gaining participants’ trust and determining adequate forms of reciprocity.
迄今为止,关于精英面试的研究主要集中在欧洲和英美背景下的政治或商业环境。在本研究中,我们考察了在学术环境中进行精英访谈所涉及的程序,借鉴了对中国北方五个地区10所大学的53名高级学者的实地调查。我们提供了一个详细的,批判性反思的策略,以获得访问,建立信任,并管理权力不平衡。我们的描述揭示了研究人员的职业身份在获得参与者信任和确定适当形式的互惠方面的重要性。
{"title":"A Critical Approach to Interviewing Academic Elites: Access, Trust, and Power","authors":"Yali Liu, L. Buckingham","doi":"10.1177/1525822X221114226","DOIUrl":"https://doi.org/10.1177/1525822X221114226","url":null,"abstract":"To date, research on elite interviews has primarily focused on political or business settings in European and Anglo-American contexts. In this study, we examine the procedures involved in conducting elite interviews in academic settings, drawing on fieldwork with 53 senior scholars at 10 universities across five regions of northern China. We provide a detailed, critically reflective account of strategies to gain access, develop trust, and manage the power imbalance. Our account reveals the importance of the researcher’s professional identity in gaining participants’ trust and determining adequate forms of reciprocity.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"236 - 252"},"PeriodicalIF":1.7,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43521189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries 细节决定成败:一项随机实验,评估在各国调查问题中提供例子的效果
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-09-16 DOI: 10.1177/1525822X221115506
E. Aizpurua, Gianmaria Bottoni, R. Fitzgerald
Despite the widespread use of examples in survey questions, very few studies have examined their impact on survey responses, and the evidence is mainly based on data collected in the United States using questionnaires in English. This study builds on previous research by examining the effects of providing examples using data from a cross-national probability-based web panel implemented in Estonia (n = 730), Great Britain (n = 685), and Slovenia (n = 529) during Round 8 of the European Social Survey (2017/18). Respondents were randomly assigned a survey question measuring confidence in social media using Facebook and Twitter as examples, or another condition in which no examples were offered. The results show that confidence in social media was significantly lower in the example condition, although the effect size was small. Confidence in social media varied across countries, and the effect of providing examples was heterogeneous across countries and education levels. The implications of these findings are discussed.
尽管在调查问题中广泛使用了例子,但很少有研究考察它们对调查结果的影响,证据主要基于在美国使用英语问卷收集的数据。这项研究建立在先前研究的基础上,通过使用爱沙尼亚(n=730)、英国(n=685)和斯洛文尼亚(n=529)在欧洲社会调查第8轮(2017/18)期间实施的基于跨国家概率的网络小组的数据来检验提供示例的效果。受访者被随机分配了一个调查问题,以脸书和推特为例,或其他没有提供例子的情况下,测量他们对社交媒体的信心。结果表明,在示例条件下,对社交媒体的信心显著降低,尽管影响范围很小。各国对社交媒体的信心各不相同,提供例子的效果因国家和教育水平而异。讨论了这些发现的含义。
{"title":"The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries","authors":"E. Aizpurua, Gianmaria Bottoni, R. Fitzgerald","doi":"10.1177/1525822X221115506","DOIUrl":"https://doi.org/10.1177/1525822X221115506","url":null,"abstract":"Despite the widespread use of examples in survey questions, very few studies have examined their impact on survey responses, and the evidence is mainly based on data collected in the United States using questionnaires in English. This study builds on previous research by examining the effects of providing examples using data from a cross-national probability-based web panel implemented in Estonia (n = 730), Great Britain (n = 685), and Slovenia (n = 529) during Round 8 of the European Social Survey (2017/18). Respondents were randomly assigned a survey question measuring confidence in social media using Facebook and Twitter as examples, or another condition in which no examples were offered. The results show that confidence in social media was significantly lower in the example condition, although the effect size was small. Confidence in social media varied across countries, and the effect of providing examples was heterogeneous across countries and education levels. The implications of these findings are discussed.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"198 - 218"},"PeriodicalIF":1.7,"publicationDate":"2022-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46631737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Sampling Probability Definitions with Predictive Algorithms 用预测算法改进采样概率定义
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-09-15 DOI: 10.1177/1525822X221113181
Matthew Jannetti, A. Carroll-Scott, Erikka Gilliam, Irene E. Headen, Maggie Beverly, F. Lê-Scherban
Place-based initiatives often use resident surveys to inform and evaluate interventions. Sampling based on well-defined sampling frames is important but challenging for initiatives that target subpopulations. Databases that enumerate total population counts can produce overinclusive sampling frames, resulting in costly outreach to ineligible participants. Quantifying eligibility before sampling using machine learning algorithms can improve efficiency and reduce costs. We developed a model to improve sampling for the West Philly Promise Neighborhood’s biennial population-representative survey of households with children within a geographic footprint. This study proposes a method to estimate probability of study eligibility by building a well-calibrated predictive model using existing administrative data sources. Six machine-learning models were evaluated; logistic regression provided the best balance of accuracy and understandable probabilities. This approach can be a blueprint for other population-based studies whose sampling frames cannot be well defined using traditional sources.
基于地点的举措通常使用居民调查来告知和评估干预措施。基于定义明确的采样框架的采样很重要,但对于针对亚群体的举措来说具有挑战性。列举总人口计数的数据库可能会产生过多的抽样框架,导致对不合格参与者的推广成本高昂。使用机器学习算法在采样前量化合格性可以提高效率并降低成本。我们为West Philly Promise Neighborhood两年一次的人口代表性调查开发了一个模型,以改进抽样,该调查针对地理足迹内有孩子的家庭。本研究提出了一种方法,通过使用现有的管理数据源建立一个校准良好的预测模型来估计研究合格的概率。评估了六个机器学习模型;逻辑回归提供了准确性和可理解概率之间的最佳平衡。这种方法可以作为其他基于人群的研究的蓝图,这些研究的采样框架无法使用传统来源很好地定义。
{"title":"Improving Sampling Probability Definitions with Predictive Algorithms","authors":"Matthew Jannetti, A. Carroll-Scott, Erikka Gilliam, Irene E. Headen, Maggie Beverly, F. Lê-Scherban","doi":"10.1177/1525822X221113181","DOIUrl":"https://doi.org/10.1177/1525822X221113181","url":null,"abstract":"Place-based initiatives often use resident surveys to inform and evaluate interventions. Sampling based on well-defined sampling frames is important but challenging for initiatives that target subpopulations. Databases that enumerate total population counts can produce overinclusive sampling frames, resulting in costly outreach to ineligible participants. Quantifying eligibility before sampling using machine learning algorithms can improve efficiency and reduce costs. We developed a model to improve sampling for the West Philly Promise Neighborhood’s biennial population-representative survey of households with children within a geographic footprint. This study proposes a method to estimate probability of study eligibility by building a well-calibrated predictive model using existing administrative data sources. Six machine-learning models were evaluated; logistic regression provided the best balance of accuracy and understandable probabilities. This approach can be a blueprint for other population-based studies whose sampling frames cannot be well defined using traditional sources.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"137 - 152"},"PeriodicalIF":1.7,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47100891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Effects of Question Characteristics on Item Nonresponse in Telephone and Web Survey Modes 电话和网络调查模式中问题特征对项目无应答的影响
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-08-28 DOI: 10.1177/1525822X221115838
O. Lipps, Gian-Andrea Monsch
Telephone surveys face more and more criticism because of decreasing coverage and increasing costs, and the risk of producing socially desirable answers. Consequently, survey administrators consider switching their surveys to the web mode, although the web mode is more susceptible to item nonresponse. Still, we do not know whether this is true for all question types. In this article, we analyze to what extent item nonresponse depends on question characteristics such as their form or difficulty in the telephone and the web mode. We use data from an experiment in which individuals randomly sampled from a population register are experimentally assigned to these two modes. Distinguishing effects on the frequency of don’t know responses, item refusals, and mid-scale responding, we find more don’t know responses and item refusals for the web mode generally, but no differences for mid-scale responding. However, this relationship depends on the characteristics of the question.
电话调查面临越来越多的批评,因为覆盖面减少,成本增加,以及产生社会期望的答案的风险。因此,调查管理员考虑将他们的调查转换为网络模式,尽管网络模式更容易受到项目无反应的影响。然而,我们不知道这是否适用于所有类型的问题。本文分析了在电话和网络模式下,问题的形式或难度等问题特征在多大程度上决定了问题的不回答。我们使用的数据来自一项实验,在该实验中,从人口登记册中随机抽取的个体被实验地分配到这两种模式。对不知道反应、项目拒绝和中等规模反应频率的区分效应,我们发现一般在网络模式下,不知道反应和项目拒绝的频率更高,而在中等规模的反应中没有差异。然而,这种关系取决于问题的特点。
{"title":"Effects of Question Characteristics on Item Nonresponse in Telephone and Web Survey Modes","authors":"O. Lipps, Gian-Andrea Monsch","doi":"10.1177/1525822X221115838","DOIUrl":"https://doi.org/10.1177/1525822X221115838","url":null,"abstract":"Telephone surveys face more and more criticism because of decreasing coverage and increasing costs, and the risk of producing socially desirable answers. Consequently, survey administrators consider switching their surveys to the web mode, although the web mode is more susceptible to item nonresponse. Still, we do not know whether this is true for all question types. In this article, we analyze to what extent item nonresponse depends on question characteristics such as their form or difficulty in the telephone and the web mode. We use data from an experiment in which individuals randomly sampled from a population register are experimentally assigned to these two modes. Distinguishing effects on the frequency of don’t know responses, item refusals, and mid-scale responding, we find more don’t know responses and item refusals for the web mode generally, but no differences for mid-scale responding. However, this relationship depends on the characteristics of the question.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"318 - 333"},"PeriodicalIF":1.7,"publicationDate":"2022-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42100080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Ethnographic Methods for Identifying Cultural Concepts of Distress: Developing Reliable and Valid Measures 识别遇险文化概念的民族志方法:制定可靠有效的措施
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2022-08-04 DOI: 10.1177/1525822X221113178
Jeffrey G. Snodgrass, A. Brewis, H. Dengah, W. Dressler, B. Kaiser, B. Kohrt, Emily Mendenhall, Seth Sagstetter, L. Weaver, K. X. Zhao
We review ethnographic methods that allow researchers to assess distress in a culturally sensitive manner. We begin with an overview of standardized biomedical and psychological approaches to assessing distress cross-culturally. We then focus on literature describing the development of reliable and valid culturally sensitive assessment tools that can serve as complements or alternatives to biomedical categories and diagnostic frameworks. The methods we describe are useful in identifying forms of suffering—expressed in culturally salient idioms of distress—that might be misidentified by biomedical classifications. We highlight the utility of a cognitive anthropological theoretical approach for developing measures that attend to local cultural categories of knowledge and experience. Attending to cultural insider perspectives is necessary because expressions of distress, thresholds of tolerance for distress, expectations about stress inherent in life, conceptions of the good life, symptom expression, and modes of help-seeking vary across cultures.
我们回顾了民族志方法,使研究人员能够以文化敏感的方式评估痛苦。我们首先概述了跨文化评估痛苦的标准化生物医学和心理学方法。然后,我们重点关注描述可靠有效的文化敏感评估工具开发的文献,这些工具可以作为生物医学类别和诊断框架的补充或替代品。我们描述的方法有助于识别痛苦的形式——用文化上显著的痛苦习语来表达——这些痛苦可能会被生物医学分类错误识别。我们强调了认知人类学理论方法在制定关注当地文化知识和经验类别的措施方面的效用。关注文化内部视角是必要的,因为不同文化对痛苦的表达、对痛苦的容忍阈值、对生活中固有压力的期望、美好生活的概念、症状表达和寻求帮助的模式各不相同。
{"title":"Ethnographic Methods for Identifying Cultural Concepts of Distress: Developing Reliable and Valid Measures","authors":"Jeffrey G. Snodgrass, A. Brewis, H. Dengah, W. Dressler, B. Kaiser, B. Kohrt, Emily Mendenhall, Seth Sagstetter, L. Weaver, K. X. Zhao","doi":"10.1177/1525822X221113178","DOIUrl":"https://doi.org/10.1177/1525822X221113178","url":null,"abstract":"We review ethnographic methods that allow researchers to assess distress in a culturally sensitive manner. We begin with an overview of standardized biomedical and psychological approaches to assessing distress cross-culturally. We then focus on literature describing the development of reliable and valid culturally sensitive assessment tools that can serve as complements or alternatives to biomedical categories and diagnostic frameworks. The methods we describe are useful in identifying forms of suffering—expressed in culturally salient idioms of distress—that might be misidentified by biomedical classifications. We highlight the utility of a cognitive anthropological theoretical approach for developing measures that attend to local cultural categories of knowledge and experience. Attending to cultural insider perspectives is necessary because expressions of distress, thresholds of tolerance for distress, expectations about stress inherent in life, conceptions of the good life, symptom expression, and modes of help-seeking vary across cultures.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"175 - 197"},"PeriodicalIF":1.7,"publicationDate":"2022-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45451889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Field Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1