Pub Date : 2022-02-23DOI: 10.1177/1525822X211070463
Iván Sarmiento, A. Cockcroft, Anna Dion, Sergio Paredes-Solís, Abraham de Jesús-García, David Melendez, Anne Marie Chomat, G. Zuluaga, Alba Meneses-Rentería, N. Andersson
A recurring issue in intercultural research is whose knowledge informs conceptualization and design of projects or interventions. Fuzzy cognitive mapping uses arrows and weights to represent stakeholder knowledge on causal relationships and can generate composite theories to inform research and action. Cognitive mapping is accessible across different cultures, but participant weighting is not always straightforward. We describe a procedure to combine and condense maps from different stakeholders and an alternative operator-independent weighting procedure adapted from Harris’s discourse analysis.
{"title":"Combining Conceptual Frameworks on Maternal Health in Indigenous Communities—Fuzzy Cognitive Mapping Using Participant and Operator-independent Weighting","authors":"Iván Sarmiento, A. Cockcroft, Anna Dion, Sergio Paredes-Solís, Abraham de Jesús-García, David Melendez, Anne Marie Chomat, G. Zuluaga, Alba Meneses-Rentería, N. Andersson","doi":"10.1177/1525822X211070463","DOIUrl":"https://doi.org/10.1177/1525822X211070463","url":null,"abstract":"A recurring issue in intercultural research is whose knowledge informs conceptualization and design of projects or interventions. Fuzzy cognitive mapping uses arrows and weights to represent stakeholder knowledge on causal relationships and can generate composite theories to inform research and action. Cognitive mapping is accessible across different cultures, but participant weighting is not always straightforward. We describe a procedure to combine and condense maps from different stakeholders and an alternative operator-independent weighting procedure adapted from Harris’s discourse analysis.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43018276","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-17DOI: 10.1177/1525822X211072358
Hanyu Sun, Andrew Caporaso, D. Cantor, Terisa Davis, Kelly Blake
Previous survey research has found that prompt interventions for speeding and straightlining were effective at reducing these undesirable response behaviors in web surveys. However, the effects of prompt interventions on data quality measures are mixed, and it is unclear how prompt interventions affect key survey estimates. We conducted an experiment on prompt interventions using the National Cancer Institute’s 2019 Health Information National Trends Survey Push-to-Web Pilot Study. We used two types of prompts, one targeted speeding and the other targeted straightlining. We found no significant differences between the prompt and no-prompt conditions in overall web response rates. Also, we found that web respondents assigned to the prompt condition spent more time on the survey, had a lower percent of straightlining, and a lower percent of speeding on grid questions. Regarding key survey estimates, there were significant differences on estimates for one out of 40 items tested.
{"title":"The Effects of Prompt Interventions on Web Survey Response Rate and Data Quality Measures","authors":"Hanyu Sun, Andrew Caporaso, D. Cantor, Terisa Davis, Kelly Blake","doi":"10.1177/1525822X211072358","DOIUrl":"https://doi.org/10.1177/1525822X211072358","url":null,"abstract":"Previous survey research has found that prompt interventions for speeding and straightlining were effective at reducing these undesirable response behaviors in web surveys. However, the effects of prompt interventions on data quality measures are mixed, and it is unclear how prompt interventions affect key survey estimates. We conducted an experiment on prompt interventions using the National Cancer Institute’s 2019 Health Information National Trends Survey Push-to-Web Pilot Study. We used two types of prompts, one targeted speeding and the other targeted straightlining. We found no significant differences between the prompt and no-prompt conditions in overall web response rates. Also, we found that web respondents assigned to the prompt condition spent more time on the survey, had a lower percent of straightlining, and a lower percent of speeding on grid questions. Regarding key survey estimates, there were significant differences on estimates for one out of 40 items tested.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43308648","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-15DOI: 10.1177/1525822X221074769
Max Izenberg, Ryan C. Brown, Cora Siebert, Ron Heinz, Aida Rahmattalabi, P. Vayanos
In the small town of Sitka, Alaska, frequent and often catastrophic landslides threaten residents. One challenge associated with disaster preparedness is access to timely and reliable risk information. As with many small but diverse towns, who or what is a trustworthy source of information is often contested. To help improve landslide communication in Sitka, we used a community-partnered approach to social network analysis to identify (1) potential key actors for landslide risk communication and (2) structural holes that may inhibit efficient and equitable communication. This short take describes how we built trust and developed adaptive data collection methods to build an approach that was acceptable and actionable for Sitka, Alaska. This approach could be useful to other researchers for conducting social network analysis to improve risk communication, particularly in rural and remote contexts.
{"title":"A Community-partnered Approach to Social Network Data Collection for a Large and Partial Network","authors":"Max Izenberg, Ryan C. Brown, Cora Siebert, Ron Heinz, Aida Rahmattalabi, P. Vayanos","doi":"10.1177/1525822X221074769","DOIUrl":"https://doi.org/10.1177/1525822X221074769","url":null,"abstract":"In the small town of Sitka, Alaska, frequent and often catastrophic landslides threaten residents. One challenge associated with disaster preparedness is access to timely and reliable risk information. As with many small but diverse towns, who or what is a trustworthy source of information is often contested. To help improve landslide communication in Sitka, we used a community-partnered approach to social network analysis to identify (1) potential key actors for landslide risk communication and (2) structural holes that may inhibit efficient and equitable communication. This short take describes how we built trust and developed adaptive data collection methods to build an approach that was acceptable and actionable for Sitka, Alaska. This approach could be useful to other researchers for conducting social network analysis to improve risk communication, particularly in rural and remote contexts.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45085818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-15DOI: 10.1177/1525822X221076986
Barbara Quimby, Melissa Beresford
Participatory modeling (PM) is an engaged research methodology for creating analog or computer-based models of complex systems, such as socio–environmental systems. Used across a range of fields, PM centers stakeholder knowledge and participation to create more internally valid models that can inform policy and increase engagement and trust between communities and research teams. The PM process also presents opportunities for knowledge co-production and eliciting cross-sectional and longitudinal data on stakeholders’ worldviews and knowledge, risk assessment, decision-making, and social learning. We present an overview of the stages for PM and how it can be used for community-based, stakeholder-engaged social science research.
{"title":"Participatory Modeling: A Methodology for Engaging Stakeholder Knowledge and Participation in Social Science Research","authors":"Barbara Quimby, Melissa Beresford","doi":"10.1177/1525822X221076986","DOIUrl":"https://doi.org/10.1177/1525822X221076986","url":null,"abstract":"Participatory modeling (PM) is an engaged research methodology for creating analog or computer-based models of complex systems, such as socio–environmental systems. Used across a range of fields, PM centers stakeholder knowledge and participation to create more internally valid models that can inform policy and increase engagement and trust between communities and research teams. The PM process also presents opportunities for knowledge co-production and eliciting cross-sectional and longitudinal data on stakeholders’ worldviews and knowledge, risk assessment, decision-making, and social learning. We present an overview of the stages for PM and how it can be used for community-based, stakeholder-engaged social science research.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42094665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-13DOI: 10.1177/1525822X221074764
Taylor Lewis, Joseph McMichael
Expected yield rates are essential to a survey’s data collection plan, as they inform requisite sample sizes to meet the survey’s objectives. Given an overall expected yield rate for a self-administered mail survey, this short take describes a simple method for using the Census Planning Database to assign differential yield rates to lower-level geographies within the study area.
{"title":"Using the Census Planning Database to Generate Differential Expected Yield Rates to Self-administered Mail Surveys","authors":"Taylor Lewis, Joseph McMichael","doi":"10.1177/1525822X221074764","DOIUrl":"https://doi.org/10.1177/1525822X221074764","url":null,"abstract":"Expected yield rates are essential to a survey’s data collection plan, as they inform requisite sample sizes to meet the survey’s objectives. Given an overall expected yield rate for a self-administered mail survey, this short take describes a simple method for using the Census Planning Database to assign differential yield rates to lower-level geographies within the study area.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43858600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-01DOI: 10.1177/1525822X221075305
Brooke Foucault Welles, Hanyu Sun, P. Miller
We examine relationships between interviewers’ nonverbal behaviors and adequate responding in face-to-face survey interviews. We videotaped professional interviewers administering face-to-face survey interviews and coded them for three interviewer nonverbal behaviors: smiling, nodding, and direct gaze. These nonverbal interviewer behaviors were associated with significant increases in the frequency of respondents’ adequate responses. Moreover, the nonverbal behaviors were equally likely to present in standardized and unstandardized utterances. These results suggest that interviewers’ nonverbal behaviors positively correlate with adequate responding without deviating from standardized interview protocols. We discuss implications for survey theory and interviewer training.
{"title":"Nonverbal Behavior in Face-to-face Survey Interviews: An Analysis of Interviewer Behavior and Adequate Responding","authors":"Brooke Foucault Welles, Hanyu Sun, P. Miller","doi":"10.1177/1525822X221075305","DOIUrl":"https://doi.org/10.1177/1525822X221075305","url":null,"abstract":"We examine relationships between interviewers’ nonverbal behaviors and adequate responding in face-to-face survey interviews. We videotaped professional interviewers administering face-to-face survey interviews and coded them for three interviewer nonverbal behaviors: smiling, nodding, and direct gaze. These nonverbal interviewer behaviors were associated with significant increases in the frequency of respondents’ adequate responses. Moreover, the nonverbal behaviors were equally likely to present in standardized and unstandardized utterances. These results suggest that interviewers’ nonverbal behaviors positively correlate with adequate responding without deviating from standardized interview protocols. We discuss implications for survey theory and interviewer training.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47535158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-01DOI: 10.1177/1525822X211069657
Katie Meehan, Lourdes Ginart, K. J. Ormerod
This article presents design principles and practical steps for web-based Q methodology surveys. Drawing on the experience of two online Q studies, we discuss theoretical concerns, sort and survey design, software programs, and issues in researcher–participant engagement. We argue that opening Q methodology to online modes of data collection is important to capture greater diversity in social perspectives and geographies.
{"title":"Short Take: Sorting at a Distance: Q Methodology Online","authors":"Katie Meehan, Lourdes Ginart, K. J. Ormerod","doi":"10.1177/1525822X211069657","DOIUrl":"https://doi.org/10.1177/1525822X211069657","url":null,"abstract":"This article presents design principles and practical steps for web-based Q methodology surveys. Drawing on the experience of two online Q studies, we discuss theoretical concerns, sort and survey design, software programs, and issues in researcher–participant engagement. We argue that opening Q methodology to online modes of data collection is important to capture greater diversity in social perspectives and geographies.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47013942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-01DOI: 10.1177/1525822X221077393
A. Stone, M. Walentynowicz, Stefan Schneider, Doerte U. Junghaenel, J. Broderick, Angus Deaton
To ensure the accuracy of self-reported data, it is important to reduce potential sources of bias such as the unwanted influence of prior questions on subsequent questions, the so-called item context effect. This article attempts to replicate the finding that evaluative subjective well-being was affected by a preceding item, a question about the political atmosphere in the country; it also examines manipulations that could mitigate the impact of the context-inducing item on well-being. Study 1 used a sample of 4,500 participants recruited from Amazon’s Mechanical Turk; it examined the effect of three manipulations based on adding buffer questions or adding text to reorient participants’ attention. A context effect was found, and one manipulation mitigated the context effect. Study 2 used a nationally representative sample (n = 906); it only replicated the context effect. These results reaffirm the importance of carefully considering item context effects in survey research.
{"title":"Item Context Effects Are Relevant for Monitoring Evaluative Well-being: Replication of Previous Work and Mitigation","authors":"A. Stone, M. Walentynowicz, Stefan Schneider, Doerte U. Junghaenel, J. Broderick, Angus Deaton","doi":"10.1177/1525822X221077393","DOIUrl":"https://doi.org/10.1177/1525822X221077393","url":null,"abstract":"To ensure the accuracy of self-reported data, it is important to reduce potential sources of bias such as the unwanted influence of prior questions on subsequent questions, the so-called item context effect. This article attempts to replicate the finding that evaluative subjective well-being was affected by a preceding item, a question about the political atmosphere in the country; it also examines manipulations that could mitigate the impact of the context-inducing item on well-being. Study 1 used a sample of 4,500 participants recruited from Amazon’s Mechanical Turk; it examined the effect of three manipulations based on adding buffer questions or adding text to reorient participants’ attention. A context effect was found, and one manipulation mitigated the context effect. Study 2 used a nationally representative sample (n = 906); it only replicated the context effect. These results reaffirm the importance of carefully considering item context effects in survey research.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46914053","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-04DOI: 10.1177/1525822X211051574
K. Adebayo, E. Njoku
How does shared identity between researcher and the researched influence trust-building for data generation and knowledge production? We reflect on this question based on two separate studies conducted by African-based researchers in sociology and political science in Nigeria. We advanced two interrelated positions. The first underscores the limits of national belonging as shorthand for insiderness, while the second argues that when shared national/group identity is tensioned other intersecting positions and relations take prominence. We also show that the researched challenge and resist unequal power relations through interview refusal or by evading issues that the researcher considers important, but the participant perceives as intrusive. We shed light on the vagaries, overlaps, and similarities in the dynamics of belonging and positionality in researching Africans in and outside Africa as home-based researchers. Our contribution advances the understanding of field dynamics in the production of local and cross-border knowledge on Africa/Africans.
{"title":"Local and Transnational Identity, Positionality and Knowledge Production in Africa and the African Diaspora","authors":"K. Adebayo, E. Njoku","doi":"10.1177/1525822X211051574","DOIUrl":"https://doi.org/10.1177/1525822X211051574","url":null,"abstract":"How does shared identity between researcher and the researched influence trust-building for data generation and knowledge production? We reflect on this question based on two separate studies conducted by African-based researchers in sociology and political science in Nigeria. We advanced two interrelated positions. The first underscores the limits of national belonging as shorthand for insiderness, while the second argues that when shared national/group identity is tensioned other intersecting positions and relations take prominence. We also show that the researched challenge and resist unequal power relations through interview refusal or by evading issues that the researcher considers important, but the participant perceives as intrusive. We shed light on the vagaries, overlaps, and similarities in the dynamics of belonging and positionality in researching Africans in and outside Africa as home-based researchers. Our contribution advances the understanding of field dynamics in the production of local and cross-border knowledge on Africa/Africans.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47083529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-03DOI: 10.1177/1525822X211069640
P. Brenner, T. Buskirk
We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive types (prepaid cash, prepaid giftcodes, and conditional giftcodes). Invitations were sent to a sample of 17,808 addresses in Boston, Massachusetts, recruiting for a new online panel study of city residents. We report response rates and costs for each condition. Findings suggest that letters achieve higher response rates than postcards and are more cost effective overall. We also find that conditional incentives achieve higher response rates and are more cost effective, although conflating factors do not permit clear inferences. Notably, the novel scratch-off postcard condition achieved the lowest response rate and the highest costs per completed survey.
{"title":"Scratch the Scratch-off: Testing Prepaid and Conditional Incentives with Postcard and Letter Invitations in a Web-push Design with an Address-based Sample","authors":"P. Brenner, T. Buskirk","doi":"10.1177/1525822X211069640","DOIUrl":"https://doi.org/10.1177/1525822X211069640","url":null,"abstract":"We tested a novel extension to mailed invitations to a web-push survey, using a postcard invitation to deliver a scratch-off giftcode incentive similar to an instant-win lottery ticket. Scratch-off postcards were included as one of five conditions in randomized survey experiment varying two mailing types (letter and postcard) and three incentive types (prepaid cash, prepaid giftcodes, and conditional giftcodes). Invitations were sent to a sample of 17,808 addresses in Boston, Massachusetts, recruiting for a new online panel study of city residents. We report response rates and costs for each condition. Findings suggest that letters achieve higher response rates than postcards and are more cost effective overall. We also find that conditional incentives achieve higher response rates and are more cost effective, although conflating factors do not permit clear inferences. Notably, the novel scratch-off postcard condition achieved the lowest response rate and the highest costs per completed survey.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42879676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}