Pub Date : 2023-10-19DOI: 10.1177/1525822x231204817
Jannes Jacobsen, Manuel Siegert
This article analyzes whether response patterns in surveys differ between the general population, regular immigrants, and recent refugees. Analyses show that the address quality of refugees contacted in the first wave of a panel study is worse than that of the general population, but of a similar quality to that of other recent immigrants. Once contacted, people in refugee households are more willing than others to participate in the first wave. In subsequent waves, this pattern changes. Address quality remains relatively low, and the motivation to participate deteriorates and is worse in comparison with other populations. However, Cox regression models of individual response behaviour reveal that this is mostly a composition effect. When socio-demographic and interviewer characteristics are taken into account, refugees have a lower risk of attrition than other immigrants, but they have a similar risk as the general population. This article provides important insights for the implementation of research about recent immigrants and refugees into ongoing panel studies.
{"title":"Establishing a Panel Study of Refugees in Germany: First Wave Response and Panel Attrition from a Comparative Perspective","authors":"Jannes Jacobsen, Manuel Siegert","doi":"10.1177/1525822x231204817","DOIUrl":"https://doi.org/10.1177/1525822x231204817","url":null,"abstract":"This article analyzes whether response patterns in surveys differ between the general population, regular immigrants, and recent refugees. Analyses show that the address quality of refugees contacted in the first wave of a panel study is worse than that of the general population, but of a similar quality to that of other recent immigrants. Once contacted, people in refugee households are more willing than others to participate in the first wave. In subsequent waves, this pattern changes. Address quality remains relatively low, and the motivation to participate deteriorates and is worse in comparison with other populations. However, Cox regression models of individual response behaviour reveal that this is mostly a composition effect. When socio-demographic and interviewer characteristics are taken into account, refugees have a lower risk of attrition than other immigrants, but they have a similar risk as the general population. This article provides important insights for the implementation of research about recent immigrants and refugees into ongoing panel studies.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135730383","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-18DOI: 10.1177/1525822x231198989
Anais Roque, Amber Wutich, Alexandra Brewis, Melissa Beresford, Laura Landes, Olga Morales-Pate, Ramon Lucero, Wendy Jepson, Yushiou Tsai, Michael Hanemann
Community-based participant-observation purposefully combines participant-observation and community-based participatory research. While participant-observation is the core method of ethnography and foundational to cultural anthropology, community-based participatory research initially emerged from health and related applied sciences to align researchers’ and communities’ agendas through focused collaboration. Participant-observation and community-based participatory research have different scholarly origins and norms but are united in centering communities’ understandings on their terms. Combining the strengths of both, we provide a step-by-step explanation of community-based participant-observation, with examples from a study of water insecurity in colonias north of the U.S.–Mexico border. Using community-based participant-observation, researchers can facilitate the co-production of knowledge and community benefit by analyzing high-quality data that inform theory building and basic research.
{"title":"Community-based Participant-observation (CBPO): A Participatory Method for Ethnographic Research","authors":"Anais Roque, Amber Wutich, Alexandra Brewis, Melissa Beresford, Laura Landes, Olga Morales-Pate, Ramon Lucero, Wendy Jepson, Yushiou Tsai, Michael Hanemann","doi":"10.1177/1525822x231198989","DOIUrl":"https://doi.org/10.1177/1525822x231198989","url":null,"abstract":"Community-based participant-observation purposefully combines participant-observation and community-based participatory research. While participant-observation is the core method of ethnography and foundational to cultural anthropology, community-based participatory research initially emerged from health and related applied sciences to align researchers’ and communities’ agendas through focused collaboration. Participant-observation and community-based participatory research have different scholarly origins and norms but are united in centering communities’ understandings on their terms. Combining the strengths of both, we provide a step-by-step explanation of community-based participant-observation, with examples from a study of water insecurity in colonias north of the U.S.–Mexico border. Using community-based participant-observation, researchers can facilitate the co-production of knowledge and community benefit by analyzing high-quality data that inform theory building and basic research.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135206502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-15DOI: 10.1177/1525822x231198997
Kaylin R. Clements, Jennifer E. Cross, Christopher McCarty, Jennifer N. Solomon
Social network research often depends on the willingness of respondents to provide personal information about themselves and alters. Survey design strategies that increase willingness to share this information are necessary for social network research to be feasible, especially when name generators are used for sampling because rosters are unavailable. We conducted an experiment in which one group of respondents ( n = 94) received an online survey that included an example network map and the other group ( n = 100) received one that did not. Results show the map did not increase or decrease provision of network contacts nor influence the types of ties reported. Furthermore, respondents were reluctant to provide names and contact information of alters. Our study demonstrates the difficulty of collecting network information without a previously defined roster and an attempt to improve data collection through strategic survey design.
{"title":"Does Providing an Example Social Network Map Increase Referrals or Affect Types of Ties Reported in an Online Survey?","authors":"Kaylin R. Clements, Jennifer E. Cross, Christopher McCarty, Jennifer N. Solomon","doi":"10.1177/1525822x231198997","DOIUrl":"https://doi.org/10.1177/1525822x231198997","url":null,"abstract":"Social network research often depends on the willingness of respondents to provide personal information about themselves and alters. Survey design strategies that increase willingness to share this information are necessary for social network research to be feasible, especially when name generators are used for sampling because rosters are unavailable. We conducted an experiment in which one group of respondents ( n = 94) received an online survey that included an example network map and the other group ( n = 100) received one that did not. Results show the map did not increase or decrease provision of network contacts nor influence the types of ties reported. Furthermore, respondents were reluctant to provide names and contact information of alters. Our study demonstrates the difficulty of collecting network information without a previously defined roster and an attempt to improve data collection through strategic survey design.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135393856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-20DOI: 10.1177/1525822x231195726
Jamelia Harris
Not knowing the population size is a common problem in data-limited contexts. Drawing on work in Sierra Leone, this short take outlines a four-step solution to this problem: (1) estimate the population size using expert interviews; (2) verify estimates using interviews with participants sampled; (3) triangulate using secondary data; and (4) reconfirm using focus group discussions.
{"title":"Estimating the Size of the Target Population in Data Limited Settings","authors":"Jamelia Harris","doi":"10.1177/1525822x231195726","DOIUrl":"https://doi.org/10.1177/1525822x231195726","url":null,"abstract":"Not knowing the population size is a common problem in data-limited contexts. Drawing on work in Sierra Leone, this short take outlines a four-step solution to this problem: (1) estimate the population size using expert interviews; (2) verify estimates using interviews with participants sampled; (3) triangulate using secondary data; and (4) reconfirm using focus group discussions.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2023-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42017159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-17DOI: 10.1177/1525822x231194178
P. Jabkowski, A. Piekut
This study analyzes the consequences of item nonresponse to the question about a household’s total net income in the European Social Survey (2008–2018). We recognize two mechanisms in avoiding answering the income question: task complexity and question sensitivity, and apply multilevel logistic regressions to predict the probability of refusals or “Do not know” across respondents of different income levels. We find that the refusal to answer the income question is the highest for respondents with lower incomes, while the probability of selecting “Do not know” answers or refusal to answer is the same among respondents with higher incomes. The bias resulting from the correlation between response propensities and household income affects the accuracy of estimates for several attitudinal measures when income is included as an explanatory variable. We recommend reducing the risk of bias by limiting the complexity and sensitivity of the income question and accounting for nonresponse bias.
{"title":"Not Random and Not Ignorable. An Examination of Nonresponse to Income Question in the European Social Survey, 2008–2018","authors":"P. Jabkowski, A. Piekut","doi":"10.1177/1525822x231194178","DOIUrl":"https://doi.org/10.1177/1525822x231194178","url":null,"abstract":"This study analyzes the consequences of item nonresponse to the question about a household’s total net income in the European Social Survey (2008–2018). We recognize two mechanisms in avoiding answering the income question: task complexity and question sensitivity, and apply multilevel logistic regressions to predict the probability of refusals or “Do not know” across respondents of different income levels. We find that the refusal to answer the income question is the highest for respondents with lower incomes, while the probability of selecting “Do not know” answers or refusal to answer is the same among respondents with higher incomes. The bias resulting from the correlation between response propensities and household income affects the accuracy of estimates for several attitudinal measures when income is included as an explanatory variable. We recommend reducing the risk of bias by limiting the complexity and sensitivity of the income question and accounting for nonresponse bias.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2023-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48865137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-16DOI: 10.1177/1525822x231195525
P. Premkumar, S. Ganesan, Balaji Pandiyan, Dhivyatharani Krishnamoorthy, G. Kang
Household expenditure data is at the core of efforts to measure living standards, inequality and financial protection against illness. Currently it is mainly derived from recall-based surveys that are time consuming and prone to measurement errors. Diaries are often used as an alternative approach, however this results in fatigue and low compliance. Smartphone- based diaries could overcome many of these challenges, but it is yet unknown how this approach could be used and its relationship with data from the household surveys. This study evaluated a smartphone-based diary application for collecting daily household expenditures and compared data with that of household surveys. Results show that smartphone-based diary applications could be used to optimize or complement the information from conventional survey-based indicators.
{"title":"Smartphone Diary Application in Household Surveys: Integration of High Frequency Temporal Data in Large-scale Data Collection","authors":"P. Premkumar, S. Ganesan, Balaji Pandiyan, Dhivyatharani Krishnamoorthy, G. Kang","doi":"10.1177/1525822x231195525","DOIUrl":"https://doi.org/10.1177/1525822x231195525","url":null,"abstract":"Household expenditure data is at the core of efforts to measure living standards, inequality and financial protection against illness. Currently it is mainly derived from recall-based surveys that are time consuming and prone to measurement errors. Diaries are often used as an alternative approach, however this results in fatigue and low compliance. Smartphone- based diaries could overcome many of these challenges, but it is yet unknown how this approach could be used and its relationship with data from the household surveys. This study evaluated a smartphone-based diary application for collecting daily household expenditures and compared data with that of household surveys. Results show that smartphone-based diary applications could be used to optimize or complement the information from conventional survey-based indicators.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2023-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48645410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-15DOI: 10.1177/1525822x231195521
M. Angrisani, A. Kapteyn, Swaroop Samek
From September 2016 to September 2018, we piloted the collection of financial transaction and account balance data in the Understanding America Study (UAS), a probability-based Internet panel representative of the U.S. adult population. Unlike previous studies relying on electronic transaction information from financial aggregators, which typically contain very little information on consumer characteristics, our data allow us to explore heterogeneity in consumer behavior as driven by demographics, cognitive ability, and financial literacy, among others. In this article, we describe the results of this pilot project, documenting selectivity issues and the major barriers associated with participation in the study. We carry out illustrative exercises to highlight how the combination of surveys and electronic financial records can lead to methodological advances in the measurement of individuals’ spending and saving behavior.
{"title":"Real Time Measurement of Household Financial Electronic Transactions in a Population Representative Panel: A Pilot Study","authors":"M. Angrisani, A. Kapteyn, Swaroop Samek","doi":"10.1177/1525822x231195521","DOIUrl":"https://doi.org/10.1177/1525822x231195521","url":null,"abstract":"From September 2016 to September 2018, we piloted the collection of financial transaction and account balance data in the Understanding America Study (UAS), a probability-based Internet panel representative of the U.S. adult population. Unlike previous studies relying on electronic transaction information from financial aggregators, which typically contain very little information on consumer characteristics, our data allow us to explore heterogeneity in consumer behavior as driven by demographics, cognitive ability, and financial literacy, among others. In this article, we describe the results of this pilot project, documenting selectivity issues and the major barriers associated with participation in the study. We carry out illustrative exercises to highlight how the combination of surveys and electronic financial records can lead to methodological advances in the measurement of individuals’ spending and saving behavior.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2023-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46135903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-09DOI: 10.1177/1525822x231194515
Anthony Distefano, Joshua S. Yang
Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs—such as ethnographic studies—have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and interviews. The three-phase method includes a priori sample size prediction, provisional saturation estimation during data collection, and post hoc confirmation. Post hoc analysis indicated we reached key thresholds of data saturation before ending fieldwork. We achieved 80% saturation at our 69th data collection event (63% of the full sample) and 90% saturation at our 91st data collection event (83% of the full sample). The method is designed to account for on-the-ground realities confronted in contemporary ethnographic research, including time constraints during fieldwork, and can accommodate studies with medium to large scopes, broad foci, heterogeneous populations, and analysis of multiple qualitative data sources.
{"title":"Sample Size and Saturation: A Three-phase Method for Ethnographic Research with Multiple Qualitative Data Sources","authors":"Anthony Distefano, Joshua S. Yang","doi":"10.1177/1525822x231194515","DOIUrl":"https://doi.org/10.1177/1525822x231194515","url":null,"abstract":"Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs—such as ethnographic studies—have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and interviews. The three-phase method includes a priori sample size prediction, provisional saturation estimation during data collection, and post hoc confirmation. Post hoc analysis indicated we reached key thresholds of data saturation before ending fieldwork. We achieved 80% saturation at our 69th data collection event (63% of the full sample) and 90% saturation at our 91st data collection event (83% of the full sample). The method is designed to account for on-the-ground realities confronted in contemporary ethnographic research, including time constraints during fieldwork, and can accommodate studies with medium to large scopes, broad foci, heterogeneous populations, and analysis of multiple qualitative data sources.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2023-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48348844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-16DOI: 10.1177/1525822x231188593
H. Einarsson, A. Cernat, N. Shlomo
The presentation of survey requests represents an easily modifiable feature of survey communications that can in some contexts affect response propensities. Here, we examine how two features: the framing of the participation request (informed by prospect theory) and the inclusion of targeted appeals based on demographic background (age or electoral district), affect participation rates in the 2021 Icelandic National Election Study, a mixed-mode cross-sectional survey. We find that these features generally fail to affect response propensities and sample composition. However, framed requests produced marginally higher response rates for a subset of the sample that was invited to complete the survey online. This suggests that modifying the presentation of the survey request may be less effective in cross-sectional surveys than in longitudinal ones, where more information is available to inform the content of targeted messages.
{"title":"The Effects of Framing the Survey Request and Using Targeted Appeals on Participation in Cross-sectional Surveys","authors":"H. Einarsson, A. Cernat, N. Shlomo","doi":"10.1177/1525822x231188593","DOIUrl":"https://doi.org/10.1177/1525822x231188593","url":null,"abstract":"The presentation of survey requests represents an easily modifiable feature of survey communications that can in some contexts affect response propensities. Here, we examine how two features: the framing of the participation request (informed by prospect theory) and the inclusion of targeted appeals based on demographic background (age or electoral district), affect participation rates in the 2021 Icelandic National Election Study, a mixed-mode cross-sectional survey. We find that these features generally fail to affect response propensities and sample composition. However, framed requests produced marginally higher response rates for a subset of the sample that was invited to complete the survey online. This suggests that modifying the presentation of the survey request may be less effective in cross-sectional surveys than in longitudinal ones, where more information is available to inform the content of targeted messages.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2023-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45783304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-05-30DOI: 10.1177/1525822x231176167
Tamara Holmes
This short take presents the process of a learning circle, underpinned by Dadirri (Ungunmeer-Baumann 1988). This method was used for the purposes of critical reflective practice and data collection activity with non-Indigenous participants. Dadirri is a First Nations (Australian) term for “deep listening.” The learning circle research occurred with social and welfare workers in a regional health service. We found, through privileging Indigenous knowledges in the activity, that this method can enable a generation of learnings and critical reflection and assist workers to apply theory to practice. This method can also be used as a data collection tool to evaluate these aims.
{"title":"Learning Circles, Underpinned by Dadirri","authors":"Tamara Holmes","doi":"10.1177/1525822x231176167","DOIUrl":"https://doi.org/10.1177/1525822x231176167","url":null,"abstract":"This short take presents the process of a learning circle, underpinned by Dadirri (Ungunmeer-Baumann 1988). This method was used for the purposes of critical reflective practice and data collection activity with non-Indigenous participants. Dadirri is a First Nations (Australian) term for “deep listening.” The learning circle research occurred with social and welfare workers in a regional health service. We found, through privileging Indigenous knowledges in the activity, that this method can enable a generation of learnings and critical reflection and assist workers to apply theory to practice. This method can also be used as a data collection tool to evaluate these aims.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135642601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}