Survey Research Methods最新文献

Young adults are generally hard to survey, presenting researchers with numerous difficulties. They are hard to locate and contact due to high mobility. They are hard to persuade and exhibit high levels of resistance to survey participation. As a result, they pose a greater challenge for longitudinal surveys. This paper explores the role of mode of data collection in young adults' decisions to stay in a longitudinal panel. We draw on data from the National Young Adult Health Survey (NYAHS). NYAHS is a longitudinal study (three annual waves and 2 brief between-wave follow-up surveys) of adults aged 18-34 initially recruited in 2019 through RDD sampling of cell phone numbers nationwide. All sampled cell phone numbers were randomly assigned to one of three experimental conditions; the conditions differed in mode of data collection used in subsequent interviews once screened in. In the first condition, young adults continue all rounds of interviews by telephone ("telephone only" condition). The second group of young adults completed one round of interview by web and the rest by telephone ("telephone mostly" condition). The last third was asked to complete three interviews online and two interviews by telephone ("web mostly" condition). We examined the impact of mode switching on young adults' likelihood of participating in later surveys and on nonresponse bias in key survey outcomes. We found that switching young adults from telephone to web had an immediate negative effect on their likelihood of participating in that web survey, but it did not have a continued negative effect. Switching them from web to telephone increased response rates and reduced nonresponse bias. The findings have important practical implications on how to survey young adults.

The U.S. Panel Study of Income Dynamics (PSID) made a planned transition to a web-first mixed-mode data collection design in 2021 (web and computer-assisted telephone interviewing [CATI]), following nearly five decades of collecting data primarily using CATI with professional interviewers. To evaluate potential effects of mode on fieldwork outcomes, two sequential mixed-mode protocols were introduced using an experimental design. One protocol randomized sample families to a "web-first" treatment, which encouraged response through an online interview, followed by an offer of telephone to complete the interview; a second protocol randomized sample families to a "CATI-first" treatment until the last phase of fieldwork when the option to complete a web interview was offered. This paper examines the comparative effects of the two protocols on fieldwork outcomes, including response rates, interviewer contact attempts, fieldwork duration, and cost. Comparisons are also made with fieldwork outcomes and characteristics of non-responding sample members from the prior-wave when a traditional telephone design was used. We found that the web-first design compared to the CATI-first design led to comparably high response rates, and faster interview completion with lower effort and cost. With some notable exceptions, compared to the prior wave, the mixed-mode design reduced effort and had generally similar patterns of non-response among key respondent subgroups. The results provide new empirical evidence on the effects of mixing modes on fieldwork outcomes and costs and contribute to the small body of experimental evidence on the use of mixed-mode designs in household panel studies.