首页 > 最新文献

Journal of Official Statistics最新文献

英文 中文
A Multivariate Regression Estimator of Levels and Change for Surveys Over Time 调查水平和随时间变化的多元回归估计
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2023-03-01 DOI: 10.2478/jos-2023-0002
Anne Konrad, Y. Berger
Abstract Rotations are often used for panel surveys, where the observations remain in the sample for a predefined number of periods and then rotate out. The information of previous waves can be exploited to improve current estimates. We propose a multivariate regression estimator which captures all information available from both waves. By adding additional auxiliary variables describing the information of the rotational design, the proposed estimator captures the sample correlation between waves. It can be used for the estimation of levels and changes.
摘要旋转通常用于面板调查,在面板调查中,观察结果在样本中保留预定义的时间段,然后旋转出去。可以利用先前波的信息来改进当前的估计。我们提出了一种多元回归估计器,它可以捕获来自两个波的所有可用信息。通过添加描述旋转设计信息的附加辅助变量,所提出的估计器捕获了波之间的样本相关性。它可以用于估计水平和变化。
{"title":"A Multivariate Regression Estimator of Levels and Change for Surveys Over Time","authors":"Anne Konrad, Y. Berger","doi":"10.2478/jos-2023-0002","DOIUrl":"https://doi.org/10.2478/jos-2023-0002","url":null,"abstract":"Abstract Rotations are often used for panel surveys, where the observations remain in the sample for a predefined number of periods and then rotate out. The information of previous waves can be exploited to improve current estimates. We propose a multivariate regression estimator which captures all information available from both waves. By adding additional auxiliary variables describing the information of the rotational design, the proposed estimator captures the sample correlation between waves. It can be used for the estimation of levels and changes.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41860741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Characteristics of Respondents to Web-Based or Traditional Interviews in Mixed-Mode Surveys. Evidence from the Italian Permanent Population Census 混合模式调查中基于网络或传统访谈的受访者特征。意大利常住人口普查的证据
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2023-03-01 DOI: 10.2478/jos-2023-0001
E. Grimaccia, A. Naccarato, G. Gallo, Novella Cecconi, Alessandro Fratoni
Abstract In order to provide useful tools for researchers in the design of actions to promote participation in web surveys, it is key to study the characteristics that define the profile of a “web respondent”, so that specific interventions can be planned. In this contribution, which draws on data collected during the 2019 housing population census in Italy, we define the set of familial and geographical characteristics that correspond to a greater probability that the interviewed household will choose to respond online, by estimating a multilevel model. The profile of a “computer-assisted web interview household” (CAWI-H) is then defined, on the basis of the structural characteristics of this population. Moreover, the geographical distribution of households is studied according to their distance from the CAWI-H profile. The results show that households that are more distant from the CAWI-H profile have characteristics that correspond to segments of the population generally affected by economic and social fragility; they are mainly elderly, foreigners, residents in small towns, and people with a low level of education. It is to these households in particular that survey designers can address specific actions that can enhance their willingness to participate in web surveys.
为了给研究者提供有效的工具来设计促进网络调查参与的行动,关键是研究定义“网络受访者”的特征,以便计划具体的干预措施。在这篇论文中,我们利用了意大利2019年住房人口普查期间收集的数据,通过估计多层模型,我们定义了一组家庭和地理特征,这些特征对应于被采访家庭选择在线回应的更大概率。然后根据该人口的结构特征定义“计算机辅助网络访谈家庭”(CAWI-H)的概况。此外,根据家庭与CAWI-H曲线的距离,研究了家庭的地理分布。结果表明,离CAWI-H曲线越远的家庭,其特征与普遍受经济和社会脆弱性影响的人群相对应;他们主要是老年人、外国人、小城镇居民和受教育程度较低的人。正是针对这些家庭,调查设计者可以提出具体的行动,提高他们参与网络调查的意愿。
{"title":"Characteristics of Respondents to Web-Based or Traditional Interviews in Mixed-Mode Surveys. Evidence from the Italian Permanent Population Census","authors":"E. Grimaccia, A. Naccarato, G. Gallo, Novella Cecconi, Alessandro Fratoni","doi":"10.2478/jos-2023-0001","DOIUrl":"https://doi.org/10.2478/jos-2023-0001","url":null,"abstract":"Abstract In order to provide useful tools for researchers in the design of actions to promote participation in web surveys, it is key to study the characteristics that define the profile of a “web respondent”, so that specific interventions can be planned. In this contribution, which draws on data collected during the 2019 housing population census in Italy, we define the set of familial and geographical characteristics that correspond to a greater probability that the interviewed household will choose to respond online, by estimating a multilevel model. The profile of a “computer-assisted web interview household” (CAWI-H) is then defined, on the basis of the structural characteristics of this population. Moreover, the geographical distribution of households is studied according to their distance from the CAWI-H profile. The results show that households that are more distant from the CAWI-H profile have characteristics that correspond to segments of the population generally affected by economic and social fragility; they are mainly elderly, foreigners, residents in small towns, and people with a low level of education. It is to these households in particular that survey designers can address specific actions that can enhance their willingness to participate in web surveys.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47611145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Database Reconstruction Is Not So Easy and Is Different from Reidentification 数据库重建不是那么容易,与重新识别不同
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2023-01-24 DOI: 10.48550/arXiv.2301.10213
K. Muralidhar, J. Domingo-Ferrer
Abstract In recent years, it has been claimed that releasing accurate statistical information on a database is likely to allow its complete reconstruction. Differential privacy has been suggested as the appropriate methodology to prevent these attacks. These claims have recently been taken very seriously by the U.S. Census Bureau and led them to adopt differential privacy for releasing U.S. Census data. This in turn has caused consternation among users of the Census data due to the lack of accuracy of the protected outputs. It has also brought legal action against the U.S. Department of Commerce. In this article, we trace the origins of the claim that releasing information on a database automatically makes it vulnerable to being exposed by reconstruction attacks and we show that this claim is, in fact, incorrect. We also show that reconstruction can be averted by properly using traditional statistical disclosure control (SDC) techniques. We further show that the geographic level at which exact counts are released is even more relevant to protection than the actual SDC method employed. Finally, we caution against confusing reconstruction and reidentification: using the quality of reconstruction as a metric of reidentification results in exaggerated reidentification risk figures.
摘要近年来,有人声称,在数据库中发布准确的统计信息可能会使其完全重建。差异隐私被认为是防止这些攻击的适当方法。美国人口普查局最近非常重视这些说法,并在发布美国人口普查数据时采用了差异隐私。由于受保护的输出缺乏准确性,这反过来又引起了人口普查数据用户的恐慌。它还对美国商务部提起了法律诉讼。在这篇文章中,我们追溯了在数据库上自动发布信息会使其容易受到重建攻击的说法的起源,我们证明了这种说法实际上是不正确的。我们还表明,通过正确使用传统的统计披露控制(SDC)技术可以避免重建。我们进一步表明,与实际使用的SDC方法相比,公布确切计数的地理水平与保护更为相关。最后,我们提醒不要混淆重建和重新识别:使用重建质量作为重新识别的衡量标准会导致夸大的重新识别风险数字。
{"title":"Database Reconstruction Is Not So Easy and Is Different from Reidentification","authors":"K. Muralidhar, J. Domingo-Ferrer","doi":"10.48550/arXiv.2301.10213","DOIUrl":"https://doi.org/10.48550/arXiv.2301.10213","url":null,"abstract":"Abstract In recent years, it has been claimed that releasing accurate statistical information on a database is likely to allow its complete reconstruction. Differential privacy has been suggested as the appropriate methodology to prevent these attacks. These claims have recently been taken very seriously by the U.S. Census Bureau and led them to adopt differential privacy for releasing U.S. Census data. This in turn has caused consternation among users of the Census data due to the lack of accuracy of the protected outputs. It has also brought legal action against the U.S. Department of Commerce. In this article, we trace the origins of the claim that releasing information on a database automatically makes it vulnerable to being exposed by reconstruction attacks and we show that this claim is, in fact, incorrect. We also show that reconstruction can be averted by properly using traditional statistical disclosure control (SDC) techniques. We further show that the geographic level at which exact counts are released is even more relevant to protection than the actual SDC method employed. Finally, we caution against confusing reconstruction and reidentification: using the quality of reconstruction as a metric of reidentification results in exaggerated reidentification risk figures.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-01-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44139678","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Index to Volume 38, 2022 Contents of Volume 38, Numbers 1–4 第38卷索引,2022年第38卷内容,第1-4号
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0054
{"title":"Index to Volume 38, 2022 Contents of Volume 38, Numbers 1–4","authors":"","doi":"10.2478/jos-2022-0054","DOIUrl":"https://doi.org/10.2478/jos-2022-0054","url":null,"abstract":"","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47276945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A User-Driven Method for Using Research Products to Empirically Assess Item Importance in National Surveys. 一种用户驱动的方法,用于使用研究产品在全国调查中实证评估项目重要性
IF 0.5 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0052
Ai Rene Ong, Robert Schultz, Sofi Sinozich, Brady T West, James Wagner, Jennifer Sinibaldi, John Finamore

Large-scale, nationally representative surveys serve many vital functions, but these surveys are often long and burdensome for respondents. Cutting survey length can help to reduce respondent burden and may improve data quality but removing items from these surveys is not a trivial matter. We propose a method to empirically assess item importance and associated burden in national surveys and guide this decision-making process using different research products produced from such surveys. This method is demonstrated using the Survey of Doctorate Recipients (SDR), a biennial survey administered to individuals with a Science, Engineering, and Health doctorate. We used three main sources of information on the SDR variables: 1) a bibliography of documents using the SDR data, 2) the SDR website that allows users to download summary data, and 3) web timing paradata and break-off rates. The bibliography was coded for SDR variable usage and citation counts. Putting this information together, we identified 35 unused items (17% of the survey) by any of these sources and found that the most burdensome items are highly important. We conclude with general recommendations for those hoping to employ similar methodologies in the future.

摘要具有全国代表性的大规模调查具有许多重要功能,但这些调查对受访者来说可能是漫长而繁重的。缩短调查长度有助于减轻受访者负担,并可能提高数据质量,但从这些调查中删除项目并非小事。我们提出了一种在国家调查中实证评估项目重要性和相关负担的方法,并使用此类调查产生的不同研究产品来指导这一决策过程。这种方法是通过对博士学位获得者的调查(SDR)来证明的,这是一项针对拥有科学、工程和健康博士学位的个人的两年一次的调查。我们使用了关于SDR变量的三个主要信息来源:使用SDR数据作为项目使用和重要性衡量标准的文件目录,科学家和工程师统计数据系统的SDR数据表下载统计数据作为项目用途的额外衡量标准,以及网络计时paradata和中断率作为负担衡量标准。综合这些信息,我们确定了35个未使用的项目(占调查的17%),并发现最繁重的项目非常重要。最后,我们为那些希望在未来采用类似方法的人提出了一般性建议。
{"title":"A User-Driven Method for Using Research Products to Empirically Assess Item Importance in National Surveys.","authors":"Ai Rene Ong, Robert Schultz, Sofi Sinozich, Brady T West, James Wagner, Jennifer Sinibaldi, John Finamore","doi":"10.2478/jos-2022-0052","DOIUrl":"10.2478/jos-2022-0052","url":null,"abstract":"<p><p>Large-scale, nationally representative surveys serve many vital functions, but these surveys are often long and burdensome for respondents. Cutting survey length can help to reduce respondent burden and may improve data quality but removing items from these surveys is not a trivial matter. We propose a method to empirically assess item importance and associated burden in national surveys and guide this decision-making process using different research products produced from such surveys. This method is demonstrated using the Survey of Doctorate Recipients (SDR), a biennial survey administered to individuals with a Science, Engineering, and Health doctorate. We used three main sources of information on the SDR variables: 1) a bibliography of documents using the SDR data, 2) the SDR website that allows users to download summary data, and 3) web timing paradata and break-off rates. The bibliography was coded for SDR variable usage and citation counts. Putting this information together, we identified 35 unused items (17% of the survey) by any of these sources and found that the most burdensome items are highly important. We conclude with general recommendations for those hoping to employ similar methodologies in the future.</p>","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":0.5,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11293792/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49516661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Relationship Between Past Survey Burden and Response Probability to a New Survey in a Probability-Based Online Panel 在基于概率的在线小组中,过去的调查负担和对新调查的响应概率之间的关系
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0045
Haomiao Jin, A. Kapteyn
Abstract We conducted an idiographic analysis to examine the effect of survey burden, measured by the length of the most recent questionnaire, or number of survey invitations (survey frequency) in a one-year period preceding a new survey, on the response probability to a new survey in a probability-based Internet panel. The individual response process was modeled by a latent Markov chain with questionnaire length and survey frequency as explanatory variables. The individual estimates were obtained using a Monte Carlo based method and then pooled to derive estimates of the overall relationships and to identify specific subgroups whose responses were more likely to be impacted by questionnaire length or survey frequency. The results show an overall positive relationship between questionnaire length and response probability, and no significant relationship between survey frequency and response probability. Further analysis showed that longer questionnaires were more likely to be associated with decreased response rates among racial/ethnic minorities and introverted participants. Frequent surveys were more likely to be associated with decreased response rates among participants with a large household. We discuss the implications for panel management and advocate targeted interventions for the small subgroups whose response probability may be negatively impacted by longer questionnaires or frequent surveys.
摘要我们在一个基于概率的互联网小组中进行了一项具体分析,以检验调查负担对新调查的响应概率的影响,调查负担以最近一次问卷的长度或新调查前一年的调查邀请次数(调查频率)来衡量。以问卷长度和调查频率为解释变量,采用隐马尔可夫链对个体反应过程进行建模。使用基于蒙特卡洛的方法获得个体估计值,然后合并得出总体关系的估计值,并确定其回答更可能受到问卷长度或调查频率影响的特定亚组。结果表明,问卷长度与回答概率总体呈正相关,调查频率与回答概率无显著关系。进一步的分析表明,调查问卷越长,少数种族/族裔和内向参与者的回答率越低。频繁的调查更有可能与大家庭参与者的回复率下降有关。我们讨论了对小组管理的影响,并主张对那些回答概率可能受到更长问卷或频繁调查负面影响的小组进行有针对性的干预。
{"title":"Relationship Between Past Survey Burden and Response Probability to a New Survey in a Probability-Based Online Panel","authors":"Haomiao Jin, A. Kapteyn","doi":"10.2478/jos-2022-0045","DOIUrl":"https://doi.org/10.2478/jos-2022-0045","url":null,"abstract":"Abstract We conducted an idiographic analysis to examine the effect of survey burden, measured by the length of the most recent questionnaire, or number of survey invitations (survey frequency) in a one-year period preceding a new survey, on the response probability to a new survey in a probability-based Internet panel. The individual response process was modeled by a latent Markov chain with questionnaire length and survey frequency as explanatory variables. The individual estimates were obtained using a Monte Carlo based method and then pooled to derive estimates of the overall relationships and to identify specific subgroups whose responses were more likely to be impacted by questionnaire length or survey frequency. The results show an overall positive relationship between questionnaire length and response probability, and no significant relationship between survey frequency and response probability. Further analysis showed that longer questionnaires were more likely to be associated with decreased response rates among racial/ethnic minorities and introverted participants. Frequent surveys were more likely to be associated with decreased response rates among participants with a large household. We discuss the implications for panel management and advocate targeted interventions for the small subgroups whose response probability may be negatively impacted by longer questionnaires or frequent surveys.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47094506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Your Best Estimate is Fine. Or is It? 您的最佳估价很好。还是它?
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0047
Jerry Timbrook, Kristen Olson, Jolene D Smyth
Abstract Providing an exact answer to open-ended numeric questions can be a burdensome task for respondents. Researchers often assume that adding an invitation to estimate (e.g., “Your best estimate is fine”) to these questions reduces cognitive burden, and in turn, reduces rates of undesirable response behaviors like item nonresponse, nonsubstantive answers, and answers that must be processed into a final response (e.g., qualified answers like “about 12” and ranges). Yet there is little research investigating this claim. Additionally, explicitly inviting estimation may lead respondents to round their answers, which may affect survey estimates. In this study, we investigate the effect of adding an invitation to estimate to 22 open-ended numeric questions in a mail survey and three questions in a separate telephone survey. Generally, we find that explicitly inviting estimation does not significantly change rates of item nonresponse, rounding, or qualified/range answers in either mode, though it does slightly reduce nonsubstantive answers for mail respondents. In the telephone survey, an invitation to estimate results in fewer conversational turns and shorter response times. Our results indicate that an invitation to estimate may simplify the interaction between interviewers and respondents in telephone surveys, and neither hurts nor helps data quality in mail surveys.
摘要为开放式数字问题提供准确答案对受访者来说可能是一项繁重的任务。研究人员通常认为,在这些问题中添加评估邀请(例如,“你的最佳评估很好”)可以减轻认知负担,进而降低不良反应行为的发生率,如项目无反应、非实质性回答以及必须处理成最终回答的答案(例如,合格答案,如“大约12”和范围)。然而,很少有研究对这一说法进行调查。此外,明确邀请评估可能会导致受访者对他们的答案进行四舍五入,这可能会影响调查估计。在这项研究中,我们调查了在邮件调查中向22个开放式数字问题和在单独的电话调查中向3个问题添加评估邀请的影响。一般来说,我们发现,在任何一种模式下,明确邀请估计都不会显著改变项目无回复、四舍五入或合格/范围回答的比率,尽管它确实略微减少了邮件受访者的非实质回答。在电话调查中,邀请对方进行评估会减少谈话次数,缩短回复时间。我们的研究结果表明,邀请评估可以简化电话调查中面试官和受访者之间的互动,既不会损害也不会有助于邮件调查中的数据质量。
{"title":"Your Best Estimate is Fine. Or is It?","authors":"Jerry Timbrook, Kristen Olson, Jolene D Smyth","doi":"10.2478/jos-2022-0047","DOIUrl":"https://doi.org/10.2478/jos-2022-0047","url":null,"abstract":"Abstract Providing an exact answer to open-ended numeric questions can be a burdensome task for respondents. Researchers often assume that adding an invitation to estimate (e.g., “Your best estimate is fine”) to these questions reduces cognitive burden, and in turn, reduces rates of undesirable response behaviors like item nonresponse, nonsubstantive answers, and answers that must be processed into a final response (e.g., qualified answers like “about 12” and ranges). Yet there is little research investigating this claim. Additionally, explicitly inviting estimation may lead respondents to round their answers, which may affect survey estimates. In this study, we investigate the effect of adding an invitation to estimate to 22 open-ended numeric questions in a mail survey and three questions in a separate telephone survey. Generally, we find that explicitly inviting estimation does not significantly change rates of item nonresponse, rounding, or qualified/range answers in either mode, though it does slightly reduce nonsubstantive answers for mail respondents. In the telephone survey, an invitation to estimate results in fewer conversational turns and shorter response times. Our results indicate that an invitation to estimate may simplify the interaction between interviewers and respondents in telephone surveys, and neither hurts nor helps data quality in mail surveys.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44435894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Response Burden and Dropout in a Probability-Based Online Panel Study – A Comparison between an App and Browser-Based Design 基于概率的在线面板研究中的响应负担和辍学率——应用程序和基于浏览器的设计的比较
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0043
C. Roberts, J. Herzing, Marc Asensio Manjon, Philip Abbet, D. Gática-Pérez
Abstract Survey respondents can complete web surveys using different Internet-enabled devices (PCs versus mobile phones and tablets) and using different software (web browser versus a mobile software application, “app”). Previous research has found that completing questionnaires via a browser on mobile devices can lead to higher breakoff rates and reduced measurement quality compared to using PCs, especially where questionnaires have not been adapted for mobile administration. A key explanation is that using a mobile browser is more burdensome and less enjoyable for respondents. There are reasons to assume apps should perform better than browsers, but so far, there have been few attempts to assess this empirically. In this study, we investigate variation in experienced burden across device and software in wave 1 of a three-wave panel study, comparing an app with a browser-based survey, in which sample members were encouraged to use a mobile device. We also assess device/software effects on participation at wave 2. We find that compared to mobile browser respondents, app respondents were less likely to drop out of the study after the first wave and the effect of the device used was mediated by subjective burden experienced during wave 1.
摘要调查受访者可以使用不同的互联网设备(PC与手机和平板电脑)和不同的软件(网络浏览器与移动软件应用程序,“应用程序”)完成网络调查。先前的研究发现,与使用PC相比,通过移动设备上的浏览器完成问卷调查可能会导致更高的中断率和更低的测量质量,尤其是在问卷调查不适用于移动管理的情况下。一个关键的解释是,对受访者来说,使用移动浏览器更麻烦,更不愉快。有理由认为应用程序应该比浏览器表现得更好,但到目前为止,很少有人尝试从经验上评估这一点。在这项研究中,我们调查了三波小组研究的第1波中设备和软件体验负担的变化,将应用程序与基于浏览器的调查进行了比较,在该调查中,鼓励样本成员使用移动设备。我们还评估了设备/软件对第2波参与的影响。我们发现,与移动浏览器受访者相比,应用程序受访者在第一波之后退出研究的可能性较小,并且所使用设备的影响是由第1波期间经历的主观负担介导的。
{"title":"Response Burden and Dropout in a Probability-Based Online Panel Study – A Comparison between an App and Browser-Based Design","authors":"C. Roberts, J. Herzing, Marc Asensio Manjon, Philip Abbet, D. Gática-Pérez","doi":"10.2478/jos-2022-0043","DOIUrl":"https://doi.org/10.2478/jos-2022-0043","url":null,"abstract":"Abstract Survey respondents can complete web surveys using different Internet-enabled devices (PCs versus mobile phones and tablets) and using different software (web browser versus a mobile software application, “app”). Previous research has found that completing questionnaires via a browser on mobile devices can lead to higher breakoff rates and reduced measurement quality compared to using PCs, especially where questionnaires have not been adapted for mobile administration. A key explanation is that using a mobile browser is more burdensome and less enjoyable for respondents. There are reasons to assume apps should perform better than browsers, but so far, there have been few attempts to assess this empirically. In this study, we investigate variation in experienced burden across device and software in wave 1 of a three-wave panel study, comparing an app with a browser-based survey, in which sample members were encouraged to use a mobile device. We also assess device/software effects on participation at wave 2. We find that compared to mobile browser respondents, app respondents were less likely to drop out of the study after the first wave and the effect of the device used was mediated by subjective burden experienced during wave 1.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48128122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analyzing the Association of Objective Burden Measures to Perceived Burden with Regression Trees 用回归树分析客观负担测度与感知负担的相关性
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0048
Daniel K. Yang, Daniell Toth
Abstract Higher levels of perceived burden by respondents can lead to ambiguous responses to a questionnaire, item nonresponse, or refusals to continue participation in the survey which can introduce bias and downgrade the quality of the data. Therefore, it is important to understand what might influence the perception of burden in respondents. In this article, we demonstrate, using U.S. Consumer Expenditure Survey data, how regression tree models can be used to analyze the associations between perceived burden and objective burden measures conditioning on household demographics and other explanatory variables. The structure of the tree models allows these associations to easily be explored. Our analysis shows a relationship between perceived burden and some of the objective measures after conditioning on different demographic and household variables and that these relationships are quite affected by different respondent characteristics and the mode of the survey. Since the tree models were constructed using an algorithm that accounts for the sample design, inferences from the analysis can be made about the population. Therefore, any insights could be used to help guide future decisions about survey design and data collection to help reduce respondent burden.
较高水平的被调查者感知负担可能导致对问卷的模棱两可的回答,项目不回应,或拒绝继续参与调查,这可能会引入偏见并降低数据质量。因此,了解什么可能影响受访者对负担的看法是很重要的。在本文中,我们利用美国消费者支出调查数据,展示了如何使用回归树模型来分析感知负担和客观负担指标之间的关联,这些指标取决于家庭人口统计数据和其他解释变量。树形模型的结构可以很容易地探索这些关联。我们的分析表明,在调整不同的人口和家庭变量后,感知负担与一些客观措施之间存在关系,这些关系受不同的被调查者特征和调查方式的影响很大。由于树形模型是使用一种解释样本设计的算法构建的,因此可以从分析中得出关于总体的推论。因此,任何见解都可以用来帮助指导有关调查设计和数据收集的未来决策,以帮助减轻受访者的负担。
{"title":"Analyzing the Association of Objective Burden Measures to Perceived Burden with Regression Trees","authors":"Daniel K. Yang, Daniell Toth","doi":"10.2478/jos-2022-0048","DOIUrl":"https://doi.org/10.2478/jos-2022-0048","url":null,"abstract":"Abstract Higher levels of perceived burden by respondents can lead to ambiguous responses to a questionnaire, item nonresponse, or refusals to continue participation in the survey which can introduce bias and downgrade the quality of the data. Therefore, it is important to understand what might influence the perception of burden in respondents. In this article, we demonstrate, using U.S. Consumer Expenditure Survey data, how regression tree models can be used to analyze the associations between perceived burden and objective burden measures conditioning on household demographics and other explanatory variables. The structure of the tree models allows these associations to easily be explored. Our analysis shows a relationship between perceived burden and some of the objective measures after conditioning on different demographic and household variables and that these relationships are quite affected by different respondent characteristics and the mode of the survey. Since the tree models were constructed using an algorithm that accounts for the sample design, inferences from the analysis can be made about the population. Therefore, any insights could be used to help guide future decisions about survey design and data collection to help reduce respondent burden.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46378880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring Burden Perceptions of Household Survey Respondents in the American Community Survey 探讨美国社区调查中家庭调查受访者的负担认知
IF 1.1 4区 数学 Q3 Mathematics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0050
J. Holzberg, Jonathan Katz
Abstract Minimizing respondent survey burden may help decrease nonresponse and increase data quality, but the measurement of burden has varied widely. Recent efforts have paid more attention to respondents’ subjective perceptions of burden, measured through the addition of questions to a survey. Despite reliance on these questions as key measures, little qualitative research has been conducted for household surveys. This study used focus groups to examine respondents’ reactions to possible sources of burden in the American Community Survey (ACS) such as survey length, sensitivity, and contact strategy; respondents’ knowledge, attitudes, and beliefs about burden; and overall perceptions of burden. Feedback was used to guide subsequent selection and cognitive testing of questions on subjective perceptions of burden. Generally, respondents did not find the ACS to be burdensome. When deciding whether it was burdensome, respondents thought about the process of responding to the questionnaire, the value of the data, that response is mandatory, and to a lesser extent, the contacts they received, suggesting these constructs are key components of burden in the ACS. There were some differences by response mode and household characteristics. Findings reinforce the importance of conducting qualitative research to ensure questions capture important respondent burden perceptions for a particular survey.
摘要最小化受访者调查负担可能有助于减少无回复并提高数据质量,但负担的衡量标准差异很大。最近的努力更加关注受访者对负担的主观感知,通过在调查中添加问题来衡量。尽管依赖这些问题作为关键衡量标准,但很少对家庭调查进行定性研究。这项研究使用焦点小组来检查受访者对美国社区调查(ACS)中可能的负担来源的反应,如调查长度、敏感性和联系策略;受访者对负担的知识、态度和信念;以及对负担的总体看法。反馈被用于指导随后对主观负担感知问题的选择和认知测试。一般来说,受访者并不认为ACS是一种负担。在决定这是否是负担时,受访者考虑了问卷的回复过程、数据的价值、该回复是强制性的,以及在较小程度上,他们收到的联系,这表明这些结构是ACS负担的关键组成部分。在反应模式和家庭特征方面存在一些差异。调查结果强化了进行定性研究的重要性,以确保问题能够反映特定调查中受访者对负担的重要看法。
{"title":"Exploring Burden Perceptions of Household Survey Respondents in the American Community Survey","authors":"J. Holzberg, Jonathan Katz","doi":"10.2478/jos-2022-0050","DOIUrl":"https://doi.org/10.2478/jos-2022-0050","url":null,"abstract":"Abstract Minimizing respondent survey burden may help decrease nonresponse and increase data quality, but the measurement of burden has varied widely. Recent efforts have paid more attention to respondents’ subjective perceptions of burden, measured through the addition of questions to a survey. Despite reliance on these questions as key measures, little qualitative research has been conducted for household surveys. This study used focus groups to examine respondents’ reactions to possible sources of burden in the American Community Survey (ACS) such as survey length, sensitivity, and contact strategy; respondents’ knowledge, attitudes, and beliefs about burden; and overall perceptions of burden. Feedback was used to guide subsequent selection and cognitive testing of questions on subjective perceptions of burden. Generally, respondents did not find the ACS to be burdensome. When deciding whether it was burdensome, respondents thought about the process of responding to the questionnaire, the value of the data, that response is mandatory, and to a lesser extent, the contacts they received, suggesting these constructs are key components of burden in the ACS. There were some differences by response mode and household characteristics. Findings reinforce the importance of conducting qualitative research to ensure questions capture important respondent burden perceptions for a particular survey.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45299283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Official Statistics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1