首页 > 最新文献

Journal of Official Statistics最新文献

英文 中文
Index to Volume 38, 2022 Contents of Volume 38, Numbers 1–4 第38卷索引,2022年第38卷内容,第1-4号
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0054
{"title":"Index to Volume 38, 2022 Contents of Volume 38, Numbers 1–4","authors":"","doi":"10.2478/jos-2022-0054","DOIUrl":"https://doi.org/10.2478/jos-2022-0054","url":null,"abstract":"","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47276945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A User-Driven Method for Using Research Products to Empirically Assess Item Importance in National Surveys. 一种用户驱动的方法,用于使用研究产品在全国调查中实证评估项目重要性
IF 0.5 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0052
Ai Rene Ong, Robert Schultz, Sofi Sinozich, Brady T West, James Wagner, Jennifer Sinibaldi, John Finamore

Large-scale, nationally representative surveys serve many vital functions, but these surveys are often long and burdensome for respondents. Cutting survey length can help to reduce respondent burden and may improve data quality but removing items from these surveys is not a trivial matter. We propose a method to empirically assess item importance and associated burden in national surveys and guide this decision-making process using different research products produced from such surveys. This method is demonstrated using the Survey of Doctorate Recipients (SDR), a biennial survey administered to individuals with a Science, Engineering, and Health doctorate. We used three main sources of information on the SDR variables: 1) a bibliography of documents using the SDR data, 2) the SDR website that allows users to download summary data, and 3) web timing paradata and break-off rates. The bibliography was coded for SDR variable usage and citation counts. Putting this information together, we identified 35 unused items (17% of the survey) by any of these sources and found that the most burdensome items are highly important. We conclude with general recommendations for those hoping to employ similar methodologies in the future.

摘要具有全国代表性的大规模调查具有许多重要功能,但这些调查对受访者来说可能是漫长而繁重的。缩短调查长度有助于减轻受访者负担,并可能提高数据质量,但从这些调查中删除项目并非小事。我们提出了一种在国家调查中实证评估项目重要性和相关负担的方法,并使用此类调查产生的不同研究产品来指导这一决策过程。这种方法是通过对博士学位获得者的调查(SDR)来证明的,这是一项针对拥有科学、工程和健康博士学位的个人的两年一次的调查。我们使用了关于SDR变量的三个主要信息来源:使用SDR数据作为项目使用和重要性衡量标准的文件目录,科学家和工程师统计数据系统的SDR数据表下载统计数据作为项目用途的额外衡量标准,以及网络计时paradata和中断率作为负担衡量标准。综合这些信息,我们确定了35个未使用的项目(占调查的17%),并发现最繁重的项目非常重要。最后,我们为那些希望在未来采用类似方法的人提出了一般性建议。
{"title":"A User-Driven Method for Using Research Products to Empirically Assess Item Importance in National Surveys.","authors":"Ai Rene Ong, Robert Schultz, Sofi Sinozich, Brady T West, James Wagner, Jennifer Sinibaldi, John Finamore","doi":"10.2478/jos-2022-0052","DOIUrl":"10.2478/jos-2022-0052","url":null,"abstract":"<p><p>Large-scale, nationally representative surveys serve many vital functions, but these surveys are often long and burdensome for respondents. Cutting survey length can help to reduce respondent burden and may improve data quality but removing items from these surveys is not a trivial matter. We propose a method to empirically assess item importance and associated burden in national surveys and guide this decision-making process using different research products produced from such surveys. This method is demonstrated using the Survey of Doctorate Recipients (SDR), a biennial survey administered to individuals with a Science, Engineering, and Health doctorate. We used three main sources of information on the SDR variables: 1) a bibliography of documents using the SDR data, 2) the SDR website that allows users to download summary data, and 3) web timing paradata and break-off rates. The bibliography was coded for SDR variable usage and citation counts. Putting this information together, we identified 35 unused items (17% of the survey) by any of these sources and found that the most burdensome items are highly important. We conclude with general recommendations for those hoping to employ similar methodologies in the future.</p>","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1235-1251"},"PeriodicalIF":0.5,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11293792/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49516661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Relationship Between Past Survey Burden and Response Probability to a New Survey in a Probability-Based Online Panel 在基于概率的在线小组中,过去的调查负担和对新调查的响应概率之间的关系
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0045
Haomiao Jin, A. Kapteyn
Abstract We conducted an idiographic analysis to examine the effect of survey burden, measured by the length of the most recent questionnaire, or number of survey invitations (survey frequency) in a one-year period preceding a new survey, on the response probability to a new survey in a probability-based Internet panel. The individual response process was modeled by a latent Markov chain with questionnaire length and survey frequency as explanatory variables. The individual estimates were obtained using a Monte Carlo based method and then pooled to derive estimates of the overall relationships and to identify specific subgroups whose responses were more likely to be impacted by questionnaire length or survey frequency. The results show an overall positive relationship between questionnaire length and response probability, and no significant relationship between survey frequency and response probability. Further analysis showed that longer questionnaires were more likely to be associated with decreased response rates among racial/ethnic minorities and introverted participants. Frequent surveys were more likely to be associated with decreased response rates among participants with a large household. We discuss the implications for panel management and advocate targeted interventions for the small subgroups whose response probability may be negatively impacted by longer questionnaires or frequent surveys.
摘要我们在一个基于概率的互联网小组中进行了一项具体分析,以检验调查负担对新调查的响应概率的影响,调查负担以最近一次问卷的长度或新调查前一年的调查邀请次数(调查频率)来衡量。以问卷长度和调查频率为解释变量,采用隐马尔可夫链对个体反应过程进行建模。使用基于蒙特卡洛的方法获得个体估计值,然后合并得出总体关系的估计值,并确定其回答更可能受到问卷长度或调查频率影响的特定亚组。结果表明,问卷长度与回答概率总体呈正相关,调查频率与回答概率无显著关系。进一步的分析表明,调查问卷越长,少数种族/族裔和内向参与者的回答率越低。频繁的调查更有可能与大家庭参与者的回复率下降有关。我们讨论了对小组管理的影响,并主张对那些回答概率可能受到更长问卷或频繁调查负面影响的小组进行有针对性的干预。
{"title":"Relationship Between Past Survey Burden and Response Probability to a New Survey in a Probability-Based Online Panel","authors":"Haomiao Jin, A. Kapteyn","doi":"10.2478/jos-2022-0045","DOIUrl":"https://doi.org/10.2478/jos-2022-0045","url":null,"abstract":"Abstract We conducted an idiographic analysis to examine the effect of survey burden, measured by the length of the most recent questionnaire, or number of survey invitations (survey frequency) in a one-year period preceding a new survey, on the response probability to a new survey in a probability-based Internet panel. The individual response process was modeled by a latent Markov chain with questionnaire length and survey frequency as explanatory variables. The individual estimates were obtained using a Monte Carlo based method and then pooled to derive estimates of the overall relationships and to identify specific subgroups whose responses were more likely to be impacted by questionnaire length or survey frequency. The results show an overall positive relationship between questionnaire length and response probability, and no significant relationship between survey frequency and response probability. Further analysis showed that longer questionnaires were more likely to be associated with decreased response rates among racial/ethnic minorities and introverted participants. Frequent surveys were more likely to be associated with decreased response rates among participants with a large household. We discuss the implications for panel management and advocate targeted interventions for the small subgroups whose response probability may be negatively impacted by longer questionnaires or frequent surveys.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1051 - 1067"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47094506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Your Best Estimate is Fine. Or is It? 您的最佳估价很好。还是它?
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0047
Jerry Timbrook, Kristen Olson, Jolene D Smyth
Abstract Providing an exact answer to open-ended numeric questions can be a burdensome task for respondents. Researchers often assume that adding an invitation to estimate (e.g., “Your best estimate is fine”) to these questions reduces cognitive burden, and in turn, reduces rates of undesirable response behaviors like item nonresponse, nonsubstantive answers, and answers that must be processed into a final response (e.g., qualified answers like “about 12” and ranges). Yet there is little research investigating this claim. Additionally, explicitly inviting estimation may lead respondents to round their answers, which may affect survey estimates. In this study, we investigate the effect of adding an invitation to estimate to 22 open-ended numeric questions in a mail survey and three questions in a separate telephone survey. Generally, we find that explicitly inviting estimation does not significantly change rates of item nonresponse, rounding, or qualified/range answers in either mode, though it does slightly reduce nonsubstantive answers for mail respondents. In the telephone survey, an invitation to estimate results in fewer conversational turns and shorter response times. Our results indicate that an invitation to estimate may simplify the interaction between interviewers and respondents in telephone surveys, and neither hurts nor helps data quality in mail surveys.
摘要为开放式数字问题提供准确答案对受访者来说可能是一项繁重的任务。研究人员通常认为,在这些问题中添加评估邀请(例如,“你的最佳评估很好”)可以减轻认知负担,进而降低不良反应行为的发生率,如项目无反应、非实质性回答以及必须处理成最终回答的答案(例如,合格答案,如“大约12”和范围)。然而,很少有研究对这一说法进行调查。此外,明确邀请评估可能会导致受访者对他们的答案进行四舍五入,这可能会影响调查估计。在这项研究中,我们调查了在邮件调查中向22个开放式数字问题和在单独的电话调查中向3个问题添加评估邀请的影响。一般来说,我们发现,在任何一种模式下,明确邀请估计都不会显著改变项目无回复、四舍五入或合格/范围回答的比率,尽管它确实略微减少了邮件受访者的非实质回答。在电话调查中,邀请对方进行评估会减少谈话次数,缩短回复时间。我们的研究结果表明,邀请评估可以简化电话调查中面试官和受访者之间的互动,既不会损害也不会有助于邮件调查中的数据质量。
{"title":"Your Best Estimate is Fine. Or is It?","authors":"Jerry Timbrook, Kristen Olson, Jolene D Smyth","doi":"10.2478/jos-2022-0047","DOIUrl":"https://doi.org/10.2478/jos-2022-0047","url":null,"abstract":"Abstract Providing an exact answer to open-ended numeric questions can be a burdensome task for respondents. Researchers often assume that adding an invitation to estimate (e.g., “Your best estimate is fine”) to these questions reduces cognitive burden, and in turn, reduces rates of undesirable response behaviors like item nonresponse, nonsubstantive answers, and answers that must be processed into a final response (e.g., qualified answers like “about 12” and ranges). Yet there is little research investigating this claim. Additionally, explicitly inviting estimation may lead respondents to round their answers, which may affect survey estimates. In this study, we investigate the effect of adding an invitation to estimate to 22 open-ended numeric questions in a mail survey and three questions in a separate telephone survey. Generally, we find that explicitly inviting estimation does not significantly change rates of item nonresponse, rounding, or qualified/range answers in either mode, though it does slightly reduce nonsubstantive answers for mail respondents. In the telephone survey, an invitation to estimate results in fewer conversational turns and shorter response times. Our results indicate that an invitation to estimate may simplify the interaction between interviewers and respondents in telephone surveys, and neither hurts nor helps data quality in mail surveys.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1097 - 1123"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44435894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Response Burden and Dropout in a Probability-Based Online Panel Study – A Comparison between an App and Browser-Based Design 基于概率的在线面板研究中的响应负担和辍学率——应用程序和基于浏览器的设计的比较
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0043
C. Roberts, J. Herzing, Marc Asensio Manjon, Philip Abbet, D. Gática-Pérez
Abstract Survey respondents can complete web surveys using different Internet-enabled devices (PCs versus mobile phones and tablets) and using different software (web browser versus a mobile software application, “app”). Previous research has found that completing questionnaires via a browser on mobile devices can lead to higher breakoff rates and reduced measurement quality compared to using PCs, especially where questionnaires have not been adapted for mobile administration. A key explanation is that using a mobile browser is more burdensome and less enjoyable for respondents. There are reasons to assume apps should perform better than browsers, but so far, there have been few attempts to assess this empirically. In this study, we investigate variation in experienced burden across device and software in wave 1 of a three-wave panel study, comparing an app with a browser-based survey, in which sample members were encouraged to use a mobile device. We also assess device/software effects on participation at wave 2. We find that compared to mobile browser respondents, app respondents were less likely to drop out of the study after the first wave and the effect of the device used was mediated by subjective burden experienced during wave 1.
摘要调查受访者可以使用不同的互联网设备(PC与手机和平板电脑)和不同的软件(网络浏览器与移动软件应用程序,“应用程序”)完成网络调查。先前的研究发现,与使用PC相比,通过移动设备上的浏览器完成问卷调查可能会导致更高的中断率和更低的测量质量,尤其是在问卷调查不适用于移动管理的情况下。一个关键的解释是,对受访者来说,使用移动浏览器更麻烦,更不愉快。有理由认为应用程序应该比浏览器表现得更好,但到目前为止,很少有人尝试从经验上评估这一点。在这项研究中,我们调查了三波小组研究的第1波中设备和软件体验负担的变化,将应用程序与基于浏览器的调查进行了比较,在该调查中,鼓励样本成员使用移动设备。我们还评估了设备/软件对第2波参与的影响。我们发现,与移动浏览器受访者相比,应用程序受访者在第一波之后退出研究的可能性较小,并且所使用设备的影响是由第1波期间经历的主观负担介导的。
{"title":"Response Burden and Dropout in a Probability-Based Online Panel Study – A Comparison between an App and Browser-Based Design","authors":"C. Roberts, J. Herzing, Marc Asensio Manjon, Philip Abbet, D. Gática-Pérez","doi":"10.2478/jos-2022-0043","DOIUrl":"https://doi.org/10.2478/jos-2022-0043","url":null,"abstract":"Abstract Survey respondents can complete web surveys using different Internet-enabled devices (PCs versus mobile phones and tablets) and using different software (web browser versus a mobile software application, “app”). Previous research has found that completing questionnaires via a browser on mobile devices can lead to higher breakoff rates and reduced measurement quality compared to using PCs, especially where questionnaires have not been adapted for mobile administration. A key explanation is that using a mobile browser is more burdensome and less enjoyable for respondents. There are reasons to assume apps should perform better than browsers, but so far, there have been few attempts to assess this empirically. In this study, we investigate variation in experienced burden across device and software in wave 1 of a three-wave panel study, comparing an app with a browser-based survey, in which sample members were encouraged to use a mobile device. We also assess device/software effects on participation at wave 2. We find that compared to mobile browser respondents, app respondents were less likely to drop out of the study after the first wave and the effect of the device used was mediated by subjective burden experienced during wave 1.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"987 - 1017"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48128122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analyzing the Association of Objective Burden Measures to Perceived Burden with Regression Trees 用回归树分析客观负担测度与感知负担的相关性
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0048
Daniel K. Yang, Daniell Toth
Abstract Higher levels of perceived burden by respondents can lead to ambiguous responses to a questionnaire, item nonresponse, or refusals to continue participation in the survey which can introduce bias and downgrade the quality of the data. Therefore, it is important to understand what might influence the perception of burden in respondents. In this article, we demonstrate, using U.S. Consumer Expenditure Survey data, how regression tree models can be used to analyze the associations between perceived burden and objective burden measures conditioning on household demographics and other explanatory variables. The structure of the tree models allows these associations to easily be explored. Our analysis shows a relationship between perceived burden and some of the objective measures after conditioning on different demographic and household variables and that these relationships are quite affected by different respondent characteristics and the mode of the survey. Since the tree models were constructed using an algorithm that accounts for the sample design, inferences from the analysis can be made about the population. Therefore, any insights could be used to help guide future decisions about survey design and data collection to help reduce respondent burden.
较高水平的被调查者感知负担可能导致对问卷的模棱两可的回答,项目不回应,或拒绝继续参与调查,这可能会引入偏见并降低数据质量。因此,了解什么可能影响受访者对负担的看法是很重要的。在本文中,我们利用美国消费者支出调查数据,展示了如何使用回归树模型来分析感知负担和客观负担指标之间的关联,这些指标取决于家庭人口统计数据和其他解释变量。树形模型的结构可以很容易地探索这些关联。我们的分析表明,在调整不同的人口和家庭变量后,感知负担与一些客观措施之间存在关系,这些关系受不同的被调查者特征和调查方式的影响很大。由于树形模型是使用一种解释样本设计的算法构建的,因此可以从分析中得出关于总体的推论。因此,任何见解都可以用来帮助指导有关调查设计和数据收集的未来决策,以帮助减轻受访者的负担。
{"title":"Analyzing the Association of Objective Burden Measures to Perceived Burden with Regression Trees","authors":"Daniel K. Yang, Daniell Toth","doi":"10.2478/jos-2022-0048","DOIUrl":"https://doi.org/10.2478/jos-2022-0048","url":null,"abstract":"Abstract Higher levels of perceived burden by respondents can lead to ambiguous responses to a questionnaire, item nonresponse, or refusals to continue participation in the survey which can introduce bias and downgrade the quality of the data. Therefore, it is important to understand what might influence the perception of burden in respondents. In this article, we demonstrate, using U.S. Consumer Expenditure Survey data, how regression tree models can be used to analyze the associations between perceived burden and objective burden measures conditioning on household demographics and other explanatory variables. The structure of the tree models allows these associations to easily be explored. Our analysis shows a relationship between perceived burden and some of the objective measures after conditioning on different demographic and household variables and that these relationships are quite affected by different respondent characteristics and the mode of the survey. Since the tree models were constructed using an algorithm that accounts for the sample design, inferences from the analysis can be made about the population. Therefore, any insights could be used to help guide future decisions about survey design and data collection to help reduce respondent burden.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1125 - 1144"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46378880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Determination of the Threshold in Cutoff Sampling Using Response Burden with an Application to Intrastat 使用响应负荷确定截断采样的阈值及其在统计中的应用
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0051
Sašo Polanec, Paul A. Smith, M. Bavdaž
Abstract Statistical offices frequently use cutoff sampling to determine which businesses in a population should be surveyed. Examples include business surveys about international trade, production, innovation, ICT usage and so on. Cutoff thresholds are typically set in terms of key variables of interest and aim to satisfy a minimum coverage ratio–the share of aggregate values of reporting units. In this article we propose a simple cost-benefit approach to determination of the sampling cutoff by taking into account the response burden. In line with existing practice, we use the coverage ratio as our measure of accuracy and provide either analytical or numerical solutions to cutoff determination. Using a business survey on response burden of reporting trade flows within the EU (Intrastat), we present an application that illustrates our approach to cutoff determination. An important practical implication is the possibility to set industry-contingent cutoffs.
摘要统计局经常使用截止抽样来确定人群中哪些企业应该接受调查。例子包括关于国际贸易、生产、创新、信息和通信技术使用等的商业调查。截止阈值通常根据感兴趣的关键变量设定,旨在满足最低覆盖率——报告单位总值的份额。在本文中,我们提出了一种简单的成本效益方法,通过考虑响应负担来确定采样截止值。根据现有实践,我们使用覆盖率作为精度的衡量标准,并为截止值的确定提供分析或数值解决方案。利用一项关于欧盟内部贸易流量报告响应负担的商业调查(Intrastat),我们提出了一个应用程序,说明了我们确定截止值的方法。一个重要的实际含义是设置行业条件下的截止值的可能性。
{"title":"Determination of the Threshold in Cutoff Sampling Using Response Burden with an Application to Intrastat","authors":"Sašo Polanec, Paul A. Smith, M. Bavdaž","doi":"10.2478/jos-2022-0051","DOIUrl":"https://doi.org/10.2478/jos-2022-0051","url":null,"abstract":"Abstract Statistical offices frequently use cutoff sampling to determine which businesses in a population should be surveyed. Examples include business surveys about international trade, production, innovation, ICT usage and so on. Cutoff thresholds are typically set in terms of key variables of interest and aim to satisfy a minimum coverage ratio–the share of aggregate values of reporting units. In this article we propose a simple cost-benefit approach to determination of the sampling cutoff by taking into account the response burden. In line with existing practice, we use the coverage ratio as our measure of accuracy and provide either analytical or numerical solutions to cutoff determination. Using a business survey on response burden of reporting trade flows within the EU (Intrastat), we present an application that illustrates our approach to cutoff determination. An important practical implication is the possibility to set industry-contingent cutoffs.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1205 - 1234"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44059572","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Response Burden – Review and Conceptual Framework 回应负担-检讨及概念架构
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0041
Ting Yan, Douglas Williams
Abstract Concerns about the burden that surveys place on respondents have a long history in the survey field. This article reviews existing conceptualizations and measurements of response burden in the survey literature. Instead of conceptualizing response burden as a one-time overall outcome, we expand the conceptual framework of response burden by positing response burden as reflecting a continuous evaluation of the requirements imposed on respondents throughout the survey process. We specifically distinguish response burden at three time points: initial burden at the time of the survey request, cumulative burden that respondents experience after starting the interview, and continuous burden for those asked to participate in a later round of interviews in a longitudinal setting. At each time point, survey and question features affect response burden. In addition, respondent characteristics can affect response burden directly, or they can moderate or mediate the relationship between survey and question characteristics and the end perception of burden. Our conceptual framework reflects the dynamic and complex interactive nature of response burden at different time points over the course of a survey. We show how this framework can be used to explain conflicting empirical findings and guide methodological research.
摘要对调查给受访者带来负担的担忧在调查领域有着悠久的历史。本文回顾了调查文献中现有的反应负担的概念和测量方法。我们没有将响应负担概念化为一次性的总体结果,而是通过将响应负担定位为反映对整个调查过程中强加给受访者的要求的持续评估,来扩展响应负担的概念框架。我们特别区分了三个时间点的回答负担:提出调查请求时的初始负担、受访者在开始面试后经历的累积负担,以及那些被要求在纵向环境中参加下一轮面试的人的持续负担。在每个时间点,调查和问题特征都会影响回答负担。此外,受访者特征可以直接影响回答负担,也可以调节或中介调查和问题特征与最终负担感知之间的关系。我们的概念框架反映了调查过程中不同时间点反应负担的动态和复杂互动性质。我们展示了如何使用这个框架来解释相互矛盾的实证结果,并指导方法论研究。
{"title":"Response Burden – Review and Conceptual Framework","authors":"Ting Yan, Douglas Williams","doi":"10.2478/jos-2022-0041","DOIUrl":"https://doi.org/10.2478/jos-2022-0041","url":null,"abstract":"Abstract Concerns about the burden that surveys place on respondents have a long history in the survey field. This article reviews existing conceptualizations and measurements of response burden in the survey literature. Instead of conceptualizing response burden as a one-time overall outcome, we expand the conceptual framework of response burden by positing response burden as reflecting a continuous evaluation of the requirements imposed on respondents throughout the survey process. We specifically distinguish response burden at three time points: initial burden at the time of the survey request, cumulative burden that respondents experience after starting the interview, and continuous burden for those asked to participate in a later round of interviews in a longitudinal setting. At each time point, survey and question features affect response burden. In addition, respondent characteristics can affect response burden directly, or they can moderate or mediate the relationship between survey and question characteristics and the end perception of burden. Our conceptual framework reflects the dynamic and complex interactive nature of response burden at different time points over the course of a survey. We show how this framework can be used to explain conflicting empirical findings and guide methodological research.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"939 - 961"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46729833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Exploring Burden Perceptions of Household Survey Respondents in the American Community Survey 探讨美国社区调查中家庭调查受访者的负担认知
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0050
J. Holzberg, Jonathan Katz
Abstract Minimizing respondent survey burden may help decrease nonresponse and increase data quality, but the measurement of burden has varied widely. Recent efforts have paid more attention to respondents’ subjective perceptions of burden, measured through the addition of questions to a survey. Despite reliance on these questions as key measures, little qualitative research has been conducted for household surveys. This study used focus groups to examine respondents’ reactions to possible sources of burden in the American Community Survey (ACS) such as survey length, sensitivity, and contact strategy; respondents’ knowledge, attitudes, and beliefs about burden; and overall perceptions of burden. Feedback was used to guide subsequent selection and cognitive testing of questions on subjective perceptions of burden. Generally, respondents did not find the ACS to be burdensome. When deciding whether it was burdensome, respondents thought about the process of responding to the questionnaire, the value of the data, that response is mandatory, and to a lesser extent, the contacts they received, suggesting these constructs are key components of burden in the ACS. There were some differences by response mode and household characteristics. Findings reinforce the importance of conducting qualitative research to ensure questions capture important respondent burden perceptions for a particular survey.
摘要最小化受访者调查负担可能有助于减少无回复并提高数据质量,但负担的衡量标准差异很大。最近的努力更加关注受访者对负担的主观感知,通过在调查中添加问题来衡量。尽管依赖这些问题作为关键衡量标准,但很少对家庭调查进行定性研究。这项研究使用焦点小组来检查受访者对美国社区调查(ACS)中可能的负担来源的反应,如调查长度、敏感性和联系策略;受访者对负担的知识、态度和信念;以及对负担的总体看法。反馈被用于指导随后对主观负担感知问题的选择和认知测试。一般来说,受访者并不认为ACS是一种负担。在决定这是否是负担时,受访者考虑了问卷的回复过程、数据的价值、该回复是强制性的,以及在较小程度上,他们收到的联系,这表明这些结构是ACS负担的关键组成部分。在反应模式和家庭特征方面存在一些差异。调查结果强化了进行定性研究的重要性,以确保问题能够反映特定调查中受访者对负担的重要看法。
{"title":"Exploring Burden Perceptions of Household Survey Respondents in the American Community Survey","authors":"J. Holzberg, Jonathan Katz","doi":"10.2478/jos-2022-0050","DOIUrl":"https://doi.org/10.2478/jos-2022-0050","url":null,"abstract":"Abstract Minimizing respondent survey burden may help decrease nonresponse and increase data quality, but the measurement of burden has varied widely. Recent efforts have paid more attention to respondents’ subjective perceptions of burden, measured through the addition of questions to a survey. Despite reliance on these questions as key measures, little qualitative research has been conducted for household surveys. This study used focus groups to examine respondents’ reactions to possible sources of burden in the American Community Survey (ACS) such as survey length, sensitivity, and contact strategy; respondents’ knowledge, attitudes, and beliefs about burden; and overall perceptions of burden. Feedback was used to guide subsequent selection and cognitive testing of questions on subjective perceptions of burden. Generally, respondents did not find the ACS to be burdensome. When deciding whether it was burdensome, respondents thought about the process of responding to the questionnaire, the value of the data, that response is mandatory, and to a lesser extent, the contacts they received, suggesting these constructs are key components of burden in the ACS. There were some differences by response mode and household characteristics. Findings reinforce the importance of conducting qualitative research to ensure questions capture important respondent burden perceptions for a particular survey.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1177 - 1203"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45299283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Preface Overview of the Special Issue on Respondent Burden 被申请人责任专刊综述
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0040
Robin L. Kaplan, J. Holzberg, S. Eckman, D. Giesen
{"title":"Preface Overview of the Special Issue on Respondent Burden","authors":"Robin L. Kaplan, J. Holzberg, S. Eckman, D. Giesen","doi":"10.2478/jos-2022-0040","DOIUrl":"https://doi.org/10.2478/jos-2022-0040","url":null,"abstract":"","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"929 - 938"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45548856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Official Statistics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1