首页 > 最新文献

Journal of Official Statistics最新文献

英文 中文
The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey 反应负担的影响——在自行管理的混合设备调查中收集生活史数据
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0046
J. Carstensen, Sebastian Lang, Fine Cordua
Abstract Collecting life history data is highly demanding and therefore prone to error since respondents must retrieve and provide extensive complex information. Research has shown that response burden is an important factor influencing data quality. We examine whether increases in different measures of response burden in a (mixed-device) online survey lead to adverse effects on the data quality and whether these effects vary by the type of device used (mobile versus non-mobile). We conducted an experimental study in an online mixed-device survey, for which we developed a questionnaire on the educational and occupational trajectories of secondary-school graduates, undergraduates, and university graduates. To address our research question, we randomly assigned different levels of response burden to the participants and compared different measures on the data quality and response. We found mixed evidence for unfavourable effects of response burden on the examined outcomes. While some of our results were expected, they were not consistent across all subgroups. Most interestingly, the effects of response burden on outcomes seemed to differ based on the device used. Hence, we conclude that further research is needed to optimise the collection of complex data from different groups of participants.
摘要收集生活史数据要求很高,因此容易出错,因为受访者必须检索并提供大量复杂的信息。研究表明,响应负担是影响数据质量的一个重要因素。我们研究了在(混合设备)在线调查中,不同响应负担指标的增加是否会对数据质量产生不利影响,以及这些影响是否因使用的设备类型(移动设备与非移动设备)而异。我们在一项在线混合设备调查中进行了一项实验研究,为此我们制定了一份关于中学毕业生、本科生和大学毕业生的教育和职业轨迹的问卷。为了解决我们的研究问题,我们随机给参与者分配了不同水平的反应负担,并比较了数据质量和反应的不同衡量标准。我们发现,应对负担对检查结果产生不利影响的证据喜忧参半。虽然我们的一些结果是意料之中的,但并非所有亚组的结果都一致。最有趣的是,反应负担对结果的影响似乎因使用的设备而异。因此,我们得出结论,需要进一步的研究来优化从不同参与者群体收集复杂数据的过程。
{"title":"The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey","authors":"J. Carstensen, Sebastian Lang, Fine Cordua","doi":"10.2478/jos-2022-0046","DOIUrl":"https://doi.org/10.2478/jos-2022-0046","url":null,"abstract":"Abstract Collecting life history data is highly demanding and therefore prone to error since respondents must retrieve and provide extensive complex information. Research has shown that response burden is an important factor influencing data quality. We examine whether increases in different measures of response burden in a (mixed-device) online survey lead to adverse effects on the data quality and whether these effects vary by the type of device used (mobile versus non-mobile). We conducted an experimental study in an online mixed-device survey, for which we developed a questionnaire on the educational and occupational trajectories of secondary-school graduates, undergraduates, and university graduates. To address our research question, we randomly assigned different levels of response burden to the participants and compared different measures on the data quality and response. We found mixed evidence for unfavourable effects of response burden on the examined outcomes. While some of our results were expected, they were not consistent across all subgroups. Most interestingly, the effects of response burden on outcomes seemed to differ based on the device used. Hence, we conclude that further research is needed to optimise the collection of complex data from different groups of participants.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1069 - 1095"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43542065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS) 测试计划缺失设计以减轻CAHPS临床和群体调查(CG-CAHPS)网络和短信管理中的被调查者负担
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0042
P. Brenner, J. Hargraves, Carol Cosenza
Abstract We test a planned missing design to reduce respondent burden in Web and SMS administrations of the CAHPS Clinician and Group Survey (CG-CAHPS), a survey of patient experiences widely used by health care providers. Members of an online nonprobability panel were randomly assigned to one of three invitation and data collection mode protocols: email invitation to a Web survey, SMS invitation to a Web survey, or SMS invitation to an SMS survey. Within these three mode protocols, respondents were randomly assigned to a planned missing design, which shortened the survey by about 40%, or to a control group that received the survey in its entirety. We compare survey duration, breakoff and completion rates, and five key patient experience measures across conditions to assess the effect of the planned missing design across the three modes. We found that a planned missing design worked well with our Web survey, reducing survey duration and breakoff without changing estimates relative to the full-survey control condition. However, mixed findings in the SMS survey suggest that even shortened, 15-item surveys may be too long to substantially reduce respondent burden. We conclude with recommendations for future research.
摘要我们测试了一种计划缺失的设计,以减少CAHPS临床医生和团体调查(CG-CAHPS)的网络和短信管理中的受访者负担,这是一项广泛用于医疗保健提供者的患者体验调查。在线不可能性小组的成员被随机分配到三种邀请和数据收集模式协议中的一种:网络调查的电子邮件邀请、网络调查的短信邀请或短信调查的短信邀请函。在这三种模式的方案中,受访者被随机分配到一个计划缺失的设计中,该设计将调查缩短了约40%,或者被分配到接受完整调查的对照组。我们比较了调查持续时间、中断率和完成率,以及不同条件下的五个关键患者体验指标,以评估计划缺失设计对三种模式的影响。我们发现,计划中的缺失设计与我们的网络调查效果良好,减少了调查持续时间和中断,而不会改变相对于完整调查控制条件的估计。然而,短信调查的结果喜忧参半,表明即使是缩短的15项调查也可能太长,无法大幅减轻受访者的负担。最后,我们提出了未来研究的建议。
{"title":"Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS)","authors":"P. Brenner, J. Hargraves, Carol Cosenza","doi":"10.2478/jos-2022-0042","DOIUrl":"https://doi.org/10.2478/jos-2022-0042","url":null,"abstract":"Abstract We test a planned missing design to reduce respondent burden in Web and SMS administrations of the CAHPS Clinician and Group Survey (CG-CAHPS), a survey of patient experiences widely used by health care providers. Members of an online nonprobability panel were randomly assigned to one of three invitation and data collection mode protocols: email invitation to a Web survey, SMS invitation to a Web survey, or SMS invitation to an SMS survey. Within these three mode protocols, respondents were randomly assigned to a planned missing design, which shortened the survey by about 40%, or to a control group that received the survey in its entirety. We compare survey duration, breakoff and completion rates, and five key patient experience measures across conditions to assess the effect of the planned missing design across the three modes. We found that a planned missing design worked well with our Web survey, reducing survey duration and breakoff without changing estimates relative to the full-survey control condition. However, mixed findings in the SMS survey suggest that even shortened, 15-item surveys may be too long to substantially reduce respondent burden. We conclude with recommendations for future research.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"963 - 986"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48352579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Effect of Burdensome Survey Questions on Data Quality in an Omnibus Survey 综合调查中繁琐的调查问题对数据质量的影响
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0044
A. Phillips, Rachel Stenger
Abstract In interviewer-administered omnibus surveys, burdensome questions asked early in a survey may result in lower quality responses to questions asked later in a survey. Two examples of these burdensome questions are social network questions, wherein respondents are asked about members of their personal network, and knowledge questions, wherein respondents are asked to provide a factually correct response to a question. In this study, we explore how the presence of potentially burdensome questions are associated with item nonresponse and acquiescence rates on subsequent survey questions, and whether this effect differs by respondent age and education. We use data from the 2010 General Social Survey (AAPOR RR5 ¼ 70.3%, AAPOR 2016), which experimentally varied the location of a social network module and the presence of a knowledge question module. Those who received knowledge questions had higher item nonresponse rates on subsequent questions than those who did not receive knowledge questions, but the quality of responses did not differ by the presence of social network questions. Further, respondents with different characteristics were not differentially burdened by the knowledge questions or the social network questions. We conclude that knowledge questions may be better asked near the end of omnibus surveys to preserve the response quality for subsequent questions.
摘要在访谈者管理的综合调查中,在调查早期提出的繁琐问题可能会导致对调查后期提出的问题的回答质量较低。这些繁琐问题的两个例子是社交网络问题,其中受访者被问及其个人网络的成员,以及知识问题,其中参与者被要求对问题提供事实上正确的回答。在这项研究中,我们探讨了潜在负担问题的存在如何与后续调查问题的项目不回答率和默许率相关,以及这种影响是否因受访者年龄和教育程度而异。我们使用了2010年一般社会调查(AAPOR RR5¼70.3%,AAPOR 2016)的数据,该调查通过实验改变了社交网络模块的位置和知识问题模块的存在。收到知识问题的人对后续问题的项目无回答率高于没有收到知识问题,但回答的质量没有因社交网络问题的存在而不同。此外,具有不同特征的受访者对知识问题或社交网络问题的负担没有差异。我们得出的结论是,在综合调查接近尾声时,可能会更好地提出知识问题,以保持后续问题的回答质量。
{"title":"The Effect of Burdensome Survey Questions on Data Quality in an Omnibus Survey","authors":"A. Phillips, Rachel Stenger","doi":"10.2478/jos-2022-0044","DOIUrl":"https://doi.org/10.2478/jos-2022-0044","url":null,"abstract":"Abstract In interviewer-administered omnibus surveys, burdensome questions asked early in a survey may result in lower quality responses to questions asked later in a survey. Two examples of these burdensome questions are social network questions, wherein respondents are asked about members of their personal network, and knowledge questions, wherein respondents are asked to provide a factually correct response to a question. In this study, we explore how the presence of potentially burdensome questions are associated with item nonresponse and acquiescence rates on subsequent survey questions, and whether this effect differs by respondent age and education. We use data from the 2010 General Social Survey (AAPOR RR5 ¼ 70.3%, AAPOR 2016), which experimentally varied the location of a social network module and the presence of a knowledge question module. Those who received knowledge questions had higher item nonresponse rates on subsequent questions than those who did not receive knowledge questions, but the quality of responses did not differ by the presence of social network questions. Further, respondents with different characteristics were not differentially burdened by the knowledge questions or the social network questions. We conclude that knowledge questions may be better asked near the end of omnibus surveys to preserve the response quality for subsequent questions.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1019 - 1050"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48539376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling the Relationship between Proxy Measures of Respondent Burden and Survey Response Rates in a Household Panel Survey. 家庭小组调查中受访者负担的代理指标与调查响应率之间的关系建模
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0049
Morgan Earp, Robin Kaplan, Daniell Toth

Respondent burden has important implications for survey outcomes, including response rates and attrition in panel surveys. Despite this, respondent burden remains an understudied topic in the field of survey methodology, with few researchers systematically measuring objective and subjective burden factors in surveys used to produce official statistics. This research was designed to assess the impact of proxy measures of respondent burden, drawing on both objective (survey length and frequency), and subjective (effort, saliency, and sensitivity) burden measures on response rates over time in the Current Population Survey (CPS). Exploratory Factor Analysis confirmed the burden proxy measures were interrelated and formed five distinct factors. Regression tree models further indicated that both objective and subjective proxy burden factors were predictive of future CPS response rates. Additionally, respondent characteristics, including employment and marital status, interacted with these burden factors to further help predict response rates over time. We discuss the implications of these findings, including the importance of measuring both objective and subjective burden factors in production surveys. Our findings support a growing body of research suggesting that subjective burden and individual respondent characteristics should be incorporated into conceptual definitions of respondent burden and have implications for adaptive design.

摘要受访者负担对调查结果有重要影响,包括小组调查中的回复率和自然减员。尽管如此,在调查方法学领域,受访者负担仍然是一个研究不足的话题,很少有研究人员在用于编制官方统计数据的调查中系统地衡量客观和主观负担因素。本研究旨在利用当前人口调查(CPS)中的客观(调查长度和频率)和主观(努力、显著性和敏感性)负担指标,评估受访者负担的替代指标对一段时间内应答率的影响。探索性因素分析证实了负担替代指标是相互关联的,并形成了五个不同的因素。回归树模型进一步表明,客观和主观的代理负担因素都可以预测未来的CPS应答率。此外,受访者的特征,包括就业和婚姻状况,与这些负担因素相互作用,以进一步帮助预测一段时间内的应答率。我们讨论了这些发现的含义,包括在生产调查中测量客观和主观负担因素的重要性。我们的研究结果支持了越来越多的研究,这些研究表明,主观负担和个体受访者特征应纳入受访者负担的概念定义中,并对适应性设计产生影响。
{"title":"Modeling the Relationship between Proxy Measures of Respondent Burden and Survey Response Rates in a Household Panel Survey.","authors":"Morgan Earp, Robin Kaplan, Daniell Toth","doi":"10.2478/jos-2022-0049","DOIUrl":"10.2478/jos-2022-0049","url":null,"abstract":"<p><p>Respondent burden has important implications for survey outcomes, including response rates and attrition in panel surveys. Despite this, respondent burden remains an understudied topic in the field of survey methodology, with few researchers systematically measuring objective and subjective burden factors in surveys used to produce official statistics. This research was designed to assess the impact of proxy measures of respondent burden, drawing on both objective (survey length and frequency), and subjective (effort, saliency, and sensitivity) burden measures on response rates over time in the Current Population Survey (CPS). Exploratory Factor Analysis confirmed the burden proxy measures were interrelated and formed five distinct factors. Regression tree models further indicated that both objective and subjective proxy burden factors were predictive of future CPS response rates. Additionally, respondent characteristics, including employment and marital status, interacted with these burden factors to further help predict response rates over time. We discuss the implications of these findings, including the importance of measuring both objective and subjective burden factors in production surveys. Our findings support a growing body of research suggesting that subjective burden and individual respondent characteristics should be incorporated into conceptual definitions of respondent burden and have implications for adaptive design.</p>","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1145-1175"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11130710/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42805259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Economic Nowcasting with Long Short-Term Memory Artificial Neural Networks (LSTM) 长短期记忆人工神经网络(LSTM)经济临近预测
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-09-13 DOI: 10.2478/jos-2022-0037
Daniel Hopp
Artificial neural networks (ANNs) have been the catalyst to numerous advances in a variety of fields and disciplines in recent years. Their impact on economics, however, has been comparatively muted. One type of ANN, the long short-term memory network (LSTM), is particularly well-suited to deal with economic time-series. Here, the architecture’s performance and characteristics are evaluated in comparison with the dynamic factor model (DFM), currently a popular choice in the field of economic nowcasting. LSTMs are found to produce superior results to DFMs in the nowcasting of three separate variables; global merchandise export values and volumes, and global services exports. Further advantages include their ability to handle large numbers of input features in a variety of time frequencies. A disadvantage is the stochastic nature of outputs, common to all ANNs. In order to facilitate continued applied research of the methodology by avoiding the need for any knowledge of deep-learning libraries, an accompanying Python (Hopp 2021a) library was developed using PyTorch. The library is also available in R, MATLAB, and Julia.
近年来,人工神经网络(ann)已经成为各个领域和学科取得众多进展的催化剂。然而,它们对经济的影响相对较小。其中一种人工神经网络,长短期记忆网络(LSTM),特别适合处理经济时间序列。本文将该体系结构的性能和特点与动态因子模型(DFM)进行了比较,动态因子模型是目前经济临近预报领域的一种流行选择。在三个独立变量的临近预报中,lstm的结果优于dfm;全球商品出口总值和出口量,以及全球服务出口。进一步的优点包括它们能够在各种时间频率下处理大量输入特征。缺点是输出的随机性,这是所有人工神经网络的共同特点。为了通过避免需要任何深度学习库的知识来促进该方法的持续应用研究,使用PyTorch开发了附带的Python (Hopp 2021a)库。该库也可以在R、MATLAB和Julia中使用。
{"title":"Economic Nowcasting with Long Short-Term Memory Artificial Neural Networks (LSTM)","authors":"Daniel Hopp","doi":"10.2478/jos-2022-0037","DOIUrl":"https://doi.org/10.2478/jos-2022-0037","url":null,"abstract":"Artificial neural networks (ANNs) have been the catalyst to numerous advances in a variety of fields and disciplines in recent years. Their impact on economics, however, has been comparatively muted. One type of ANN, the long short-term memory network (LSTM), is particularly well-suited to deal with economic time-series. Here, the architecture’s performance and characteristics are evaluated in comparison with the dynamic factor model (DFM), currently a popular choice in the field of economic nowcasting. LSTMs are found to produce superior results to DFMs in the nowcasting of three separate variables; global merchandise export values and volumes, and global services exports. Further advantages include their ability to handle large numbers of input features in a variety of time frequencies. A disadvantage is the stochastic nature of outputs, common to all ANNs. In order to facilitate continued applied research of the methodology by avoiding the need for any knowledge of deep-learning libraries, an accompanying Python (Hopp 2021a) library was developed using PyTorch. The library is also available in R, MATLAB, and Julia.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"1 1","pages":""},"PeriodicalIF":1.1,"publicationDate":"2022-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138515737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Identifying Data Quality Challenges in Online Opt-In Panels Using Cognitive Interviews in English and Spanish 使用英语和西班牙语的认知访谈识别在线选择小组中的数据质量挑战
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0035
Y. G. Trejo, Mikelyn Meyers, Mandi Martinez, Angie O’Brien, Patricia L. Goerman, Betsarí Otero Class
Abstract In this article, we evaluate how the analysis of open-ended probes in an online cognitive interview can serve as a metric to identify cases that should be excluded due to disingenuous responses by ineligible respondents. We analyze data collected in 2019 via an online opt-in panel in English and Spanish to pretest a public opinion questionnaire (n = 265 in English and 199 in Spanish). We find that analyzing open-ended probes allowed us to flag cases completed by respondents who demonstrated problematic behaviors (e.g., answering many probes with repetitive textual patterns, by typing random characters, etc.), as well as to identify cases completed by ineligible respondents posing as eligible respondents (i.e., non-Spanish-speakers posing as Spanish-speakers). These findings indicate that data collected for multilingual pretesting research using online opt-in panels likely require additional evaluations of data quality. We find that open-ended probes can help determine which cases should be replaced when conducting pretesting using opt-in panels. We argue that open-ended probes in online cognitive interviews, while more time consuming and expensive to analyze than close-ended questions, serve as a valuable method of verifying response quality and respondent eligibility, particularly for researchers conducting multilingual surveys with online opt-in panels.
摘要在本文中,我们评估了在线认知访谈中对开放式调查的分析如何作为一种衡量标准,以确定由于不合格受访者的虚假回答而应排除的病例。我们分析了2019年通过英语和西班牙语在线选择加入小组收集的数据,以预测试一份民意调查问卷(英语n=265,西班牙语n=199)。我们发现,分析开放式调查使我们能够标记出表现出问题行为的受访者完成的案例(例如,通过键入随机字符等,用重复的文本模式回答许多调查),并识别出不合格的受访者冒充合格的受访者(即,非西班牙语使用者冒充西班牙语使用者)完成的案例。这些发现表明,使用在线选择加入小组为多语言预测试研究收集的数据可能需要对数据质量进行额外评估。我们发现,当使用选择加入面板进行预测试时,开放式探针可以帮助确定哪些情况应该更换。我们认为,在线认知访谈中的开放式调查虽然比封闭式问题更耗时、更昂贵,但却是验证回答质量和受访者资格的一种有价值的方法,尤其是对于通过在线选择小组进行多语言调查的研究人员来说。
{"title":"Identifying Data Quality Challenges in Online Opt-In Panels Using Cognitive Interviews in English and Spanish","authors":"Y. G. Trejo, Mikelyn Meyers, Mandi Martinez, Angie O’Brien, Patricia L. Goerman, Betsarí Otero Class","doi":"10.2478/jos-2022-0035","DOIUrl":"https://doi.org/10.2478/jos-2022-0035","url":null,"abstract":"Abstract In this article, we evaluate how the analysis of open-ended probes in an online cognitive interview can serve as a metric to identify cases that should be excluded due to disingenuous responses by ineligible respondents. We analyze data collected in 2019 via an online opt-in panel in English and Spanish to pretest a public opinion questionnaire (n = 265 in English and 199 in Spanish). We find that analyzing open-ended probes allowed us to flag cases completed by respondents who demonstrated problematic behaviors (e.g., answering many probes with repetitive textual patterns, by typing random characters, etc.), as well as to identify cases completed by ineligible respondents posing as eligible respondents (i.e., non-Spanish-speakers posing as Spanish-speakers). These findings indicate that data collected for multilingual pretesting research using online opt-in panels likely require additional evaluations of data quality. We find that open-ended probes can help determine which cases should be replaced when conducting pretesting using opt-in panels. We argue that open-ended probes in online cognitive interviews, while more time consuming and expensive to analyze than close-ended questions, serve as a valuable method of verifying response quality and respondent eligibility, particularly for researchers conducting multilingual surveys with online opt-in panels.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"793 - 822"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48743538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Measuring and Mapping Micro Level Earning Inequality towards Addressing the Sustainable Development Goals – A Multivariate Small Area Modelling Approach 测量和绘制微观层面的收入不平等以实现可持续发展目标——一种多变量小区域建模方法
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0036
Saurav Guha, Hukum Chandra
Abstract The earning inequality in India has unfavorably obstructed underprivileged in accessing elementary needs like health and education. Periodic labour force survey conducted by National Statistical Office of India generates estimates on earning status at national and state level for both rural and urban sectors separately. However, due to small sample size problem, these surveys cannot generate reliable estimates at micro-level viz. district or block. Thus, owing to unavailability of district-level estimates, analysis of earning inequality is restricted to the national and the state level. Therefore, the existing variability in disaggregate-level earning distribution often goes unnoticed. This article describes multivariate small area estimation method to generate precise and representative district-wise estimate of earning distribution in rural and urban areas of the Indian State of Bihar by linking Periodic labour force survey data of 2018–2019 and 2011 Population Census data of India. These disaggregate-level estimates and spatial mapping of earning distribution are essential for measuring and monitoring the goal of reduced inequalities related to the sustainable development of 2030 agenda. They expected to offer insightful information to decision-makers and policy experts for identifying the areas demanding more attention.
印度的收入不平等阻碍了弱势群体获得健康和教育等基本需求。印度国家统计局进行的定期劳动力调查分别估算了农村和城市部门在全国和各邦的收入状况。然而,由于样本数量小的问题,这些调查无法在微观层面(即地区或街区)得出可靠的估计。因此,由于无法获得地区一级的估计,对收入不平等的分析仅限于国家和州一级。因此,分散层级收入分布中存在的变异性往往被忽视。本文描述了多变量小区域估计方法,通过将2018-2019年的定期劳动力调查数据和2011年印度人口普查数据联系起来,对印度比哈尔邦农村和城市地区的收入分布进行精确和有代表性的地区估计。这些分类估计和收入分配的空间映射对于衡量和监测减少与2030年可持续发展议程相关的不平等的目标至关重要。他们希望为决策者和政策专家提供有见地的信息,以确定需要更多关注的领域。
{"title":"Measuring and Mapping Micro Level Earning Inequality towards Addressing the Sustainable Development Goals – A Multivariate Small Area Modelling Approach","authors":"Saurav Guha, Hukum Chandra","doi":"10.2478/jos-2022-0036","DOIUrl":"https://doi.org/10.2478/jos-2022-0036","url":null,"abstract":"Abstract The earning inequality in India has unfavorably obstructed underprivileged in accessing elementary needs like health and education. Periodic labour force survey conducted by National Statistical Office of India generates estimates on earning status at national and state level for both rural and urban sectors separately. However, due to small sample size problem, these surveys cannot generate reliable estimates at micro-level viz. district or block. Thus, owing to unavailability of district-level estimates, analysis of earning inequality is restricted to the national and the state level. Therefore, the existing variability in disaggregate-level earning distribution often goes unnoticed. This article describes multivariate small area estimation method to generate precise and representative district-wise estimate of earning distribution in rural and urban areas of the Indian State of Bihar by linking Periodic labour force survey data of 2018–2019 and 2011 Population Census data of India. These disaggregate-level estimates and spatial mapping of earning distribution are essential for measuring and monitoring the goal of reduced inequalities related to the sustainable development of 2030 agenda. They expected to offer insightful information to decision-makers and policy experts for identifying the areas demanding more attention.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"823 - 845"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47252025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Variable inclusion strategies through directed acyclic graphs to adjust health surveys subject to selection bias for producing national estimates. 变量包含策略通过有向无环图调整健康调查受选择偏差产生的国家估计。
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0038
Yan Li, Katherine E Irimata, Yulei He, Jennifer Parker

Along with the rapid emergence of web surveys to address time-sensitive priority topics, various propensity score (PS)-based adjustment methods have been developed to improve population representativeness for nonprobability- or probability-sampled web surveys subject to selection bias. Conventional PS-based methods construct pseudo-weights for web samples using a higher-quality reference probability sample. The bias reduction, however, depends on the outcome and variables collected in both web and reference samples. A central issue is identifying variables for inclusion in PS-adjustment. In this paper, directed acyclic graph (DAG), a common graphical tool for causal studies but largely under-utilized in survey research, is used to examine and elucidate how different types of variables in the causal pathways impact the performance of PS-adjustment. While past literature generally recommends including all variables, our research demonstrates that only certain types of variables are needed in PS-adjustment. Our research is illustrated by NCHS' Research and Development Survey, a probability-sampled web survey with potential selection bias, PS-adjusted to the National Health Interview Survey, to estimate U.S. asthma prevalence. Findings in this paper can be used by National Statistics Offices to design questionnaires with variables that improve web-samples' population representativeness and to release more timely and accurate estimates for priority topics.

随着网络调查的迅速出现,以解决时间敏感的优先主题,各种基于倾向得分(PS)的调整方法已经被开发出来,以提高受选择偏差影响的非概率或概率抽样网络调查的人口代表性。传统的基于ps的方法使用更高质量的参考概率样本为web样本构建伪权重。然而,偏倚的减少取决于在网络和参考样本中收集的结果和变量。一个中心问题是确定纳入ps调整的变量。有向无环图(DAG)是一种常见的因果研究图形工具,但在调查研究中很少得到利用,本文使用DAG来检验和阐明因果路径中不同类型的变量如何影响ps调整的性能。虽然过去的文献通常建议包括所有变量,但我们的研究表明,ps调整只需要某些类型的变量。我们的研究通过NCHS的研究与发展调查来说明,这是一项带有潜在选择偏差的概率抽样网络调查,ps调整为国家健康访谈调查,以估计美国哮喘患病率。本文的研究结果可以被国家统计局用来设计带有变量的问卷,以提高网络样本的人口代表性,并对优先主题发布更及时和准确的估计。
{"title":"Variable inclusion strategies through directed acyclic graphs to adjust health surveys subject to selection bias for producing national estimates.","authors":"Yan Li,&nbsp;Katherine E Irimata,&nbsp;Yulei He,&nbsp;Jennifer Parker","doi":"10.2478/jos-2022-0038","DOIUrl":"https://doi.org/10.2478/jos-2022-0038","url":null,"abstract":"<p><p>Along with the rapid emergence of web surveys to address time-sensitive priority topics, various propensity score (PS)-based adjustment methods have been developed to improve population representativeness for nonprobability- or probability-sampled web surveys subject to selection bias. Conventional PS-based methods construct pseudo-weights for web samples using a higher-quality reference probability sample. The bias reduction, however, depends on the outcome and variables collected in both web and reference samples. A central issue is identifying variables for inclusion in PS-adjustment. In this paper, directed acyclic graph (DAG), a common graphical tool for causal studies but largely under-utilized in survey research, is used to examine and elucidate how different types of variables in the causal pathways impact the performance of PS-adjustment. While past literature generally recommends including all variables, our research demonstrates that only certain types of variables are needed in PS-adjustment. Our research is illustrated by NCHS' Research and Development Survey, a probability-sampled web survey with potential selection bias, PS-adjusted to the National Health Interview Survey, to estimate U.S. asthma prevalence. Findings in this paper can be used by National Statistics Offices to design questionnaires with variables that improve web-samples' population representativeness and to release more timely and accurate estimates for priority topics.</p>","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 3","pages":"875-900"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9490791/pdf/nihms-1807439.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10132956","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Construction of Databases for Small Area Estimation 小面积估算数据库的构建
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0031
Emily J. Berg
Abstract The demand for small area estimates can conflict with the objective of producing a multi-purpose data set. We use donor imputation to construct a database that supports small area estimation. Appropriately weighted sums of observed and imputed values produce model-based small area estimates. We develop imputation procedures for both unit-level and area-level models. For area-level models, we restrict to linear models. We assume a single vector of covariates is used for a possibly multivariate response. Each record in the imputed data set has complete data, an estimation weight, and a set of replicate weights for mean square error (MSE) estimation. We compare imputation procedures based on area-level models to those based on unit-level models through simulation. We apply the methods to the Iowa Seat-Belt Use Survey, a survey designed to produce state-level estimates of the proportions of vehicle occupants who wear a seat-belt. We develop a bivariate unit-level model for prediction of county-level proportions of belted drivers and total occupants. We impute values for the proportions of belted drivers and vehicle occupants onto the full population of road segments in the sampling frame. The resulting imputed data set returns approximations for the county-level predictors based on the bivariate model.
摘要对小面积估计的需求可能与生成多用途数据集的目标相冲突。我们使用捐助者估算来构建一个支持小面积估计的数据库。观测值和估算值的适当加权和产生基于模型的小面积估计。我们为单位级和地区级模型制定插补程序。对于区域级模型,我们仅限于线性模型。我们假设协变的单个向量用于可能的多变量响应。估算数据集中的每个记录都有完整的数据、估计权重和一组用于均方误差(MSE)估计的重复权重。我们通过模拟比较了基于地区级模型和基于单位级模型的插补程序。我们将这些方法应用于爱荷华州安全带使用调查,该调查旨在对佩戴安全带的车辆乘客比例进行州级估计。我们开发了一个双变量单位水平模型,用于预测县级安全带驾驶员和总乘客的比例。我们将系安全带的驾驶员和车辆乘客的比例估算到采样框架中路段的全部人口中。由此产生的估算数据集基于双变量模型返回县级预测因子的近似值。
{"title":"Construction of Databases for Small Area Estimation","authors":"Emily J. Berg","doi":"10.2478/jos-2022-0031","DOIUrl":"https://doi.org/10.2478/jos-2022-0031","url":null,"abstract":"Abstract The demand for small area estimates can conflict with the objective of producing a multi-purpose data set. We use donor imputation to construct a database that supports small area estimation. Appropriately weighted sums of observed and imputed values produce model-based small area estimates. We develop imputation procedures for both unit-level and area-level models. For area-level models, we restrict to linear models. We assume a single vector of covariates is used for a possibly multivariate response. Each record in the imputed data set has complete data, an estimation weight, and a set of replicate weights for mean square error (MSE) estimation. We compare imputation procedures based on area-level models to those based on unit-level models through simulation. We apply the methods to the Iowa Seat-Belt Use Survey, a survey designed to produce state-level estimates of the proportions of vehicle occupants who wear a seat-belt. We develop a bivariate unit-level model for prediction of county-level proportions of belted drivers and total occupants. We impute values for the proportions of belted drivers and vehicle occupants onto the full population of road segments in the sampling frame. The resulting imputed data set returns approximations for the county-level predictors based on the bivariate model.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"673 - 708"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45891496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Timely Estimates of the Monthly Mexican Economic Activity 墨西哥每月经济活动的及时估计
IF 1.1 4区 数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0033
F. Corona, G. González-Farías, J. López-Pérez
Abstract In this article, we present a new approach based on dynamic factor models (DFMs) to perform accurate nowcasts for the percentage annual variation of the Mexican Global Economic Activity Indicator (IGAE), the commonly used variable as an approximation of monthly GDP. The procedure exploits the contemporaneous relationship of the timely traditional macroeconomic time series and nontraditional variables as Google Trends with respect to the IGAE. We evaluate the performance of the approach in a pseudo real-time framework, which includes the pandemic of COVID-19, and conclude that the procedure obtains accurate estimates, for one and two-steps ahead, above all, given the use of Google Trends. Another contribution for economic nowcasting is that the approach allows to disentangle the key variables in the DFM by estimating the confidence interval for the factor loadings, hence allows to evaluate the statistical significance of the variables in the DFM. This approach is used in official statistics to obtain preliminary and accurate estimates for IGAE up to 40 days before the official data release.
在本文中,我们提出了一种基于动态因子模型(dfm)的新方法,对墨西哥全球经济活动指标(IGAE)的年度变化百分比进行准确的临近预测,IGAE是常用的月度GDP近似值变量。该程序利用传统宏观经济时间序列和非传统变量作为谷歌趋势与IGAE的同步关系。我们在包括COVID-19大流行在内的伪实时框架中评估了该方法的性能,并得出结论认为,考虑到使用谷歌趋势,该程序获得了准确的预测,特别是提前一步和两步。对经济临近预测的另一个贡献是,该方法允许通过估计因子负荷的置信区间来解开DFM中的关键变量,从而允许评估DFM中变量的统计显著性。这种方法用于官方统计,以便在官方数据发布前40天获得IGAE的初步和准确估计。
{"title":"Timely Estimates of the Monthly Mexican Economic Activity","authors":"F. Corona, G. González-Farías, J. López-Pérez","doi":"10.2478/jos-2022-0033","DOIUrl":"https://doi.org/10.2478/jos-2022-0033","url":null,"abstract":"Abstract In this article, we present a new approach based on dynamic factor models (DFMs) to perform accurate nowcasts for the percentage annual variation of the Mexican Global Economic Activity Indicator (IGAE), the commonly used variable as an approximation of monthly GDP. The procedure exploits the contemporaneous relationship of the timely traditional macroeconomic time series and nontraditional variables as Google Trends with respect to the IGAE. We evaluate the performance of the approach in a pseudo real-time framework, which includes the pandemic of COVID-19, and conclude that the procedure obtains accurate estimates, for one and two-steps ahead, above all, given the use of Google Trends. Another contribution for economic nowcasting is that the approach allows to disentangle the key variables in the DFM by estimating the confidence interval for the factor loadings, hence allows to evaluate the statistical significance of the variables in the DFM. This approach is used in official statistics to obtain preliminary and accurate estimates for IGAE up to 40 days before the official data release.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"733 - 765"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44845546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Official Statistics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1