首页 > 最新文献

Field Methods最新文献

英文 中文
Verbalization of Rating Scales Taking Account of Their Polarity 考虑两极性的评定量表的言语化
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2023-01-15 DOI: 10.1177/1525822x231151314
Natalja Menold
While numerical bipolar rating scales may evoke positivity bias, little is known about the corresponding bias in verbal bipolar rating scales. The choice of verbalization of the middle category may lead to response bias, particularly if it is not in line with the scale polarity. Unipolar and bipolar seven-category rating scales in which the verbalizations of the middle categories matched or did not match the implemented polarity were investigated in randomized experiments using a non-probabilistic online access panel in Germany. Bipolar rating scales exhibited higher positivity bias and acquiescence than unipolar rating scales. Reliability, validity, and equidistance tended to be violated if the verbalizations of the middle category did not match scale polarity. The results provide a rationale for rating scale verbalization.
虽然数字双相评定量表可能会引发积极偏见,但对言语双相评定表中相应的偏见知之甚少。选择中间类别的动词化可能会导致反应偏差,特别是如果它不符合量表的极性。在德国使用非概率在线访问面板进行的随机实验中,研究了单极性和双极性七类评定量表,其中中间类别的措辞与实施的极性匹配或不匹配。两极评定量表比单极评定量表表现出更高的积极偏向和默许。如果中间类别的措辞与量表的极性不匹配,则倾向于违反信度、有效性和等距性。研究结果为评定量表语言化提供了依据。
{"title":"Verbalization of Rating Scales Taking Account of Their Polarity","authors":"Natalja Menold","doi":"10.1177/1525822x231151314","DOIUrl":"https://doi.org/10.1177/1525822x231151314","url":null,"abstract":"While numerical bipolar rating scales may evoke positivity bias, little is known about the corresponding bias in verbal bipolar rating scales. The choice of verbalization of the middle category may lead to response bias, particularly if it is not in line with the scale polarity. Unipolar and bipolar seven-category rating scales in which the verbalizations of the middle categories matched or did not match the implemented polarity were investigated in randomized experiments using a non-probabilistic online access panel in Germany. Bipolar rating scales exhibited higher positivity bias and acquiescence than unipolar rating scales. Reliability, validity, and equidistance tended to be violated if the verbalizations of the middle category did not match scale polarity. The results provide a rationale for rating scale verbalization.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2023-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46414775","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accuracy of a Photo-based Smartphone Application to Assess Salivary Cortisol Sampling Time in Adolescents 基于照片的智能手机应用程序评估青少年唾液皮质醇采样时间的准确性
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-11-28 DOI: 10.1177/1525822X221141226
Cheng K. Fred Wen, Stefan Schneider, M. Weigensberg, B. Weerman, D. Spruijt-Metz
Accurate assessment of saliva sampling time is essential for studies that collect cortisol sample in ambulatory settings. This study examined the sampling time assessed by user-submitted photos via a mobile application (ZEMI) compared with MEMSCaps™. Intra-class correlation coefficient (ICC) of the time differences between when the 16 adolescents in the study were prompted to collect the sample and (1) when the MEMSCaps™ was opened (TimeM), and (2) when photos of the corresponding sample were submitted (TimeZ) was computed to evaluate the agreement of sampling times. The average TimeM and TimeZ 12.06 ± 65.80 and 16.13 ± 52.07 minutes, respectively. The pooled ICC between TimeM and TimeZ was 0.986 (95% CI: 0.959–0.995), suggesting excellent correspondence between the two measurements.
唾液采样时间的准确评估是必不可少的研究,收集皮质醇样本在门诊设置。本研究检验了用户通过移动应用程序(ZEMI)提交的照片评估的采样时间,并与MEMSCaps™进行了比较。计算16名青少年被提示采集样本与(1)打开MEMSCaps™(TimeM)和(2)提交相应样本照片(TimeZ)之间的时间差的班级内相关系数(ICC),以评估采样时间的一致性。TimeM和TimeZ的平均值分别为12.06±65.80和16.13±52.07分钟。TimeM和TimeZ之间的合并ICC为0.986 (95% CI: 0.959-0.995),表明两个测量值之间具有良好的对应关系。
{"title":"Accuracy of a Photo-based Smartphone Application to Assess Salivary Cortisol Sampling Time in Adolescents","authors":"Cheng K. Fred Wen, Stefan Schneider, M. Weigensberg, B. Weerman, D. Spruijt-Metz","doi":"10.1177/1525822X221141226","DOIUrl":"https://doi.org/10.1177/1525822X221141226","url":null,"abstract":"Accurate assessment of saliva sampling time is essential for studies that collect cortisol sample in ambulatory settings. This study examined the sampling time assessed by user-submitted photos via a mobile application (ZEMI) compared with MEMSCaps™. Intra-class correlation coefficient (ICC) of the time differences between when the 16 adolescents in the study were prompted to collect the sample and (1) when the MEMSCaps™ was opened (TimeM), and (2) when photos of the corresponding sample were submitted (TimeZ) was computed to evaluate the agreement of sampling times. The average TimeM and TimeZ 12.06 ± 65.80 and 16.13 ± 52.07 minutes, respectively. The pooled ICC between TimeM and TimeZ was 0.986 (95% CI: 0.959–0.995), suggesting excellent correspondence between the two measurements.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46692080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Daily and Momentary Variability in Sleep, Stress, and Well-being Data in Two Samples of Health Care Workers 两个卫生保健工作者样本中睡眠、压力和健康数据的日常和瞬间变异性
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-10-27 DOI: 10.1177/1525822x221132425
Soomi Lee, C. Mu, R. Joshi, Arooj Khan
Ecological momentary assessment (EMA) can capture how sleep, stress, and well-being are related within individuals. However, the use of EMA involves participant burden, which may be a major barrier when studying at-risk populations like frontline workers. To guide future research interested in using EMA, this study examined variance components in sleep, stress, and well-being variables collected from health care workers. Two samples of hospital nurses (60 inpatient, 84 outpatient) responded to 2-week smartphone-based EMA. Adherence to the EMA protocol was good in both samples. Results from intraclass correlations showed more momentary variability in stressors and uplifts, more daily variability in sleep, fatigue, and physical symptoms, and more between-person variability in affect, rumination, and work quality. Across the variables, however, there was substantial within-person variability. Variance components were relatively consistent between workdays and non-workdays and between week 1 and week 2. Some nuanced between-sample differences were noted.
生态瞬时评估(EMA)可以捕捉到个体的睡眠、压力和幸福感是如何相互关联的。然而,EMA的使用涉及参与者负担,这可能是研究一线工作人员等高危人群时的主要障碍。为了指导未来对使用EMA感兴趣的研究,本研究检查了从卫生保健工作者那里收集的睡眠、压力和幸福变量的方差成分。两个医院护士样本(60名住院病人,84名门诊病人)对2周基于智能手机的EMA有反应。两个样本对EMA方案的依从性都很好。班级内相关性的结果显示,压力源和兴奋的瞬间差异更大,睡眠、疲劳和身体症状的日常差异更大,情感、沉思和工作质量的人与人之间差异更大。然而,在这些变量中,存在大量的个人差异。工作日与非工作日、第1周与第2周的方差成分相对一致。注意到样本之间的一些细微差别。
{"title":"Daily and Momentary Variability in Sleep, Stress, and Well-being Data in Two Samples of Health Care Workers","authors":"Soomi Lee, C. Mu, R. Joshi, Arooj Khan","doi":"10.1177/1525822x221132425","DOIUrl":"https://doi.org/10.1177/1525822x221132425","url":null,"abstract":"Ecological momentary assessment (EMA) can capture how sleep, stress, and well-being are related within individuals. However, the use of EMA involves participant burden, which may be a major barrier when studying at-risk populations like frontline workers. To guide future research interested in using EMA, this study examined variance components in sleep, stress, and well-being variables collected from health care workers. Two samples of hospital nurses (60 inpatient, 84 outpatient) responded to 2-week smartphone-based EMA. Adherence to the EMA protocol was good in both samples. Results from intraclass correlations showed more momentary variability in stressors and uplifts, more daily variability in sleep, fatigue, and physical symptoms, and more between-person variability in affect, rumination, and work quality. Across the variables, however, there was substantial within-person variability. Variance components were relatively consistent between workdays and non-workdays and between week 1 and week 2. Some nuanced between-sample differences were noted.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41287023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of Prepaid Postage Stamps and Postcard Incentives in a Web Survey Experiment 网络调查实验中预付邮资邮票和明信片激励措施的效果
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-10-26 DOI: 10.1177/1525822X221132401
G. Haas, Marieke Volkert, M. Senghaas
Even small monetary incentives, e.g., a one-dollar bill in a postal invitation letter, can increase the response rate in a web survey. However, in the euro currency area, the smallest amount of monetary incentive for a postal invitation is a five-euro bill, which is costly. As such, we conducted a random experiment with prepaid stamp and postcard incentives as affordable alternatives. We compare the effect of our experimental groups with a control group in terms of response rates, response rates in a subsequent wave, data linkage consent, and data collection costs. Compared with the control group, the postcard incentive has no effect on our outcomes except overall costs. Using a prepaid stamp incentive increases the response rate overall but with different effect sizes for subgroups. We find no effect of stamp incentives on response rates in a subsequent wave or data linkage consent.
即使是很小的金钱奖励,例如邮寄邀请函中的一美元纸币,也可以提高网络调查的回复率。然而,在欧元区,邮寄邀请函的最低货币激励是5欧元纸币,这是昂贵的。因此,我们进行了一项随机实验,将预付邮票和明信片奖励作为负担得起的替代方案。我们比较了实验组和对照组在反应率、后续波反应率、数据链接同意和数据收集成本方面的效果。与对照组相比,明信片激励对我们的结果没有影响,除了总体成本。使用预付邮票激励总体上提高了响应率,但对子组的影响大小不同。我们发现,在随后的浪潮或数据链接同意中,印花激励对响应率没有影响。
{"title":"Effects of Prepaid Postage Stamps and Postcard Incentives in a Web Survey Experiment","authors":"G. Haas, Marieke Volkert, M. Senghaas","doi":"10.1177/1525822X221132401","DOIUrl":"https://doi.org/10.1177/1525822X221132401","url":null,"abstract":"Even small monetary incentives, e.g., a one-dollar bill in a postal invitation letter, can increase the response rate in a web survey. However, in the euro currency area, the smallest amount of monetary incentive for a postal invitation is a five-euro bill, which is costly. As such, we conducted a random experiment with prepaid stamp and postcard incentives as affordable alternatives. We compare the effect of our experimental groups with a control group in terms of response rates, response rates in a subsequent wave, data linkage consent, and data collection costs. Compared with the control group, the postcard incentive has no effect on our outcomes except overall costs. Using a prepaid stamp incentive increases the response rate overall but with different effect sizes for subgroups. We find no effect of stamp incentives on response rates in a subsequent wave or data linkage consent.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46937338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Are Voter Rolls Suitable Sampling Frames for Household Surveys? Evidence from India 选民名册是否适合家庭调查的抽样框架?来自印度的证据
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-10-25 DOI: 10.1177/1525822x221135369
Ruchika Joshi, J. McManus, Karan Nagpal, Andrew Fraker
We examine the use of publicly available voter rolls for household survey sampling as an alternative to household listings or field-based sampling methods. Using voter rolls for sampling can save most of the cost of constructing a sampling frame relative to a household listing, but there is limited evidence about their accuracy and completeness. We conducted a household listing in 13 polling stations in India comprising 2,416 households across four states and compared the listing to voter rolls for the same polling stations. We show that voter rolls include 91% of the households found in the household listing. We conduct simulations to show that sampling from voter rolls produces estimates of household-level economic variables with minimal bias. These results suggest that voter rolls may be suitable for constructing household sampling frames, particularly in rural India.
我们研究了使用公开的选民名册进行家庭调查抽样,作为家庭名单或实地抽样方法的替代方案。使用选民名册进行抽样可以节省相对于家庭名单构建抽样框架的大部分成本,但关于其准确性和完整性的证据有限。我们在印度的13个投票站对四个州的2416户家庭进行了家庭登记,并将该登记与同一投票站的选民名册进行了比较。我们显示,选民名册包括家庭名单中91%的家庭。我们进行了模拟,以表明从选民名册中抽样可以以最小的偏差对家庭层面的经济变量进行估计。这些结果表明,选民名册可能适合构建家庭抽样框架,尤其是在印度农村。
{"title":"Are Voter Rolls Suitable Sampling Frames for Household Surveys? Evidence from India","authors":"Ruchika Joshi, J. McManus, Karan Nagpal, Andrew Fraker","doi":"10.1177/1525822x221135369","DOIUrl":"https://doi.org/10.1177/1525822x221135369","url":null,"abstract":"We examine the use of publicly available voter rolls for household survey sampling as an alternative to household listings or field-based sampling methods. Using voter rolls for sampling can save most of the cost of constructing a sampling frame relative to a household listing, but there is limited evidence about their accuracy and completeness. We conducted a household listing in 13 polling stations in India comprising 2,416 households across four states and compared the listing to voter rolls for the same polling stations. We show that voter rolls include 91% of the households found in the household listing. We conduct simulations to show that sampling from voter rolls produces estimates of household-level economic variables with minimal bias. These results suggest that voter rolls may be suitable for constructing household sampling frames, particularly in rural India.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42389676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
What about the Less IT Literate? A Comparison of Different Postal Recruitment Strategies to an Online Panel of the General Population IT Literate降低了多少?不同邮政招聘策略与普通人群在线小组的比较
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-10-25 DOI: 10.1177/1525822X221132940
Barbara Felderer, J. Herzing
Even though the proportion of individuals who are not equipped to participate in online surveys is constantly decreasing, many surveys face an under-representation of individuals who do not feel IT literate enough to participate. Using experimental data from a probability-based online panel, we study which recruitment survey mode strategy performs best in recruiting less IT-literate persons for an online panel. The sampled individuals received postal invitations to conduct the recruitment survey in a self-completion mode. We experimentally vary four recruitment survey mode strategies: one online mode strategy, two sequential mixed-mode strategies, and one concurrent mode strategy. We find the recruitment survey mode strategies to have a major effect on the sample composition of the recruitment survey, but the differences between the strategies vanish once respondents are asked to proceed with the panel online.
尽管没有能力参加在线调查的个人比例不断下降,但许多调查都面临着缺乏信息技术知识的人的代表性。使用来自基于概率的在线小组的实验数据,我们研究了哪种招聘调查模式策略在为在线小组招聘不太懂IT的人方面表现最好。被抽样的个人收到了以自我完成模式进行招聘调查的邮寄邀请。我们通过实验改变了四种招聘调查模式策略:一种在线模式策略、两种顺序混合模式策略和一种并发模式策略。我们发现,招聘调查模式策略对招聘调查的样本构成有重大影响,但一旦受访者被要求在线进行小组讨论,策略之间的差异就会消失。
{"title":"What about the Less IT Literate? A Comparison of Different Postal Recruitment Strategies to an Online Panel of the General Population","authors":"Barbara Felderer, J. Herzing","doi":"10.1177/1525822X221132940","DOIUrl":"https://doi.org/10.1177/1525822X221132940","url":null,"abstract":"Even though the proportion of individuals who are not equipped to participate in online surveys is constantly decreasing, many surveys face an under-representation of individuals who do not feel IT literate enough to participate. Using experimental data from a probability-based online panel, we study which recruitment survey mode strategy performs best in recruiting less IT-literate persons for an online panel. The sampled individuals received postal invitations to conduct the recruitment survey in a self-completion mode. We experimentally vary four recruitment survey mode strategies: one online mode strategy, two sequential mixed-mode strategies, and one concurrent mode strategy. We find the recruitment survey mode strategies to have a major effect on the sample composition of the recruitment survey, but the differences between the strategies vanish once respondents are asked to proceed with the panel online.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49627250","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
“Are You …”: An Examination of Incomplete Question Stems in Self-administered Surveys “你是……吗?”:自我调查中不完整题干的检验
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-10-18 DOI: 10.1177/1525822x221134756
Nestor Hernandez, Kristen Olson, Jolene D Smyth
Questionnaire designers are encouraged to write questions as complete sentences. In self-administered surveys, incomplete question stems may reduce visual clutter but may also increase burden when respondents need to scan the response options to fully complete the question. We experimentally examine the effects of three categories of incomplete question stems (incomplete conversational, incomplete ordinal, and incomplete nominal questions) versus complete question stems on 53 items in a probability web-mail survey. We examine item nonresponse, response time, selection of the first and last response options, and response distributions. We find that incomplete question stems take slightly longer to answer and slightly reduce the selection of the last response option but have no effect on item nonresponse rates or selection of the first response option. We conclude that questionnaire designers should follow current best practices to write complete questions, but deviations from complete questions will likely have limited effects.
问卷设计者被鼓励把问题写成完整的句子。在自我管理的调查中,不完整的问题可能会减少视觉混乱,但也可能增加负担,因为受访者需要扫描回答选项才能完全完成问题。我们通过实验研究了三种不完整题干(不完整会话题干、不完整顺序题干和不完整标称题干)与完整题干在概率网络邮件调查中的53个项目上的影响。我们检查了项目不响应、响应时间、第一个和最后一个响应选项的选择以及响应分布。我们发现,不完整的题干需要稍长的时间来回答,并略微减少最后一个回答选项的选择,但对项目无反应率或第一反应选项的选择没有影响。我们得出结论,问卷设计者应该遵循当前的最佳实践来编写完整的问题,但偏离完整的问题可能会产生有限的影响。
{"title":"“Are You …”: An Examination of Incomplete Question Stems in Self-administered Surveys","authors":"Nestor Hernandez, Kristen Olson, Jolene D Smyth","doi":"10.1177/1525822x221134756","DOIUrl":"https://doi.org/10.1177/1525822x221134756","url":null,"abstract":"Questionnaire designers are encouraged to write questions as complete sentences. In self-administered surveys, incomplete question stems may reduce visual clutter but may also increase burden when respondents need to scan the response options to fully complete the question. We experimentally examine the effects of three categories of incomplete question stems (incomplete conversational, incomplete ordinal, and incomplete nominal questions) versus complete question stems on 53 items in a probability web-mail survey. We examine item nonresponse, response time, selection of the first and last response options, and response distributions. We find that incomplete question stems take slightly longer to answer and slightly reduce the selection of the last response option but have no effect on item nonresponse rates or selection of the first response option. We conclude that questionnaire designers should follow current best practices to write complete questions, but deviations from complete questions will likely have limited effects.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43988017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing Readability Measures and Computer‐assisted Question Evaluation Tools for Self‐administered Survey Questions 自我管理调查问题的可读性测量和计算机辅助问题评估工具的比较
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-10-14 DOI: 10.1177/1525822x221124469
Rachel Stenger, Kristen Olson, Jolene D Smyth
Questionnaire designers use readability measures to ensure that questions can be understood by the target population. The most common measure is the Flesch-Kincaid Grade level, but other formulas exist. This article compares six different readability measures across 150 questions in a self-administered questionnaire, finding notable variation in calculated readability across measures. Some question formats, including those that are part of a battery, require important decisions that have large effects on the estimated readability of survey items. Other question evaluation tools, such as the Question Understanding Aid (QUAID) and the Survey Quality Predictor (SQP), may identify similar problems in questions, making readability measures less useful. We find little overlap between QUAID, SQP, and the readability measures, and little differentiation in the tools’ prediction of item nonresponse rates. Questionnaire designers are encouraged to use multiple question evaluation tools and develop readability measures specifically for survey questions.
问卷设计者使用可读性措施来确保问题能够被目标人群理解。最常见的衡量标准是Flesch-Kincaid等级,但也存在其他公式。本文在一份自填问卷中对150个问题的六种不同可读性指标进行了比较,发现不同指标的计算可读性存在显著差异。一些问题格式,包括那些属于一组的格式,需要做出对调查项目的估计可读性有很大影响的重要决定。其他问题评估工具,如问题理解辅助工具(QUAID)和调查质量预测工具(SQP),可能会发现问题中的类似问题,从而降低可读性度量的用处。我们发现QUAID、SQP和可读性度量之间几乎没有重叠,工具对项目无应答率的预测也几乎没有差异。鼓励问卷设计者使用多个问题评估工具,并专门针对调查问题制定可读性措施。
{"title":"Comparing Readability Measures and Computer‐assisted Question Evaluation Tools for Self‐administered Survey Questions","authors":"Rachel Stenger, Kristen Olson, Jolene D Smyth","doi":"10.1177/1525822x221124469","DOIUrl":"https://doi.org/10.1177/1525822x221124469","url":null,"abstract":"Questionnaire designers use readability measures to ensure that questions can be understood by the target population. The most common measure is the Flesch-Kincaid Grade level, but other formulas exist. This article compares six different readability measures across 150 questions in a self-administered questionnaire, finding notable variation in calculated readability across measures. Some question formats, including those that are part of a battery, require important decisions that have large effects on the estimated readability of survey items. Other question evaluation tools, such as the Question Understanding Aid (QUAID) and the Survey Quality Predictor (SQP), may identify similar problems in questions, making readability measures less useful. We find little overlap between QUAID, SQP, and the readability measures, and little differentiation in the tools’ prediction of item nonresponse rates. Questionnaire designers are encouraged to use multiple question evaluation tools and develop readability measures specifically for survey questions.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42385232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Can Recall Data Be Trusted? Evaluating Reliability of Interview Data on Traditional Multilingualism in Highland Daghestan 召回数据是否可信?达赫斯坦高原传统多语采访数据的可靠性评价
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-10-01 DOI: 10.1177/1525822X221115844
Michael Daniel, Alexey Koshevoy, I. Schurov, N. Dobrushina
In this article, we address the issue of reliability of quantitative data on multilingualism of the past obtained as recall data. More specifically, we investigate whether the interviewees’ assessments of the language repertoires of their late relatives (indirect data) provide results that are quantitatively similar to those obtained from the people of the same age range themselves (direct data). The empirical data we use come from an ongoing field study of traditional multilingualism in Daghestan (Russia). We trained machine learning models to see whether they can detect differences in indirect and direct data. We conclude that our indirect quantitative data on L2 other than Russian are essentially similar to direct data, while there may be a small but systematic underestimation when reporting others’ knowledge of Russian.
在这篇文章中,我们讨论了作为回忆数据获得的过去使用多种语言的定量数据的可靠性问题。更具体地说,我们调查了受访者对其已故亲属语言库的评估(间接数据)是否提供了与同年龄段的人自己获得的结果(直接数据)在数量上相似的结果。我们使用的实证数据来自于正在进行的对达赫斯坦(俄罗斯)传统多语制的实地研究。我们训练了机器学习模型,看看它们是否能够检测间接数据和直接数据的差异。我们得出的结论是,我们关于除俄语以外的第二语言的间接定量数据与直接数据基本相似,而在报告他人对俄语的了解时,可能存在小规模但系统性的低估。
{"title":"Can Recall Data Be Trusted? Evaluating Reliability of Interview Data on Traditional Multilingualism in Highland Daghestan","authors":"Michael Daniel, Alexey Koshevoy, I. Schurov, N. Dobrushina","doi":"10.1177/1525822X221115844","DOIUrl":"https://doi.org/10.1177/1525822X221115844","url":null,"abstract":"In this article, we address the issue of reliability of quantitative data on multilingualism of the past obtained as recall data. More specifically, we investigate whether the interviewees’ assessments of the language repertoires of their late relatives (indirect data) provide results that are quantitatively similar to those obtained from the people of the same age range themselves (direct data). The empirical data we use come from an ongoing field study of traditional multilingualism in Daghestan (Russia). We trained machine learning models to see whether they can detect differences in indirect and direct data. We conclude that our indirect quantitative data on L2 other than Russian are essentially similar to direct data, while there may be a small but systematic underestimation when reporting others’ knowledge of Russian.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48799728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The Issue of Noncompliance in Attention Check Questions: False Positives in Instructed Response Items 注意检查问题的不服从问题:指示反应项目的误报
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2022-09-30 DOI: 10.1177/1525822X221115830
Henning Silber, Joss Roßmann, Tobias Gummer
Attention checks detect inattentiveness by instructing respondents to perform a specific task. However, while respondents may correctly process the task, they may choose to not comply with the instructions. We investigated the issue of noncompliance in attention checks in two web surveys. In Study 1, we measured respondents’ attitudes toward attention checks and their self-reported compliance. In Study 2, we experimentally varied the reasons given to respondents for conducting the attention check. Our results showed that while most respondents understand why attention checks are conducted, a nonnegligible proportion of respondents evaluated them as controlling or annoying. Most respondents passed the attention check; however, among those who failed the test, 61% seem to have failed the task deliberately. These findings reinforce that noncompliance is a serious concern with attention check instruments. The results of our experiment showed that more respondents passed the attention check if a comprehensible reason was given.
注意力检查通过指示受访者执行特定任务来检测注意力不集中。然而,尽管受访者可以正确处理任务,但他们可能会选择不遵守指示。我们在两次网络调查中调查了注意力检查中的违规问题。在研究1中,我们测量了受访者对注意力检查的态度以及他们自我报告的依从性。在研究2中,我们通过实验改变了受访者进行注意力检查的原因。我们的研究结果表明,虽然大多数受访者理解为什么要进行注意力检查,但不可忽略的比例的受访者认为他们控制欲强或令人讨厌。大多数受访者通过了注意力检查;然而,在那些没有通过测试的人中,61%的人似乎是故意不及格的。这些发现强化了不遵守是注意力检查工具的一个严重问题。我们的实验结果表明,如果给出了一个可以理解的原因,更多的受访者通过了注意力检查。
{"title":"The Issue of Noncompliance in Attention Check Questions: False Positives in Instructed Response Items","authors":"Henning Silber, Joss Roßmann, Tobias Gummer","doi":"10.1177/1525822X221115830","DOIUrl":"https://doi.org/10.1177/1525822X221115830","url":null,"abstract":"Attention checks detect inattentiveness by instructing respondents to perform a specific task. However, while respondents may correctly process the task, they may choose to not comply with the instructions. We investigated the issue of noncompliance in attention checks in two web surveys. In Study 1, we measured respondents’ attitudes toward attention checks and their self-reported compliance. In Study 2, we experimentally varied the reasons given to respondents for conducting the attention check. Our results showed that while most respondents understand why attention checks are conducted, a nonnegligible proportion of respondents evaluated them as controlling or annoying. Most respondents passed the attention check; however, among those who failed the test, 61% seem to have failed the task deliberately. These findings reinforce that noncompliance is a serious concern with attention check instruments. The results of our experiment showed that more respondents passed the attention check if a comprehensible reason was given.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2022-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47430637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Field Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1