首页 > 最新文献

Field Methods最新文献

英文 中文
ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting ChatGPTest:利用人工智能进行问卷预测的机遇与警示
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2024-09-14 DOI: 10.1177/1525822x241280574
Francisco Olivos, Minhui Liu
The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers’ judgment in interpreting and implementing AI-generated feedback.
生成式人工智能的飞速发展为加强研究的各个方面开辟了新的途径,其中包括调查问卷的设计和评估。然而,最近的开创性应用并未考虑问卷预测。本文探讨了如何使用 GPT 模型作为调查问卷预测的有用工具,特别是在调查问卷设计的早期阶段。文章以两个应用为例进行说明,建议在人工预试之前将 GPT 反馈作为附加阶段,从而减少连续迭代。文章还强调了研究人员的判断力在解释和实施人工智能生成的反馈中不可或缺的作用。
{"title":"ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting","authors":"Francisco Olivos, Minhui Liu","doi":"10.1177/1525822x241280574","DOIUrl":"https://doi.org/10.1177/1525822x241280574","url":null,"abstract":"The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers’ judgment in interpreting and implementing AI-generated feedback.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What predicts willingness to participate in a follow-up panel study among respondents to a national web/mail survey? 什么能预测在全国网络/邮件调查的受访者中参与后续小组研究的意愿?
IF 1.1 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2024-08-01 Epub Date: 2023-08-09 DOI: 10.1177/1525822x231193311
Htay-Wah Saw, Brady T West, Mick P Couper, William G Axinn

The American Family Health Study (AFHS) collected family health and fertility data from a national probability sample of persons aged 18-49 between September 2021 and May 2022, using web and mail exclusively. In July 2022, we surveyed AFHS respondents and gauged their willingness to become part of a national web panel that would create novel longitudinal data on these topics. We focus on predictors of willingness to participate, identifying the potential selection bias that this type of approach may introduce. We found that efforts of this type to create a national web panel may introduce potential selection bias in estimates based on the panel respondents, with individuals having higher socio-economic status being more cooperative. Thus, alternative recruitment strategies and re-weighting of the subsample may be needed to further reduce selection bias. We present methodological implications of our results, limitations of our approach, and suggestions for further research on this topic.

美国家庭健康研究(AFHS)专门使用网络和邮件,从2021年9月至2022年5月期间18-49岁人群的全国概率样本中收集了家庭健康和生育数据。2022年7月,我们调查了AFHS的受访者,并衡量了他们是否愿意成为国家网络小组的一员,该小组将创建关于这些主题的新颖纵向数据。我们关注参与意愿的预测因素,确定这种方法可能引入的潜在选择偏差。我们发现,建立国家网络小组的这种努力可能会在基于小组受访者的估计中引入潜在的选择偏见,社会经济地位较高的个人更具合作性。因此,可能需要替代招募策略和重新加权子样本,以进一步减少选择偏差。我们提出了我们的研究结果的方法论含义,我们的方法的局限性,以及对进一步研究这一主题的建议。
{"title":"What predicts willingness to participate in a follow-up panel study among respondents to a national web/mail survey?","authors":"Htay-Wah Saw, Brady T West, Mick P Couper, William G Axinn","doi":"10.1177/1525822x231193311","DOIUrl":"10.1177/1525822x231193311","url":null,"abstract":"<p><p>The American Family Health Study (AFHS) collected family health and fertility data from a national probability sample of persons aged 18-49 between September 2021 and May 2022, using web and mail exclusively. In July 2022, we surveyed AFHS respondents and gauged their willingness to become part of a national web panel that would create novel longitudinal data on these topics. We focus on predictors of willingness to participate, identifying the potential selection bias that this type of approach may introduce. We found that efforts of this type to create a national web panel may introduce potential selection bias in estimates based on the panel respondents, with individuals having higher socio-economic status being more cooperative. Thus, alternative recruitment strategies and re-weighting of the subsample may be needed to further reduce selection bias. We present methodological implications of our results, limitations of our approach, and suggestions for further research on this topic.</p>","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11262570/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48213738","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Invited Review: Collecting Data through Dyadic Interviews: A Systematic Review 特邀评论:通过社群访谈收集数据:系统回顾
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2024-07-26 DOI: 10.1177/1525822x241267171
David L. Morgan
This article reports on a systematic review of journal articles that used dyadic interviews, also known as paired or joint interviews. The two basic formats for these interviews involve either interviewing participants separately or together, plus the additional possibility of using both formats in the same study. A search using the Social Science Citations Index yielded 471 articles that reported on such interviews. Of these articles, 38% reported interviewing the dyad members separately, 55% reported interviewing them together, and 7% used both formats. Over 40% reported on interviews of married couples or equivalents, and an additional 30% of the interviews involved other pairs of family members. Less common pairings involved coworkers, patients and providers, or friends. These results indicate an almost unanimous use of dyadic interviews based on pre-existing relationships and family members in particular, with only limited use as a broader interviewing method.
本文报告了对使用二元访谈(又称配对或联合访谈)的期刊文章进行的系统性回顾。这种访谈有两种基本形式,一种是分别访谈参与者,另一种是共同访谈参与者。使用《社会科学引文索引》进行搜索后,发现有 471 篇文章对此类访谈进行了报道。在这些文章中,有 38% 的文章报告了对二人组成员的单独访谈,55% 的文章报告了对二人组成员的共同访谈,7% 的文章同时使用了两种访谈形式。超过 40% 的文章报道了对已婚夫妇或同等成员的访谈,另有 30% 的访谈涉及其他成对的家庭成员。较少见的配对涉及同事、病人和医疗服务提供者或朋友。这些结果表明,基于先前存在的关系和家庭成员的双人访谈几乎得到了一致的使用,而作为一种更广泛的访谈方法的使用则非常有限。
{"title":"Invited Review: Collecting Data through Dyadic Interviews: A Systematic Review","authors":"David L. Morgan","doi":"10.1177/1525822x241267171","DOIUrl":"https://doi.org/10.1177/1525822x241267171","url":null,"abstract":"This article reports on a systematic review of journal articles that used dyadic interviews, also known as paired or joint interviews. The two basic formats for these interviews involve either interviewing participants separately or together, plus the additional possibility of using both formats in the same study. A search using the Social Science Citations Index yielded 471 articles that reported on such interviews. Of these articles, 38% reported interviewing the dyad members separately, 55% reported interviewing them together, and 7% used both formats. Over 40% reported on interviews of married couples or equivalents, and an additional 30% of the interviews involved other pairs of family members. Less common pairings involved coworkers, patients and providers, or friends. These results indicate an almost unanimous use of dyadic interviews based on pre-existing relationships and family members in particular, with only limited use as a broader interviewing method.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141782658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Offering Web Response as a Refusal Conversion Technique in a Mixed-mode Survey 在混合模式调查中提供网络回复作为拒绝转换技术
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2024-07-20 DOI: 10.1177/1525822x241263508
Hafsteinn Einarsson
Survey organizations aiming to improve response rates in the later stages of fieldwork often attempt refusal conversions. However, reestablishing contact with units that have refused participation at prior stages of fieldwork may prove costly and time consuming. In this article, the potential of using a refusal conversion procedure in a single contact is investigated. In a mixed-mode survey of young adults in Iceland, individuals who were contacted by telephone and refused participation were instantly offered the option of self-completing the survey on the web at their time of choice. Results indicate that this procedure can meaningfully improve response rates in a survey of young adults in Iceland. The additional respondents gathered using this procedure were mostly similar to those who responded by using other modes when considering demographic background and responses to survey items.
旨在提高实地调查后期答复率的调查组织通常会尝试对拒绝参与的单位进行转换。然而,与在实地调查前几个阶段拒绝参与调查的单位重新建立联系可能会耗费大量成本和时间。本文研究了在一次接触中使用拒绝转换程序的可能性。在一项针对冰岛青壮年的混合模式调查中,通过电话联系并拒绝参与调查的个人可立即选择在其选择的时间通过网络自行完成调查。结果表明,在对冰岛青壮年进行调查时,这一程序可有效提高回复率。考虑到人口背景和对调查项目的回答,使用该程序收集到的额外受访者大多与使用其他方式的受访者相似。
{"title":"Offering Web Response as a Refusal Conversion Technique in a Mixed-mode Survey","authors":"Hafsteinn Einarsson","doi":"10.1177/1525822x241263508","DOIUrl":"https://doi.org/10.1177/1525822x241263508","url":null,"abstract":"Survey organizations aiming to improve response rates in the later stages of fieldwork often attempt refusal conversions. However, reestablishing contact with units that have refused participation at prior stages of fieldwork may prove costly and time consuming. In this article, the potential of using a refusal conversion procedure in a single contact is investigated. In a mixed-mode survey of young adults in Iceland, individuals who were contacted by telephone and refused participation were instantly offered the option of self-completing the survey on the web at their time of choice. Results indicate that this procedure can meaningfully improve response rates in a survey of young adults in Iceland. The additional respondents gathered using this procedure were mostly similar to those who responded by using other modes when considering demographic background and responses to survey items.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141738905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Network of Categories: A Method to Aggregate Egocentric Network Survey Data into a Whole Network Structure 类别网络:将以自我为中心的网络调查数据汇总为整体网络结构的方法
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2024-07-20 DOI: 10.1177/1525822x241262678
Mireia Bolíbar, Julia Martínez-Ariño, Maria Schiller
We propose a new method for analyzing and visualizing information on a large collection of personal networks to uncover the socio-centric structure of relationships among aggregated actors that we clustered into categories. The network of categories identifies the links between groups of sampled ego actors sharing a given attribute (e.g., “being immigrant organizations”) and abstract attribute-based groups or types of alters (e.g., “any immigrant organization”). This method takes advantage of both whole networks and ego-centered networks analytical approaches since it gains insights into the context’s whole network structure while generalizing the results to a wider population. The method can be applied to data obtained through modified versions of instruments such as position or resource generators, which are easy to collect within standard large- N representative surveys. We present a concrete application of the method to the analysis of immigrant organizations' position in local governance networks in 40 French and German cities.
我们提出了一种分析和可视化大量个人网络信息的新方法,以揭示我们按类别聚类的聚合行动者之间关系的社会中心结构。类别网络可识别具有特定属性(如 "移民组织")的抽样自我行为者群体与基于属性的抽象群体或改变者类型(如 "任何移民组织")之间的联系。这种方法利用了整体网络和以自我为中心的网络分析方法的优势,因为它既能深入了解背景的整体网络结构,又能将结果推广到更广泛的人群中。该方法可应用于通过职位或资源生成器等工具的修改版获得的数据,这些工具很容易在标准的大 N 代表性调查中收集。我们将该方法具体应用于分析法国和德国 40 个城市中移民组织在地方治理网络中的地位。
{"title":"Network of Categories: A Method to Aggregate Egocentric Network Survey Data into a Whole Network Structure","authors":"Mireia Bolíbar, Julia Martínez-Ariño, Maria Schiller","doi":"10.1177/1525822x241262678","DOIUrl":"https://doi.org/10.1177/1525822x241262678","url":null,"abstract":"We propose a new method for analyzing and visualizing information on a large collection of personal networks to uncover the socio-centric structure of relationships among aggregated actors that we clustered into categories. The network of categories identifies the links between groups of sampled ego actors sharing a given attribute (e.g., “being immigrant organizations”) and abstract attribute-based groups or types of alters (e.g., “any immigrant organization”). This method takes advantage of both whole networks and ego-centered networks analytical approaches since it gains insights into the context’s whole network structure while generalizing the results to a wider population. The method can be applied to data obtained through modified versions of instruments such as position or resource generators, which are easy to collect within standard large- N representative surveys. We present a concrete application of the method to the analysis of immigrant organizations' position in local governance networks in 40 French and German cities.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141738906","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing a Modular Survey App Using Co-design Principles 利用协同设计原则开发模块化调查应用程序
IF 1.7 3区 社会学 Q2 ANTHROPOLOGY Pub Date : 2024-06-24 DOI: 10.1177/1525822x241260994
Christopher Antoun, Xin (Rosalynn) Yang, Brady T. West, Ai Rene Ong
The objective of our project was to develop a smartphone app for administering shorter (“modular”) surveys. Given the paucity of research on this topic, we decided to use “co-design” techniques to generate design solutions. To implement these techniques, we recruited respondents in the survey target population to work in small groups and provide design ideas for the app. In this article, we present their input and examine whether we were successful in engaging them to contribute useful ideas. Although participation levels were uneven across the different groups, we found no evidence that group engagement was low overall or declined over the course of the sessions. In addition, the groups generated a diverse set of ideas, some of which informed the final app design. These findings underscore the feasibility of applying co-design principles to survey research, though further investigation is needed with different samples and design topics.
我们项目的目标是开发一款智能手机应用程序,用于管理较短的("模块化")调查。鉴于这方面的研究很少,我们决定使用 "共同设计 "技术来生成设计方案。为了实施这些技术,我们招募了调查目标人群中的受访者,让他们以小组形式工作,为应用程序提供设计思路。在本文中,我们将介绍他们的意见,并探讨我们是否成功地让他们提出了有用的想法。虽然不同小组的参与程度参差不齐,但我们没有发现任何证据表明小组的整体参与度不高或在会议过程中参与度下降。此外,各小组还提出了各种各样的想法,其中一些为最终的应用程序设计提供了参考。这些发现强调了将共同设计原则应用于调查研究的可行性,尽管还需要对不同的样本和设计主题进行进一步的调查。
{"title":"Developing a Modular Survey App Using Co-design Principles","authors":"Christopher Antoun, Xin (Rosalynn) Yang, Brady T. West, Ai Rene Ong","doi":"10.1177/1525822x241260994","DOIUrl":"https://doi.org/10.1177/1525822x241260994","url":null,"abstract":"The objective of our project was to develop a smartphone app for administering shorter (“modular”) surveys. Given the paucity of research on this topic, we decided to use “co-design” techniques to generate design solutions. To implement these techniques, we recruited respondents in the survey target population to work in small groups and provide design ideas for the app. In this article, we present their input and examine whether we were successful in engaging them to contribute useful ideas. Although participation levels were uneven across the different groups, we found no evidence that group engagement was low overall or declined over the course of the sessions. In addition, the groups generated a diverse set of ideas, some of which informed the final app design. These findings underscore the feasibility of applying co-design principles to survey research, though further investigation is needed with different samples and design topics.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141532494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Nolan Index: An R Program for Calculating List Resemblances 诺兰索引计算列表相似度的 R 程序
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2024-05-28 DOI: 10.1177/1525822x241252220
Michael C. Robbins, Zhuping (Zoe) Li
The Nolan Index (NI) is a normed, quantitative measure for comparing the degree of resemblance (similarity or dissimilarity) between free listings with an Excel program for calculating it. This article enhances that effort with the addition of an R program and additional applications. Free-list resemblance measures have been used to investigate and compare historical and cultural connections, ecological relationships, cultural item utilities, practices, knowledge, and values both within and between various groups. Their utility for cultural domain analysis and the theory of cognitive cultural models is also considered.
诺兰指数(Nolan Index,NI)是一种标准化的定量测量方法,用于比较免费列表之间的相似程度(相似性或不相似性),并附有一个 Excel 计算程序。本文增加了一个 R 程序和其他应用,进一步加强了这一功能。自由列表相似度测量方法已被用于研究和比较不同群体内部和群体之间的历史和文化联系、生态关系、文化项目效用、习俗、知识和价值观。此外,还考虑了它们在文化领域分析和认知文化模型理论方面的实用性。
{"title":"The Nolan Index: An R Program for Calculating List Resemblances","authors":"Michael C. Robbins, Zhuping (Zoe) Li","doi":"10.1177/1525822x241252220","DOIUrl":"https://doi.org/10.1177/1525822x241252220","url":null,"abstract":"The Nolan Index (NI) is a normed, quantitative measure for comparing the degree of resemblance (similarity or dissimilarity) between free listings with an Excel program for calculating it. This article enhances that effort with the addition of an R program and additional applications. Free-list resemblance measures have been used to investigate and compare historical and cultural connections, ecological relationships, cultural item utilities, practices, knowledge, and values both within and between various groups. Their utility for cultural domain analysis and the theory of cognitive cultural models is also considered.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141169857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Photovoice: Methodological Insights From a Multi-site Online Design 摄影声音:多站点在线设计的方法论启示
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2024-05-16 DOI: 10.1177/1525822x241244421
Michelle C. Pasco, A. Roque, Brittany Romanello, Emir Estrada
Photovoice involves respondents taking photographs of their environment to promote critical discussions and reflect on their experiences. Photovoice empowers marginalized communities and serves to reach policymakers. The Arizona Youth Identity Project (AZYIP) used photovoice with an innovative approach in a multisite research design with a large sample size and completely online research implementation using video conferencing, mobile phones, and video messages. We outline our process for other researchers interested in utilizing this dynamic method. We also reflect on the challenges and opportunities of engaging in this research design for future projects.
摄影荐言涉及受访者拍摄其所处环境的照片,以促进批判性讨论并反思其经历。Photovoice 增强了边缘化社区的能力,并有助于接触政策制定者。亚利桑那州青年身份认同项目(AZYIP)在多地点研究设计中采用了创新方法,使用视频会议、手机和视频信息进行了大量样本和完全在线的研究实施。我们为有兴趣使用这种动态方法的其他研究人员概述了我们的过程。此外,我们还对未来项目中采用这种研究设计所面临的挑战和机遇进行了反思。
{"title":"Photovoice: Methodological Insights From a Multi-site Online Design","authors":"Michelle C. Pasco, A. Roque, Brittany Romanello, Emir Estrada","doi":"10.1177/1525822x241244421","DOIUrl":"https://doi.org/10.1177/1525822x241244421","url":null,"abstract":"Photovoice involves respondents taking photographs of their environment to promote critical discussions and reflect on their experiences. Photovoice empowers marginalized communities and serves to reach policymakers. The Arizona Youth Identity Project (AZYIP) used photovoice with an innovative approach in a multisite research design with a large sample size and completely online research implementation using video conferencing, mobile phones, and video messages. We outline our process for other researchers interested in utilizing this dynamic method. We also reflect on the challenges and opportunities of engaging in this research design for future projects.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140969174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lexical Similarity in Grid Questions: An Experiment of the Effect of “Same Leading” on Respondent Behaviors 网格问题中的词汇相似性:相同引导 "对应答者行为的影响实验
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2024-05-11 DOI: 10.1177/1525822x241247441
Chan Zhang, Shuaiying Cao, Minglei Wang, Jiangyan Wang, Lirui He
Previous research on grid questions has mostly focused on their comparability with the item-by-item method and the use of shading to help respondents navigate through a grid. This study extends prior work by examining whether lexical similarity among grid items affects how respondents answer the questions in an experiment where we manipulated lexical similarity by adding the same leading phrase to the items in a grid (“same leading” condition). Both interpretative heuristics and survey satisficing theory suggest that such a design could increase non-differentiated answers. Based on an experiment using respondents from a Chinese opt-in panel ( n = 2,000+), we confirmed more non-differentiation in the same leading condition (than the control) for low-education respondents, while the effects were not significant for the others. This study adds to the literature that incidental survey design features can make an impact and highlights the need for more research into the effects of wording styles.
之前关于网格问题的研究主要集中在网格问题与逐项法的可比性,以及使用阴影帮助受访者浏览网格。本研究对之前的研究进行了扩展,在一项实验中,我们通过在网格项目中添加相同的引导短语("相同引导 "条件)来操纵词汇的相似性,从而考察了网格项目之间的词汇相似性是否会影响受访者对问题的回答。解释启发法和调查满意度理论都表明,这种设计可能会增加无差异答案。基于一项使用中国选入小组受访者(n = 2,000+ )进行的实验,我们证实在同一引导条件下(比对照组),低学历受访者的无差异程度更高,而对其他受访者的影响并不显著。这项研究补充了偶然的调查设计特征会产生影响的文献,并强调了对措辞风格的影响进行更多研究的必要性。
{"title":"Lexical Similarity in Grid Questions: An Experiment of the Effect of “Same Leading” on Respondent Behaviors","authors":"Chan Zhang, Shuaiying Cao, Minglei Wang, Jiangyan Wang, Lirui He","doi":"10.1177/1525822x241247441","DOIUrl":"https://doi.org/10.1177/1525822x241247441","url":null,"abstract":"Previous research on grid questions has mostly focused on their comparability with the item-by-item method and the use of shading to help respondents navigate through a grid. This study extends prior work by examining whether lexical similarity among grid items affects how respondents answer the questions in an experiment where we manipulated lexical similarity by adding the same leading phrase to the items in a grid (“same leading” condition). Both interpretative heuristics and survey satisficing theory suggest that such a design could increase non-differentiated answers. Based on an experiment using respondents from a Chinese opt-in panel ( n = 2,000+), we confirmed more non-differentiation in the same leading condition (than the control) for low-education respondents, while the effects were not significant for the others. This study adds to the literature that incidental survey design features can make an impact and highlights the need for more research into the effects of wording styles.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140987307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Psychometric Network Analysis Approach for Detecting Item Wording Effects in Self-report Measures across Subgroups 跨小群体自我报告测量中检测项目措辞效应的心理测量网络分析方法
IF 1.7 3区 社会学 Q1 Social Sciences Pub Date : 2024-05-11 DOI: 10.1177/1525822x241247444
H. Cigdem Bulut, Okan Bulut, Ashley Clelland
In this study, we explored psychometric network analysis (PNA) as an alternative method for identifying item wording effects in self-report instruments. We examined the functioning of negatively worded items in the network structures of two math-related scales from the 2019 Trends in International Mathematics and Science Study (TIMSS); Students Like Learning in Mathematics (SLLM); and Students Confident in Mathematics (SCM). We also explored how the negatively worded items functioned in network structures across demographic subgroups. Data were drawn from eight countries that represented diverse levels of math performance and cultural attitudes toward school ( n = 75,972). We found that negatively worded items were distinct from the positively worded items in the SLLM and SCM item networks, and that this effect was consistent across all age- and country-level subgroups. Based on these findings, we recommend PNA as a data-driven approach for detecting wording effects effectively.
在本研究中,我们探索了心理测量网络分析(PNA),将其作为识别自我报告工具中项目措辞效应的另一种方法。我们考察了 2019 年国际数学与科学研究趋势(TIMSS)中两个与数学相关的量表--"学生喜欢学习数学"(SLLM)和 "学生对数学有信心"(SCM)的网络结构中消极措辞项目的功能。我们还探讨了消极措辞的项目如何在不同人口亚群的网络结构中发挥作用。数据来自八个国家,代表了不同的数学成绩水平和对学校的文化态度(n = 75972)。我们发现,在 SLLM 和 SCM 项目网络中,消极措辞的项目与积极措辞的项目截然不同,而且这种效应在所有年龄和国家级别的亚组中都是一致的。基于这些发现,我们建议将 PNA 作为有效检测措辞效应的数据驱动方法。
{"title":"A Psychometric Network Analysis Approach for Detecting Item Wording Effects in Self-report Measures across Subgroups","authors":"H. Cigdem Bulut, Okan Bulut, Ashley Clelland","doi":"10.1177/1525822x241247444","DOIUrl":"https://doi.org/10.1177/1525822x241247444","url":null,"abstract":"In this study, we explored psychometric network analysis (PNA) as an alternative method for identifying item wording effects in self-report instruments. We examined the functioning of negatively worded items in the network structures of two math-related scales from the 2019 Trends in International Mathematics and Science Study (TIMSS); Students Like Learning in Mathematics (SLLM); and Students Confident in Mathematics (SCM). We also explored how the negatively worded items functioned in network structures across demographic subgroups. Data were drawn from eight countries that represented diverse levels of math performance and cultural attitudes toward school ( n = 75,972). We found that negatively worded items were distinct from the positively worded items in the SLLM and SCM item networks, and that this effect was consistent across all age- and country-level subgroups. Based on these findings, we recommend PNA as a data-driven approach for detecting wording effects effectively.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140925066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Field Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1