首页 > 最新文献

Organizational Research Methods最新文献

英文 中文
Five Is the Brightest Star. But by how Much? Testing the Equidistance of Star Ratings in Online Reviews 五是最亮的星。但有多亮?测试在线评论中星级评定的等距性
IF 9.5 2区 管理学 Q1 MANAGEMENT Pub Date : 2024-01-08 DOI: 10.1177/10944281231223412
Balázs Kovács
Organizational research increasingly relies on online review data to gauge perceived valuation and reputation of organizations and products. Online review platforms typically collect ordinal ratings (e.g., 1 to 5 stars); however, researchers often treat them as a cardinal data, calculating aggregate statistics such as the average, the median, or the variance of ratings. In calculating these statistics, ratings are implicitly assumed to be equidistant. We test whether star ratings are equidistant using reviews from two large-scale online review platforms: Amazon.com and Yelp.com. We develop a deep learning framework to analyze the text of the reviews in order to assess their overall valuation. We find that 4 and 5-star ratings, as well as 1 and 2-star ratings, are closer to each other than 3-star ratings are to 2 and 4-star ratings. An additional online experiment corroborates this pattern. Using simulations, we show that the distortion by non-equidistant ratings is especially harmful in cases when organizations receive only a few reviews and when researchers are interested in estimating variance effects. We discuss potential solutions to solve the issue with rating non-equidistance.
组织研究越来越依赖于在线评论数据来衡量组织和产品的认知价值和声誉。在线评论平台通常收集的是序数评分(如 1 到 5 星);然而,研究人员通常将其视为心数数据,计算平均值、中位数或评分方差等综合统计数据。在计算这些统计数据时,评级被隐含地假定为等距的。我们使用两个大型在线评论平台的评论来检验星级评分是否等距:亚马逊和 Yelp.com。我们开发了一个深度学习框架来分析评论文本,以评估其整体价值。我们发现,4 星和 5 星评价以及 1 星和 2 星评价之间的距离比 3 星和 2 星以及 4 星评价之间的距离更近。另外一项在线实验也证实了这一模式。通过模拟实验,我们发现当组织只收到几条评论时,当研究人员对估计方差效应感兴趣时,非等距评分的失真尤其有害。我们讨论了解决非等距评分问题的潜在方案。
{"title":"Five Is the Brightest Star. But by how Much? Testing the Equidistance of Star Ratings in Online Reviews","authors":"Balázs Kovács","doi":"10.1177/10944281231223412","DOIUrl":"https://doi.org/10.1177/10944281231223412","url":null,"abstract":"Organizational research increasingly relies on online review data to gauge perceived valuation and reputation of organizations and products. Online review platforms typically collect ordinal ratings (e.g., 1 to 5 stars); however, researchers often treat them as a cardinal data, calculating aggregate statistics such as the average, the median, or the variance of ratings. In calculating these statistics, ratings are implicitly assumed to be equidistant. We test whether star ratings are equidistant using reviews from two large-scale online review platforms: Amazon.com and Yelp.com. We develop a deep learning framework to analyze the text of the reviews in order to assess their overall valuation. We find that 4 and 5-star ratings, as well as 1 and 2-star ratings, are closer to each other than 3-star ratings are to 2 and 4-star ratings. An additional online experiment corroborates this pattern. Using simulations, we show that the distortion by non-equidistant ratings is especially harmful in cases when organizations receive only a few reviews and when researchers are interested in estimating variance effects. We discuss potential solutions to solve the issue with rating non-equidistance.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"22 12","pages":""},"PeriodicalIF":9.5,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139446588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The VIF Score. What is it Good For? Absolutely Nothing VIF 分数。有什么用?没什么用
IF 9.5 2区 管理学 Q1 MANAGEMENT Pub Date : 2023-12-13 DOI: 10.1177/10944281231216381
Arturs Kalnins, Kendall Praitis Hill
Variance inflation factors (VIF scores) are regression diagnostics commonly invoked throughout the social sciences. Researchers typically take the perspective that VIF scores below a numerical rule-of-thumb threshold act as a “silver bullet” to dismiss any and all multicollinearity concerns. Yet, no valid logical basis exists for using VIF thresholds to reject the possibility of multicollinearity-induced type 1 errors. Reporting VIF scores below a threshold does not in any way add to the credibility of statistically significant results among correlated variables. In contrast to this “threshold perspective,” our analysis expands the scope of a perspective that has considered multicollinearity and misspecification. We demonstrate analytically that a regression omitting a relevant variable correlated with included variables that exhibit multicollinearity is susceptible to endogeneity-induced bias inflation and beta polarization, leading to the possible co-existence of type 1 errors and low VIF scores. Further, omitting variables explicitly reduces VIF scores. We conclude that the threshold perspective not only lacks any logical basis but also is fundamentally misleading as a rule-of-thumb. Instrumental variables represent one clear remedy for endogeneity-induced bias inflation. If exogenous instruments are unavailable, we encourage researchers to test only straightforward, unambiguous theory when using variables that exhibit multicollinearity, and to ensure that correlated co-variates exhibit the expected signs.
方差膨胀因子(VIF 分值)是社会科学领域常用的回归诊断方法。研究人员通常认为,VIF 分数低于某个数字规则阈值,就可以作为 "灵丹妙药 "来排除所有多重共线性问题。然而,使用 VIF 临界值来排除多重共线性引起的 1 类错误的可能性并不存在有效的逻辑依据。报告低于阈值的 VIF 分数丝毫不会增加相关变量统计意义结果的可信度。与这种 "临界值视角 "不同,我们的分析扩大了考虑多重共线性和规格错误的视角的范围。我们通过分析表明,如果回归中省略了与表现出多重共线性的包含变量相关的相关变量,就很容易出现由内生因素引起的偏差膨胀和贝塔极化,从而导致 1 类错误和低 VIF 分数可能同时存在。此外,明确省略变量可降低 VIF 分数。我们的结论是,阈值观点不仅缺乏逻辑基础,而且作为一种经验法则从根本上具有误导性。工具变量是解决内生性偏差膨胀的一种有效方法。如果没有外生工具,我们鼓励研究人员在使用表现出多重共线性的变量时,只对直接、明确的理论进行检验,并确保相关共变量表现出预期的符号。
{"title":"The VIF Score. What is it Good For? Absolutely Nothing","authors":"Arturs Kalnins, Kendall Praitis Hill","doi":"10.1177/10944281231216381","DOIUrl":"https://doi.org/10.1177/10944281231216381","url":null,"abstract":"Variance inflation factors (VIF scores) are regression diagnostics commonly invoked throughout the social sciences. Researchers typically take the perspective that VIF scores below a numerical rule-of-thumb threshold act as a “silver bullet” to dismiss any and all multicollinearity concerns. Yet, no valid logical basis exists for using VIF thresholds to reject the possibility of multicollinearity-induced type 1 errors. Reporting VIF scores below a threshold does not in any way add to the credibility of statistically significant results among correlated variables. In contrast to this “threshold perspective,” our analysis expands the scope of a perspective that has considered multicollinearity and misspecification. We demonstrate analytically that a regression omitting a relevant variable correlated with included variables that exhibit multicollinearity is susceptible to endogeneity-induced bias inflation and beta polarization, leading to the possible co-existence of type 1 errors and low VIF scores. Further, omitting variables explicitly reduces VIF scores. We conclude that the threshold perspective not only lacks any logical basis but also is fundamentally misleading as a rule-of-thumb. Instrumental variables represent one clear remedy for endogeneity-induced bias inflation. If exogenous instruments are unavailable, we encourage researchers to test only straightforward, unambiguous theory when using variables that exhibit multicollinearity, and to ensure that correlated co-variates exhibit the expected signs.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"24 4","pages":""},"PeriodicalIF":9.5,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139005307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Qualitative Restudies: Research Designs for Retheorizing 定性再研究:重新理论化的研究设计
IF 9.5 2区 管理学 Q1 MANAGEMENT Pub Date : 2023-12-03 DOI: 10.1177/10944281231216323
T. Köhler, Maria N. Rumyantseva, Catherine Welch
Qualitative research methods are deemed best suited to exploring novel phenomena and generating new concepts. Their potential to reevaluate existing theorizing, however, is underestimated. Qualitative restudies that return to the data and settings on which the original theories were built are a well-established tradition in other disciplines (e.g., history, sociology, and anthropology), but have received little recognition in management and organization studies. We introduce qualitative restudies as a powerful means to improve theorizing by revising or challenging theories that have become outdated or obsolete and establishing transferability and longevity of findings and interpretations. We provide a typology of qualitative restudy designs drawing on an integrative review of literature in management, strategy, and the social sciences and humanities. We highlight the main design and ethical considerations for researchers in undertaking a restudy. We argue for the strengths of restudies as lying in their possibilities for retheorizing, above and beyond verifying or updating prior studies. Restudies draw on the strengths of in-depth qualitative work to uncover how interpretations and theorizing are shaped by methodological traditions, historical contexts, existing societal structures, and researcher backgrounds.
定性研究方法被认为最适合探索新现象和产生新概念。然而,他们重新评估现有理论的潜力被低估了。在其他学科(如历史学、社会学和人类学)中,回归原始理论所依据的数据和背景的定性再研究是一个公认的传统,但在管理和组织研究中却很少得到认可。我们引入定性再研究作为一种强有力的手段,通过修订或挑战已经过时或过时的理论,并建立发现和解释的可转移性和持久性,来改进理论。我们提供了一种定性再研究设计的类型学,借鉴了管理、战略、社会科学和人文科学方面的综合文献综述。我们强调了研究人员在进行重新研究时的主要设计和伦理考虑。我们认为,再研究的优势在于,它们可以在验证或更新先前研究的基础上,重新理论化。再研究利用深入的定性工作的优势,揭示解释和理论化是如何被方法论传统、历史背景、现有社会结构和研究人员背景所塑造的。
{"title":"Qualitative Restudies: Research Designs for Retheorizing","authors":"T. Köhler, Maria N. Rumyantseva, Catherine Welch","doi":"10.1177/10944281231216323","DOIUrl":"https://doi.org/10.1177/10944281231216323","url":null,"abstract":"Qualitative research methods are deemed best suited to exploring novel phenomena and generating new concepts. Their potential to reevaluate existing theorizing, however, is underestimated. Qualitative restudies that return to the data and settings on which the original theories were built are a well-established tradition in other disciplines (e.g., history, sociology, and anthropology), but have received little recognition in management and organization studies. We introduce qualitative restudies as a powerful means to improve theorizing by revising or challenging theories that have become outdated or obsolete and establishing transferability and longevity of findings and interpretations. We provide a typology of qualitative restudy designs drawing on an integrative review of literature in management, strategy, and the social sciences and humanities. We highlight the main design and ethical considerations for researchers in undertaking a restudy. We argue for the strengths of restudies as lying in their possibilities for retheorizing, above and beyond verifying or updating prior studies. Restudies draw on the strengths of in-depth qualitative work to uncover how interpretations and theorizing are shaped by methodological traditions, historical contexts, existing societal structures, and researcher backgrounds.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"36 23","pages":""},"PeriodicalIF":9.5,"publicationDate":"2023-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138605211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Vector Space Approach for Measuring Relationality and Multidimensionality of Meaning in Large Text Collections 基于向量空间的大型文本集意义相关性和多维度度量方法
2区 管理学 Q1 MANAGEMENT Pub Date : 2023-11-13 DOI: 10.1177/10944281231213068
Philipp Poschmann, Jan Goldenstein, Sven Büchel, Udo Hahn
In this article, we develop a methodological approach for organizational research regarding the construction of multidimensional and relational similarity measures by using the vector space model in natural language processing (NLP). Our vector space approach draws on the well-established premise in organizational research that texts provide a window into social reality and allow measuring theory-based constructs ( e.g., organizations’ self-representations). Using a vector space approach allows capturing the multidimensionality of these theory-based constructs and computing relational similarities between organizational entities ( e.g., organizations, their members, and subunits) in social spaces and with their environments, such as the organization itself, industries, or countries. Thus, our methodological approach contributes to the recent trend in organizational research to use the potential inherent in big (textual) data by using NLP. In an example, we provide guidance for organizational scholars by illustrating how they can ensure validity when applying our methodological contribution in concrete research practice.
在本文中,我们利用自然语言处理(NLP)中的向量空间模型,开发了一种方法方法,用于组织研究有关多维和关系相似性度量的构建。我们的向量空间方法借鉴了组织研究中公认的前提,即文本提供了一个了解社会现实的窗口,并允许测量基于理论的结构(例如,组织的自我表征)。使用向量空间方法可以捕获这些基于理论的结构的多维度,并计算社会空间中的组织实体(例如,组织、其成员和子单位)及其环境(例如组织本身、行业或国家)之间的关系相似性。因此,我们的方法论方法有助于组织研究的最新趋势,即通过使用NLP来利用大(文本)数据中固有的潜力。在一个例子中,我们通过说明他们如何在具体研究实践中应用我们的方法贡献时确保有效性,为组织学者提供指导。
{"title":"A Vector Space Approach for Measuring Relationality and Multidimensionality of Meaning in Large Text Collections","authors":"Philipp Poschmann, Jan Goldenstein, Sven Büchel, Udo Hahn","doi":"10.1177/10944281231213068","DOIUrl":"https://doi.org/10.1177/10944281231213068","url":null,"abstract":"In this article, we develop a methodological approach for organizational research regarding the construction of multidimensional and relational similarity measures by using the vector space model in natural language processing (NLP). Our vector space approach draws on the well-established premise in organizational research that texts provide a window into social reality and allow measuring theory-based constructs ( e.g., organizations’ self-representations). Using a vector space approach allows capturing the multidimensionality of these theory-based constructs and computing relational similarities between organizational entities ( e.g., organizations, their members, and subunits) in social spaces and with their environments, such as the organization itself, industries, or countries. Thus, our methodological approach contributes to the recent trend in organizational research to use the potential inherent in big (textual) data by using NLP. In an example, we provide guidance for organizational scholars by illustrating how they can ensure validity when applying our methodological contribution in concrete research practice.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"131 17","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136351297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Quotes to Present Claims: Practices for the Writing Stages of Qualitative Research 使用引用来表达主张:定性研究写作阶段的实践
2区 管理学 Q1 MANAGEMENT Pub Date : 2023-11-09 DOI: 10.1177/10944281231210558
Kevin W. Rockmann, Heather C. Vough
While there has been a great deal of guidance on qualitative research methodology, such scholarship has focused almost exclusively on the first three parts of the qualitative process: study design, data gathering, and coding/analysis. We suggest that writing findings is a fourth stage that involves pre-writing and composing. Our intent is to provide practices for this phase for those who are using qualitative data as the evidentiary basis for their claims. The pre-writing phase is strengthened by structuring claims and storyboarding findings, while the composing phase is improved by critically evaluating how to insert the author's voice. Practices surrounding qualitative writing are discussed, such as which quotes to include, where to place quotes, and how to edit quotes. Annotated examples are also provided that show both recommended and nonrecommended ways of inserting the author's voice into a findings section. A sample structure for writing a claim—a claim table—and a sample storyboard are provided.
虽然有很多关于定性研究方法的指导,但这些学术研究几乎完全集中在定性过程的前三个部分:研究设计、数据收集和编码/分析。我们认为写作发现是第四个阶段,包括写作前和作曲。我们的目的是为那些使用定性数据作为其主张的证据基础的人提供这一阶段的实践。写作前阶段通过构建要求和故事板的发现得到加强,而写作阶段通过批判性地评估如何插入作者的声音来改进。讨论了围绕定性写作的实践,例如包括哪些引用,在哪里放置引用,以及如何编辑引用。还提供了带注释的示例,展示了将作者的声音插入发现部分的推荐和不推荐的方法。提供了一个编写声明的示例结构——声明表和一个示例故事板。
{"title":"Using Quotes to Present Claims: Practices for the Writing Stages of Qualitative Research","authors":"Kevin W. Rockmann, Heather C. Vough","doi":"10.1177/10944281231210558","DOIUrl":"https://doi.org/10.1177/10944281231210558","url":null,"abstract":"While there has been a great deal of guidance on qualitative research methodology, such scholarship has focused almost exclusively on the first three parts of the qualitative process: study design, data gathering, and coding/analysis. We suggest that writing findings is a fourth stage that involves pre-writing and composing. Our intent is to provide practices for this phase for those who are using qualitative data as the evidentiary basis for their claims. The pre-writing phase is strengthened by structuring claims and storyboarding findings, while the composing phase is improved by critically evaluating how to insert the author's voice. Practices surrounding qualitative writing are discussed, such as which quotes to include, where to place quotes, and how to edit quotes. Annotated examples are also provided that show both recommended and nonrecommended ways of inserting the author's voice into a findings section. A sample structure for writing a claim—a claim table—and a sample storyboard are provided.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":" 26","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135243107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Publishing Registered Reports in Management and Applied Psychology: Common Beliefs and Best Practices 出版注册报告管理和应用心理学:共同信念和最佳实践
2区 管理学 Q1 MANAGEMENT Pub Date : 2023-11-07 DOI: 10.1177/10944281231210309
Roman Briker, Fabiola H. Gerpott
Management and applied psychology scholars are confronted with a crisis undermining trust in their findings. One solution to this crisis is the publication format Registered Reports (RRs). Here, authors submit the frontend of their paper for peer review before data collection. While this format can help increase the trustworthiness of research, authors’ usage of RRs—although emerging—has been scarce and scattered. Eventually, common beliefs regarding the (dis)advantages of RRs and a lack of best practices can limit the broad implementation of this approach. To address these issues, we utilized a systematic review process to identify 50 RRs in management and applied psychology and surveyed authors with ( N = 86) and without experience ( N = 161) in publishing RRs and reviewers/editors who have handled RRs ( N = 59). On this basis, we (a) scrutinize prevalent beliefs surrounding the RR format in the fields of management and applied psychology and (b) derive hands-on best practices. In sum, we provide a fact check and guidelines for authors interested in writing RRs, which can also be used by reviewers to evaluate such submissions.
管理和应用心理学学者正面临着一场危机,人们对他们的研究结果的信任正在减弱。解决这一危机的一种方法是使用已注册报告(rs)的发布格式。在这里,作者在收集数据之前提交论文的前端供同行评审。虽然这种格式有助于提高研究的可信度,但作者对rrr的使用——尽管刚刚出现——是稀缺和分散的。最终,对rr(不)优点的普遍看法和缺乏最佳实践会限制这种方法的广泛实现。为了解决这些问题,我们利用系统评价过程确定了管理和应用心理学领域的50个rr,并调查了有(N = 86)和没有发表rr经验(N = 161)的作者以及处理过rr的审稿人/编辑(N = 59)。在此基础上,我们(a)仔细研究管理和应用心理学领域中围绕RR格式的流行信念,(b)得出实践最佳实践。总之,我们为有兴趣撰写rr的作者提供了一个事实检查和指导方针,它也可以被审稿人用来评估这些提交。
{"title":"Publishing Registered Reports in Management and Applied Psychology: Common Beliefs and Best Practices","authors":"Roman Briker, Fabiola H. Gerpott","doi":"10.1177/10944281231210309","DOIUrl":"https://doi.org/10.1177/10944281231210309","url":null,"abstract":"Management and applied psychology scholars are confronted with a crisis undermining trust in their findings. One solution to this crisis is the publication format Registered Reports (RRs). Here, authors submit the frontend of their paper for peer review before data collection. While this format can help increase the trustworthiness of research, authors’ usage of RRs—although emerging—has been scarce and scattered. Eventually, common beliefs regarding the (dis)advantages of RRs and a lack of best practices can limit the broad implementation of this approach. To address these issues, we utilized a systematic review process to identify 50 RRs in management and applied psychology and surveyed authors with ( N = 86) and without experience ( N = 161) in publishing RRs and reviewers/editors who have handled RRs ( N = 59). On this basis, we (a) scrutinize prevalent beliefs surrounding the RR format in the fields of management and applied psychology and (b) derive hands-on best practices. In sum, we provide a fact check and guidelines for authors interested in writing RRs, which can also be used by reviewers to evaluate such submissions.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135480381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The Generalized Thurstonian Unfolding Model (GTUM): Advancing the Modeling of Forced-Choice Data 广义瑟斯顿展开模型(GTUM):推进强迫选择数据的建模
2区 管理学 Q1 MANAGEMENT Pub Date : 2023-11-01 DOI: 10.1177/10944281231210481
Bo Zhang, Naidan Tu, Lawrence Angrave, Susu Zhang, Tianjun Sun, Louis Tay, Jian Li
Forced-choice (FC) measurement has become increasingly popular due to its robustness to various response biases and reduced susceptibility to faking. Although several current Item Response Theory (IRT) models can extract normative person scores from FC responses, each has its limitations. This study proposes the Generalized Thurstonian Unfolding Model (GTUM) as a more flexible IRT model for FC measures to overcome these limitations. The GTUM (1) adheres to the unfolding response process, (2) accommodates FC scales of any block size, and (3) manages both dichotomous and graded responses. Monte Carlo simulation studies consistently demonstrated that the GTUM exhibited good statistical properties under most realistic conditions. Particularly noteworthy findings include (1) the GTUM's ability to handle FC scales with or without intermediate statements, (2) the consistently superior performance of graded responses over dichotomous responses in person score recovery, and (3) the sufficiency of 10 mixed pairs to ensure robust psychometric performance. Two empirical examples, one with 1,033 responses to a static version of the Tailored Adaptative Personality Assessment System and the other with 759 responses to a graded version of the Forced-Choice Five-Factor Markers, demonstrated the feasibility of the GTUM to handle different types of FC scales. To aid in the practical use of the GTUM, we also developed the R package “ fcscoring.”
强迫选择(FC)测量由于其对各种反应偏差的鲁棒性和对伪造的敏感性降低而越来越受欢迎。虽然目前有几个项目反应理论(IRT)模型可以从FC反应中提取出规范的人得分,但每个模型都有其局限性。本研究提出广义瑟斯顿展开模型(GTUM)作为FC措施的更灵活的IRT模型来克服这些局限性。GTUM(1)遵循展开响应过程,(2)适应任何块大小的FC尺度,以及(3)管理二分类和分级响应。蒙特卡罗模拟研究一致表明,GTUM在大多数实际条件下都具有良好的统计性能。特别值得注意的发现包括:(1)GTUM在有或没有中间陈述的情况下处理FC量表的能力,(2)分级反应在个人得分恢复方面始终优于二分反应的表现,以及(3)10个混合对的充分性,以确保稳健的心理测量表现。两个实证例子,一个是对静态版本的量身定制适应人格评估系统有1033个反应,另一个是对分级版本的强迫选择五因素标记有759个反应,证明了GTUM处理不同类型FC量表的可行性。为了帮助实际使用GTUM,我们还开发了R包“fcscoring”。
{"title":"The Generalized Thurstonian Unfolding Model (GTUM): Advancing the Modeling of Forced-Choice Data","authors":"Bo Zhang, Naidan Tu, Lawrence Angrave, Susu Zhang, Tianjun Sun, Louis Tay, Jian Li","doi":"10.1177/10944281231210481","DOIUrl":"https://doi.org/10.1177/10944281231210481","url":null,"abstract":"Forced-choice (FC) measurement has become increasingly popular due to its robustness to various response biases and reduced susceptibility to faking. Although several current Item Response Theory (IRT) models can extract normative person scores from FC responses, each has its limitations. This study proposes the Generalized Thurstonian Unfolding Model (GTUM) as a more flexible IRT model for FC measures to overcome these limitations. The GTUM (1) adheres to the unfolding response process, (2) accommodates FC scales of any block size, and (3) manages both dichotomous and graded responses. Monte Carlo simulation studies consistently demonstrated that the GTUM exhibited good statistical properties under most realistic conditions. Particularly noteworthy findings include (1) the GTUM's ability to handle FC scales with or without intermediate statements, (2) the consistently superior performance of graded responses over dichotomous responses in person score recovery, and (3) the sufficiency of 10 mixed pairs to ensure robust psychometric performance. Two empirical examples, one with 1,033 responses to a static version of the Tailored Adaptative Personality Assessment System and the other with 759 responses to a graded version of the Forced-Choice Five-Factor Markers, demonstrated the feasibility of the GTUM to handle different types of FC scales. To aid in the practical use of the GTUM, we also developed the R package “ fcscoring.”","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"29 9-10","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135272455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Time Dependence in the Cox Proportional Hazard Model as a Theory Development Opportunity: A Step-by-Step Guide 作为理论发展机会的Cox比例风险模型中的时间依赖性:一步一步的指南
2区 管理学 Q1 MANAGEMENT Pub Date : 2023-10-11 DOI: 10.1177/10944281231205027
Hyun-Soo Woo, Jisun Kim, Albert A. Cannella
The Cox proportional hazard model has often been used for survival analysis in organizational research. The Cox model needs to satisfy one critical assumption—time independence—that the effects of independent variables are constant over survival time (also known as the proportional hazard assumption). However, organizational research often encounters time dependence in the Cox model. Organizational studies have traditionally seemed to view time dependence as an empirical nuisance, but we highlight that it is also a theory-development opportunity. Indeed, from our review of AMJ and SMJ papers published in a recent 10-year period, we found that researchers rarely considered time dependence as a theory-development opportunity, and worse, many of them did not test for (or report tests for) time dependence. The purpose of our study is to change this pattern. To this end, we provide a step-by-step guide to facilitate testing for time dependence and using time dependence as a theory development opportunity. We also demonstrate our step-by-step guide with an empirical example.
在组织研究中,Cox比例风险模型常用于生存分析。Cox模型需要满足一个关键的假设——时间独立性——即自变量的影响在生存时间内是恒定的(也称为比例风险假设)。然而,在Cox模型中,组织研究经常遇到时间依赖问题。组织研究传统上似乎将时间依赖性视为经验上的麻烦,但我们强调,它也是一个理论发展的机会。事实上,从我们对近10年来发表的AMJ和SMJ论文的回顾中,我们发现研究人员很少将时间依赖性视为理论发展的机会,更糟糕的是,他们中的许多人没有测试(或报告测试)时间依赖性。我们研究的目的就是要改变这种模式。为此,我们提供了一个循序渐进的指导,以促进时间依赖性的测试,并将时间依赖性作为理论发展的机会。我们还通过一个经验示例演示我们的逐步指南。
{"title":"Time Dependence in the Cox Proportional Hazard Model as a Theory Development Opportunity: A Step-by-Step Guide","authors":"Hyun-Soo Woo, Jisun Kim, Albert A. Cannella","doi":"10.1177/10944281231205027","DOIUrl":"https://doi.org/10.1177/10944281231205027","url":null,"abstract":"The Cox proportional hazard model has often been used for survival analysis in organizational research. The Cox model needs to satisfy one critical assumption—time independence—that the effects of independent variables are constant over survival time (also known as the proportional hazard assumption). However, organizational research often encounters time dependence in the Cox model. Organizational studies have traditionally seemed to view time dependence as an empirical nuisance, but we highlight that it is also a theory-development opportunity. Indeed, from our review of AMJ and SMJ papers published in a recent 10-year period, we found that researchers rarely considered time dependence as a theory-development opportunity, and worse, many of them did not test for (or report tests for) time dependence. The purpose of our study is to change this pattern. To this end, we provide a step-by-step guide to facilitate testing for time dependence and using time dependence as a theory development opportunity. We also demonstrate our step-by-step guide with an empirical example.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136063886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Multimodal Social Signal Processing Approach to Team Interactions 团队互动的多模态社会信号处理方法
2区 管理学 Q1 MANAGEMENT Pub Date : 2023-10-05 DOI: 10.1177/10944281231202741
Nale Lehmann-Willenbrock, Hayley Hung
Social signal processing develops automated approaches to detect, analyze, and synthesize social signals in human–human as well as human–machine interactions by means of machine learning and sensor data processing. Most works analyze individual or dyadic behavior, while the analysis of group or team interactions remains limited. We present a case study of an interdisciplinary work process for social signal processing that can develop automatized measures of complex team interaction dynamics, using team task and social cohesion as an example. In a field sample of 25 real project team meetings, we obtained sensor data from cameras, microphones, and a smart ID badge measuring acceleration. We demonstrate how fine-grained behavioral expressions of task and social cohesion in team meetings can be extracted and processed from sensor data by capturing dyadic coordination patterns that are then aggregated to the team level. The extracted patterns act as proxies for behavioral synchrony and mimicry of speech and body behavior which map onto verbal expressions of task and social cohesion in the observed team meetings. We reflect on opportunities for future interdisciplinary or collaboration that can move beyond a simple producer–consumer model.
社会信号处理通过机器学习和传感器数据处理,开发了自动化的方法来检测、分析和合成人与人之间以及人机交互中的社会信号。大多数研究分析个体或二元行为,而对群体或团队互动的分析仍然有限。我们以团队任务和社会凝聚力为例,提出了一个跨学科的社会信号处理工作过程的案例研究,该过程可以开发复杂团队互动动态的自动化测量。在25个真实项目团队会议的现场样本中,我们从相机、麦克风和测量加速度的智能ID徽章中获得传感器数据。我们展示了如何通过捕获二元协调模式从传感器数据中提取和处理团队会议中任务和社会凝聚力的细粒度行为表达,然后将其聚合到团队级别。所提取的模式作为行为同步和模仿的代理语言和身体行为映射到任务和社会凝聚力的口头表达在观察到的团队会议。我们思考未来跨学科或合作的机会,这些机会可以超越简单的生产者-消费者模式。
{"title":"A Multimodal Social Signal Processing Approach to Team Interactions","authors":"Nale Lehmann-Willenbrock, Hayley Hung","doi":"10.1177/10944281231202741","DOIUrl":"https://doi.org/10.1177/10944281231202741","url":null,"abstract":"Social signal processing develops automated approaches to detect, analyze, and synthesize social signals in human–human as well as human–machine interactions by means of machine learning and sensor data processing. Most works analyze individual or dyadic behavior, while the analysis of group or team interactions remains limited. We present a case study of an interdisciplinary work process for social signal processing that can develop automatized measures of complex team interaction dynamics, using team task and social cohesion as an example. In a field sample of 25 real project team meetings, we obtained sensor data from cameras, microphones, and a smart ID badge measuring acceleration. We demonstrate how fine-grained behavioral expressions of task and social cohesion in team meetings can be extracted and processed from sensor data by capturing dyadic coordination patterns that are then aggregated to the team level. The extracted patterns act as proxies for behavioral synchrony and mimicry of speech and body behavior which map onto verbal expressions of task and social cohesion in the observed team meetings. We reflect on opportunities for future interdisciplinary or collaboration that can move beyond a simple producer–consumer model.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134946260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The Promise of Just-in-Time Adaptive Interventions for Organizational Scholarship and Practice: Conceptual Development and Research Agenda 组织学术与实践的适时适应性干预承诺:概念发展与研究议程
2区 管理学 Q1 MANAGEMENT Pub Date : 2023-09-28 DOI: 10.1177/10944281231202740
Ze Zhu, John A. Aitken, Reeshad S. Dalal, Seth A. Kaplan
Organizational researchers are now making widespread use of ecological momentary assessments but have not yet taken the logical next step to ecological momentary interventions, also called Just-in-Time Adaptive Interventions (JITAIs). JITAIs have the potential to test within-person causal theories and maximize practical benefits to participants through two developmental phases: The microrandomized trial and the randomized controlled trial, respectively. In the microrandomized trial design, within-person randomization and experimental manipulation maximize internal validity at the within-person level. In the randomized controlled trial design, interventions are delivered in a timely and ecological manner while avoiding unnecessary and ill-timed interventions that potentially increase participant fatigue and noncompliance. Despite these potential advantages, the development and implementation of JITAIs require consideration of many conceptual and methodological factors. Given the benefits of JITAIs, but also the various considerations involved in using them, this review introduces organizational behavior and human resources researchers to JITAIs, provides guidelines for JITAI design, development, and evaluation, and describes the extensive potential of JITAIs in organizational behavior and human resources research.
组织研究人员现在正在广泛使用生态瞬时评估,但尚未采取合乎逻辑的下一步生态瞬时干预,也称为即时适应性干预(JITAIs)。jitai有可能通过两个发展阶段(分别为微随机试验和随机对照试验)来测试人体内的因果理论,并最大限度地提高参与者的实际利益。在微随机试验设计中,人内随机化和实验操作在人内水平上最大化了内部有效性。在随机对照试验设计中,干预措施以及时和生态的方式提供,同时避免不必要和不合时宜的干预措施,这些干预措施可能会增加参与者的疲劳和不依从性。尽管有这些潜在的优势,JITAIs的开发和实施需要考虑许多概念和方法上的因素。考虑到JITAIs的好处,以及使用JITAIs所涉及的各种考虑,本文向组织行为学和人力资源研究人员介绍了JITAIs,为JITAI的设计、开发和评估提供了指南,并描述了JITAIs在组织行为学和人力资源研究中的广泛潜力。
{"title":"The Promise of Just-in-Time Adaptive Interventions for Organizational Scholarship and Practice: Conceptual Development and Research Agenda","authors":"Ze Zhu, John A. Aitken, Reeshad S. Dalal, Seth A. Kaplan","doi":"10.1177/10944281231202740","DOIUrl":"https://doi.org/10.1177/10944281231202740","url":null,"abstract":"Organizational researchers are now making widespread use of ecological momentary assessments but have not yet taken the logical next step to ecological momentary interventions, also called Just-in-Time Adaptive Interventions (JITAIs). JITAIs have the potential to test within-person causal theories and maximize practical benefits to participants through two developmental phases: The microrandomized trial and the randomized controlled trial, respectively. In the microrandomized trial design, within-person randomization and experimental manipulation maximize internal validity at the within-person level. In the randomized controlled trial design, interventions are delivered in a timely and ecological manner while avoiding unnecessary and ill-timed interventions that potentially increase participant fatigue and noncompliance. Despite these potential advantages, the development and implementation of JITAIs require consideration of many conceptual and methodological factors. Given the benefits of JITAIs, but also the various considerations involved in using them, this review introduces organizational behavior and human resources researchers to JITAIs, provides guidelines for JITAI design, development, and evaluation, and describes the extensive potential of JITAIs in organizational behavior and human resources research.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135344361","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Organizational Research Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1