首页 > 最新文献

Organizational Research Methods最新文献

英文 中文
Enhancing Causal Pursuits in Organizational Science: Targeting the Effect of Treatment on the Treated in Research on Vulnerable Populations 加强组织科学的因果追求:在弱势人群研究中针对治疗对被治疗者的影响
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2024-05-02 DOI: 10.1177/10944281241246772
Wen Wei Loh, Dongning Ren
Understanding the experiences of vulnerable workers is an important scientific pursuit. For example, research interest is often in quantifying the impacts of adverse exposures such as discrimination, exclusion, harassment, or job insecurity, among others. However, routine approaches have only focused on the average treatment effect, which encapsulates the impact of an exposure (e.g., discrimination) applied to the entire study population—including those who were not exposed. In this paper, we propose using a more refined causal quantity uniquely suited to address such causal queries: The effect of treatment on the treated (ETT) from the causal inference literature. We explain why the ETT is a more pertinent causal estimand for investigating the experiences of vulnerable workers by highlighting three appealing features: Better interpretability, greater accuracy, and enhanced robustness to violations of empirically untestable causal assumptions. We further describe how to estimate the ETT by introducing and comparing two estimators. Both estimators are conferred with a so-called doubly robust property. We hope the current proposal empowers organizational scholars in their crucial endeavors dedicated to understanding the vulnerable workforce.
了解弱势工人的经历是一项重要的科学追求。例如,研究兴趣往往在于量化歧视、排斥、骚扰或工作不稳定等不利暴露的影响。然而,常规方法只关注平均处理效果,即某一暴露(如歧视)对整个研究人群(包括未暴露人群)的影响。在本文中,我们建议使用一种更精细的因果量,它非常适合解决此类因果问题:因果推断文献中的治疗对被治疗者的影响(ETT)。我们通过强调三个吸引人的特点来解释为什么 ETT 是调查弱势工人经历的更相关的因果估计量:更好的可解释性、更高的准确性以及对违反经验上无法检验的因果假设的稳健性。通过介绍和比较两种估计方法,我们进一步介绍了如何估计 ETT。这两个估计器都具有所谓的双重稳健性。我们希望当前的建议能够增强组织学者的能力,使他们能够致力于了解弱势劳动力的重要工作。
{"title":"Enhancing Causal Pursuits in Organizational Science: Targeting the Effect of Treatment on the Treated in Research on Vulnerable Populations","authors":"Wen Wei Loh, Dongning Ren","doi":"10.1177/10944281241246772","DOIUrl":"https://doi.org/10.1177/10944281241246772","url":null,"abstract":"Understanding the experiences of vulnerable workers is an important scientific pursuit. For example, research interest is often in quantifying the impacts of adverse exposures such as discrimination, exclusion, harassment, or job insecurity, among others. However, routine approaches have only focused on the average treatment effect, which encapsulates the impact of an exposure (e.g., discrimination) applied to the entire study population—including those who were not exposed. In this paper, we propose using a more refined causal quantity uniquely suited to address such causal queries: The effect of treatment on the treated (ETT) from the causal inference literature. We explain why the ETT is a more pertinent causal estimand for investigating the experiences of vulnerable workers by highlighting three appealing features: Better interpretability, greater accuracy, and enhanced robustness to violations of empirically untestable causal assumptions. We further describe how to estimate the ETT by introducing and comparing two estimators. Both estimators are conferred with a so-called doubly robust property. We hope the current proposal empowers organizational scholars in their crucial endeavors dedicated to understanding the vulnerable workforce.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2024-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140826389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analyzing Social Interaction in Organizations: A Roadmap for Reflexive Choice 分析组织中的社会互动:反思性选择路线图
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2024-04-22 DOI: 10.1177/10944281241245444
Linda Jakob Sadeh, Avital Baikovich, Tammar B. Zilber
This article proposes a framework for reflexive choice in qualitative research, centering on social interaction. Interaction, fundamental to social and organizational life, has been studied extensively. Yet, researchers can get lost in the plethora of methodological tools, hampering reflexive choice. Our proposed framework consists of four dimensions of interaction (content, communication patterns, emotions, and roles), intersecting with five levels of analysis (individual, dyadic, group, organizational, and sociocultural), as well as three overarching analytic principles (following the dynamic, consequential, and contextual nature of interaction). For each intersection between dimension and level, we specify analytical questions, empirical markers, and references to exemplary works. The framework functions both as a compass, indicating potential directions for research design and data collection methods, and as a roadmap, illuminating pathways at the analysis stage. Our contributions are twofold: First, our framework fleshes out the broad spectrum of available methods for analyzing interaction, providing pragmatic tools for the researcher to reflexively choose from. Second, we highlight the broader relevance of maps, such as our own, for enhancing reflexive methodological choices.
本文以社会互动为中心,提出了定性研究中的反思性选择框架。互动是社会和组织生活的基础,已被广泛研究。然而,研究人员可能会迷失在过多的方法论工具中,从而阻碍了反思性选择。我们提出的框架包括互动的四个维度(内容、交流模式、情感和角色),与五个分析层次(个人、二元、群体、组织和社会文化)以及三个总体分析原则(遵循互动的动态性、结果性和情境性)相交叉。对于每个维度和层次之间的交叉点,我们都明确了分析问题、实证标记和典范作品参考。该框架既是指南针,指明了研究设计和数据收集方法的潜在方向,也是路线图,阐明了分析阶段的路径。我们的贡献有两个方面:首先,我们的框架充实了可用来分析互动的各种方法,为研究人员提供了实用的工具,以便他们进行反思性选择。其次,我们强调了地图(比如我们自己的地图)对于加强反思性方法选择的广泛意义。
{"title":"Analyzing Social Interaction in Organizations: A Roadmap for Reflexive Choice","authors":"Linda Jakob Sadeh, Avital Baikovich, Tammar B. Zilber","doi":"10.1177/10944281241245444","DOIUrl":"https://doi.org/10.1177/10944281241245444","url":null,"abstract":"This article proposes a framework for reflexive choice in qualitative research, centering on social interaction. Interaction, fundamental to social and organizational life, has been studied extensively. Yet, researchers can get lost in the plethora of methodological tools, hampering reflexive choice. Our proposed framework consists of four dimensions of interaction (content, communication patterns, emotions, and roles), intersecting with five levels of analysis (individual, dyadic, group, organizational, and sociocultural), as well as three overarching analytic principles (following the dynamic, consequential, and contextual nature of interaction). For each intersection between dimension and level, we specify analytical questions, empirical markers, and references to exemplary works. The framework functions both as a compass, indicating potential directions for research design and data collection methods, and as a roadmap, illuminating pathways at the analysis stage. Our contributions are twofold: First, our framework fleshes out the broad spectrum of available methods for analyzing interaction, providing pragmatic tools for the researcher to reflexively choose from. Second, we highlight the broader relevance of maps, such as our own, for enhancing reflexive methodological choices.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2024-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140637754","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Advancing Qualitative Meta-Studies (QMS): Current Practices and Reflective Guidelines for Synthesizing Qualitative Research 推进定性元研究(QMS):综合定性研究的现行做法和反思指南
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2024-04-17 DOI: 10.1177/10944281241240180
Stefanie Habersang, Markus Reihlen
Qualitative meta-studies (QMS) have emerged as a promising methodology for synthesizing qualitative research within organization and management studies. However, despite considerable progress, increasingly fragmented applications of QMS impede the advancement of the methodology. To address this issue, we review and analyze the expanding body of QMS in organization and management studies. We propose a framework that encompasses the core decisions and methodological choices in the formal QMS protocol as well as the reflective—yet often implicit—meta-practices essential for deriving meaningful results from QMS. Based on our analysis, we develop two guidelines to help researchers reflectively align formal methodological choices with the intended purpose of the QMS, which can be either confirmatory or exploratory.
定性荟萃研究(QMS)是在组织和管理研究中综合定性研究的一种很有前途的方法。然而,尽管取得了长足的进步,定性元研究日益分散的应用阻碍了该方法的发展。为了解决这个问题,我们回顾并分析了组织与管理研究中不断扩展的定性研究方法。我们提出了一个框架,其中包括正式 QMS 协议中的核心决策和方法选择,以及从 QMS 中获得有意义的结果所必需的反思性--但往往是隐含的--元实践。根据我们的分析,我们制定了两个指南,帮助研究人员反思正式的方法选择与 QMS 的预期目的(可以是证实性的,也可以是探索性的)是否一致。
{"title":"Advancing Qualitative Meta-Studies (QMS): Current Practices and Reflective Guidelines for Synthesizing Qualitative Research","authors":"Stefanie Habersang, Markus Reihlen","doi":"10.1177/10944281241240180","DOIUrl":"https://doi.org/10.1177/10944281241240180","url":null,"abstract":"Qualitative meta-studies (QMS) have emerged as a promising methodology for synthesizing qualitative research within organization and management studies. However, despite considerable progress, increasingly fragmented applications of QMS impede the advancement of the methodology. To address this issue, we review and analyze the expanding body of QMS in organization and management studies. We propose a framework that encompasses the core decisions and methodological choices in the formal QMS protocol as well as the reflective—yet often implicit—meta-practices essential for deriving meaningful results from QMS. Based on our analysis, we develop two guidelines to help researchers reflectively align formal methodological choices with the intended purpose of the QMS, which can be either confirmatory or exploratory.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140608152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Simulating Virtual Organizations for Research: A Comparative Empirical Evaluation of Text-Based, Video, and Virtual Reality Video Vignettes 为研究模拟虚拟组织:基于文本、视频和虚拟现实视频小故事的比较实证评估
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2024-04-17 DOI: 10.1177/10944281241246770
Anand P. A. van Zelderen, Theodore C. Masters-Waage, Nicky Dries, Jochen I. Menges, Diana R. Sanchez
Due to recent technological developments, vignette studies that have traditionally been done in text or video formats can now be done in immersive formats using virtual reality—but are such virtual reality video vignettes superior to traditional vignettes? To address this question, we examine participants’ experiences within a fictitious organization by comparing their responses to a relevant and particularly sensitive organizational phenomenon presented either through written text, a video recording, or a virtual reality experience. The results indicate that participants prefer more immersive methods, and that these increase their attention to critical study details. Moreover, this augments the effect sizes of several measured employee reactions—particularly those with high emotional content—suggesting that virtual reality technology offers a promising avenue for developing ecologically valid vignette studies to measure employee affect. To facilitate and expediate the use of virtual reality video vignettes in organizational research, we provide organizational scholars with a step-by-step instructional guide to develop immersive vignette studies.
由于最近的技术发展,传统上以文本或视频形式进行的小故事研究现在可以通过虚拟现实技术以身临其境的形式进行,但这种虚拟现实视频小故事是否优于传统的小故事呢?为了解决这个问题,我们研究了参与者在虚构组织中的体验,比较了他们对通过书面文字、视频录像或虚拟现实体验呈现的相关且特别敏感的组织现象的反应。结果表明,参与者更喜欢身临其境的方法,而且这些方法会提高他们对关键研究细节的关注度。此外,这还增强了几种测量的员工反应的效应大小--尤其是那些高情感含量的反应--这表明虚拟现实技术为开发生态有效的小故事研究来测量员工情感提供了一个前景广阔的途径。为了促进和加快虚拟现实视频小插曲在组织研究中的应用,我们为组织学者提供了一个逐步指导的指南,以开发沉浸式小插曲研究。
{"title":"Simulating Virtual Organizations for Research: A Comparative Empirical Evaluation of Text-Based, Video, and Virtual Reality Video Vignettes","authors":"Anand P. A. van Zelderen, Theodore C. Masters-Waage, Nicky Dries, Jochen I. Menges, Diana R. Sanchez","doi":"10.1177/10944281241246770","DOIUrl":"https://doi.org/10.1177/10944281241246770","url":null,"abstract":"Due to recent technological developments, vignette studies that have traditionally been done in text or video formats can now be done in immersive formats using virtual reality—but are such virtual reality video vignettes superior to traditional vignettes? To address this question, we examine participants’ experiences within a fictitious organization by comparing their responses to a relevant and particularly sensitive organizational phenomenon presented either through written text, a video recording, or a virtual reality experience. The results indicate that participants prefer more immersive methods, and that these increase their attention to critical study details. Moreover, this augments the effect sizes of several measured employee reactions—particularly those with high emotional content—suggesting that virtual reality technology offers a promising avenue for developing ecologically valid vignette studies to measure employee affect. To facilitate and expediate the use of virtual reality video vignettes in organizational research, we provide organizational scholars with a step-by-step instructional guide to develop immersive vignette studies.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140608136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Framework for Detecting Both Main Effect and Interactive DIF in Multidimensional Forced-Choice Assessments 在多维强制选择测评中检测主效应和交互式 DIF 的框架
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2024-04-13 DOI: 10.1177/10944281241244760
Kai Liu, Yi Zheng, Daxun Wang, Yan Cai, Yuanyuan Shi, Chongqin Xi, Dongbo Tu
In recent decades, multidimensional forced-choice (MFC) tests have gained widespread popularity in organizational settings due to their effectiveness in reducing response biases. Detecting differential item functioning (DIF) is crucial in developing MFC tests, as it relates to test fairness and validity. However, existing methods appear insufficient for detecting DIF induced by the interaction between multiple covariates. Furthermore, for multi-category, ordered or continuous covariates, existing approaches often dichotomize them using a-priori cutoffs, commonly using the median of the covariates. This may lead to information loss and reduced power in detecting MFC DIF. To address these limitations, we propose a method to identify both main effect DIF and interactive DIF. This method can automatically search for the optimal cutoffs for ordered or continuous covariates without pre-defined cutoffs. We introduce the rationale behind the proposed method and evaluate its performance through three Monte Carlo simulation studies. Results demonstrate that the proposed method effectively identifies various DIF forms in MFC tests, thereby increasing detection power. Finally, we provide an empirical application to illustrate the practical applicability of the proposed method.
近几十年来,多维强迫选择(MFC)测验因其在减少反应偏差方面的有效性而在组织机构中得到了广泛的普及。检测项目功能差异(DIF)对开发 MFC 测试至关重要,因为它关系到测试的公平性和有效性。然而,现有的方法似乎不足以检测由多个协变量之间的交互作用引起的 DIF。此外,对于多类别、有序或连续的协变量,现有方法通常使用先验截断点(通常使用协变量的中位数)对其进行二分。这可能会导致信息丢失,降低检测 MFC DIF 的能力。为了解决这些局限性,我们提出了一种同时识别主效应 DIF 和交互式 DIF 的方法。这种方法可以自动搜索有序或连续协变量的最佳临界点,而无需预先设定临界点。我们介绍了所提方法背后的原理,并通过三项蒙特卡罗模拟研究对其性能进行了评估。结果表明,所提方法能有效识别 MFC 检验中的各种 DIF 形式,从而提高检测能力。最后,我们提供了一个经验应用,以说明所提方法的实际适用性。
{"title":"A Framework for Detecting Both Main Effect and Interactive DIF in Multidimensional Forced-Choice Assessments","authors":"Kai Liu, Yi Zheng, Daxun Wang, Yan Cai, Yuanyuan Shi, Chongqin Xi, Dongbo Tu","doi":"10.1177/10944281241244760","DOIUrl":"https://doi.org/10.1177/10944281241244760","url":null,"abstract":"In recent decades, multidimensional forced-choice (MFC) tests have gained widespread popularity in organizational settings due to their effectiveness in reducing response biases. Detecting differential item functioning (DIF) is crucial in developing MFC tests, as it relates to test fairness and validity. However, existing methods appear insufficient for detecting DIF induced by the interaction between multiple covariates. Furthermore, for multi-category, ordered or continuous covariates, existing approaches often dichotomize them using a-priori cutoffs, commonly using the median of the covariates. This may lead to information loss and reduced power in detecting MFC DIF. To address these limitations, we propose a method to identify both main effect DIF and interactive DIF. This method can automatically search for the optimal cutoffs for ordered or continuous covariates without pre-defined cutoffs. We introduce the rationale behind the proposed method and evaluate its performance through three Monte Carlo simulation studies. Results demonstrate that the proposed method effectively identifies various DIF forms in MFC tests, thereby increasing detection power. Finally, we provide an empirical application to illustrate the practical applicability of the proposed method.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2024-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140551921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From Textual Data to Theoretical Insights: Introducing and Applying the Word-Text-Topic Extraction Approach 从文本数据到理论见解:单词-文本-主题提取方法的介绍和应用
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2024-01-31 DOI: 10.1177/10944281241228186
Jaewoo Jung, Wenjun Zhou, Anne D. Smith
Text analysis, particularly custom dictionaries and topic modeling, has helped advance management and organization theory. Custom dictionaries involve creating word lists to quantify patterns and infer constructs, while topic modeling extracts themes from textual documents to help understand a theoretical domain. Building on these two approaches, we propose another text analysis approach called word-text-topic extraction (WTT), which enhances the efficiency and relevance of text analysis for the sake of theoretical advancement. Specifically, we first identify relevant words for a researcher's theoretical area of interest using word-embedding algorithms. That step is followed by extracting text segments from the textual corpus using a collocation process. Finally, topic modeling is applied to capture themes relevant to the specific theoretical area of interest. To illustrate the WTT approach, we explored one research area needing further theory development—innovation. Using 841 CEOs’ letters to shareholders, we found that our WTT approach provides nuanced features of innovation that differ across industry contexts. We guide researchers on decisions and considerations related to the WTT approach in order to facilitate its use in future studies.
文本分析,尤其是定制词典和主题建模,有助于推动管理和组织理论的发展。自定义词典包括创建词表,以量化模式和推断结构,而主题建模则是从文本文档中提取主题,以帮助理解某一理论领域。在这两种方法的基础上,我们提出了另一种称为词-文本-主题提取(WTT)的文本分析方法,它提高了文本分析的效率和相关性,从而促进了理论的发展。具体来说,我们首先使用单词嵌入算法识别研究人员感兴趣的理论领域的相关单词。然后,使用搭配过程从文本语料库中提取文本片段。最后,应用主题建模来捕捉与特定理论领域相关的主题。为了说明 WTT 方法,我们探讨了一个需要进一步发展理论的研究领域--创新。通过使用 841 封首席执行官致股东的信,我们发现我们的 WTT 方法提供了不同行业背景下创新的细微特征。我们为研究人员提供了与 WTT 方法相关的决策和注意事项方面的指导,以促进其在未来研究中的应用。
{"title":"From Textual Data to Theoretical Insights: Introducing and Applying the Word-Text-Topic Extraction Approach","authors":"Jaewoo Jung, Wenjun Zhou, Anne D. Smith","doi":"10.1177/10944281241228186","DOIUrl":"https://doi.org/10.1177/10944281241228186","url":null,"abstract":"Text analysis, particularly custom dictionaries and topic modeling, has helped advance management and organization theory. Custom dictionaries involve creating word lists to quantify patterns and infer constructs, while topic modeling extracts themes from textual documents to help understand a theoretical domain. Building on these two approaches, we propose another text analysis approach called word-text-topic extraction (WTT), which enhances the efficiency and relevance of text analysis for the sake of theoretical advancement. Specifically, we first identify relevant words for a researcher's theoretical area of interest using word-embedding algorithms. That step is followed by extracting text segments from the textual corpus using a collocation process. Finally, topic modeling is applied to capture themes relevant to the specific theoretical area of interest. To illustrate the WTT approach, we explored one research area needing further theory development—innovation. Using 841 CEOs’ letters to shareholders, we found that our WTT approach provides nuanced features of innovation that differ across industry contexts. We guide researchers on decisions and considerations related to the WTT approach in order to facilitate its use in future studies.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2024-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139938974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Five Is the Brightest Star. But by how Much? Testing the Equidistance of Star Ratings in Online Reviews 五是最亮的星。但有多亮?测试在线评论中星级评定的等距性
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2024-01-08 DOI: 10.1177/10944281231223412
Balázs Kovács
Organizational research increasingly relies on online review data to gauge perceived valuation and reputation of organizations and products. Online review platforms typically collect ordinal ratings (e.g., 1 to 5 stars); however, researchers often treat them as a cardinal data, calculating aggregate statistics such as the average, the median, or the variance of ratings. In calculating these statistics, ratings are implicitly assumed to be equidistant. We test whether star ratings are equidistant using reviews from two large-scale online review platforms: Amazon.com and Yelp.com. We develop a deep learning framework to analyze the text of the reviews in order to assess their overall valuation. We find that 4 and 5-star ratings, as well as 1 and 2-star ratings, are closer to each other than 3-star ratings are to 2 and 4-star ratings. An additional online experiment corroborates this pattern. Using simulations, we show that the distortion by non-equidistant ratings is especially harmful in cases when organizations receive only a few reviews and when researchers are interested in estimating variance effects. We discuss potential solutions to solve the issue with rating non-equidistance.
组织研究越来越依赖于在线评论数据来衡量组织和产品的认知价值和声誉。在线评论平台通常收集的是序数评分(如 1 到 5 星);然而,研究人员通常将其视为心数数据,计算平均值、中位数或评分方差等综合统计数据。在计算这些统计数据时,评级被隐含地假定为等距的。我们使用两个大型在线评论平台的评论来检验星级评分是否等距:亚马逊和 Yelp.com。我们开发了一个深度学习框架来分析评论文本,以评估其整体价值。我们发现,4 星和 5 星评价以及 1 星和 2 星评价之间的距离比 3 星和 2 星以及 4 星评价之间的距离更近。另外一项在线实验也证实了这一模式。通过模拟实验,我们发现当组织只收到几条评论时,当研究人员对估计方差效应感兴趣时,非等距评分的失真尤其有害。我们讨论了解决非等距评分问题的潜在方案。
{"title":"Five Is the Brightest Star. But by how Much? Testing the Equidistance of Star Ratings in Online Reviews","authors":"Balázs Kovács","doi":"10.1177/10944281231223412","DOIUrl":"https://doi.org/10.1177/10944281231223412","url":null,"abstract":"Organizational research increasingly relies on online review data to gauge perceived valuation and reputation of organizations and products. Online review platforms typically collect ordinal ratings (e.g., 1 to 5 stars); however, researchers often treat them as a cardinal data, calculating aggregate statistics such as the average, the median, or the variance of ratings. In calculating these statistics, ratings are implicitly assumed to be equidistant. We test whether star ratings are equidistant using reviews from two large-scale online review platforms: Amazon.com and Yelp.com. We develop a deep learning framework to analyze the text of the reviews in order to assess their overall valuation. We find that 4 and 5-star ratings, as well as 1 and 2-star ratings, are closer to each other than 3-star ratings are to 2 and 4-star ratings. An additional online experiment corroborates this pattern. Using simulations, we show that the distortion by non-equidistant ratings is especially harmful in cases when organizations receive only a few reviews and when researchers are interested in estimating variance effects. We discuss potential solutions to solve the issue with rating non-equidistance.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139446588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The VIF Score. What is it Good For? Absolutely Nothing VIF 分数。有什么用?没什么用
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2023-12-13 DOI: 10.1177/10944281231216381
Arturs Kalnins, Kendall Praitis Hill
Variance inflation factors (VIF scores) are regression diagnostics commonly invoked throughout the social sciences. Researchers typically take the perspective that VIF scores below a numerical rule-of-thumb threshold act as a “silver bullet” to dismiss any and all multicollinearity concerns. Yet, no valid logical basis exists for using VIF thresholds to reject the possibility of multicollinearity-induced type 1 errors. Reporting VIF scores below a threshold does not in any way add to the credibility of statistically significant results among correlated variables. In contrast to this “threshold perspective,” our analysis expands the scope of a perspective that has considered multicollinearity and misspecification. We demonstrate analytically that a regression omitting a relevant variable correlated with included variables that exhibit multicollinearity is susceptible to endogeneity-induced bias inflation and beta polarization, leading to the possible co-existence of type 1 errors and low VIF scores. Further, omitting variables explicitly reduces VIF scores. We conclude that the threshold perspective not only lacks any logical basis but also is fundamentally misleading as a rule-of-thumb. Instrumental variables represent one clear remedy for endogeneity-induced bias inflation. If exogenous instruments are unavailable, we encourage researchers to test only straightforward, unambiguous theory when using variables that exhibit multicollinearity, and to ensure that correlated co-variates exhibit the expected signs.
方差膨胀因子(VIF 分值)是社会科学领域常用的回归诊断方法。研究人员通常认为,VIF 分数低于某个数字规则阈值,就可以作为 "灵丹妙药 "来排除所有多重共线性问题。然而,使用 VIF 临界值来排除多重共线性引起的 1 类错误的可能性并不存在有效的逻辑依据。报告低于阈值的 VIF 分数丝毫不会增加相关变量统计意义结果的可信度。与这种 "临界值视角 "不同,我们的分析扩大了考虑多重共线性和规格错误的视角的范围。我们通过分析表明,如果回归中省略了与表现出多重共线性的包含变量相关的相关变量,就很容易出现由内生因素引起的偏差膨胀和贝塔极化,从而导致 1 类错误和低 VIF 分数可能同时存在。此外,明确省略变量可降低 VIF 分数。我们的结论是,阈值观点不仅缺乏逻辑基础,而且作为一种经验法则从根本上具有误导性。工具变量是解决内生性偏差膨胀的一种有效方法。如果没有外生工具,我们鼓励研究人员在使用表现出多重共线性的变量时,只对直接、明确的理论进行检验,并确保相关共变量表现出预期的符号。
{"title":"The VIF Score. What is it Good For? Absolutely Nothing","authors":"Arturs Kalnins, Kendall Praitis Hill","doi":"10.1177/10944281231216381","DOIUrl":"https://doi.org/10.1177/10944281231216381","url":null,"abstract":"Variance inflation factors (VIF scores) are regression diagnostics commonly invoked throughout the social sciences. Researchers typically take the perspective that VIF scores below a numerical rule-of-thumb threshold act as a “silver bullet” to dismiss any and all multicollinearity concerns. Yet, no valid logical basis exists for using VIF thresholds to reject the possibility of multicollinearity-induced type 1 errors. Reporting VIF scores below a threshold does not in any way add to the credibility of statistically significant results among correlated variables. In contrast to this “threshold perspective,” our analysis expands the scope of a perspective that has considered multicollinearity and misspecification. We demonstrate analytically that a regression omitting a relevant variable correlated with included variables that exhibit multicollinearity is susceptible to endogeneity-induced bias inflation and beta polarization, leading to the possible co-existence of type 1 errors and low VIF scores. Further, omitting variables explicitly reduces VIF scores. We conclude that the threshold perspective not only lacks any logical basis but also is fundamentally misleading as a rule-of-thumb. Instrumental variables represent one clear remedy for endogeneity-induced bias inflation. If exogenous instruments are unavailable, we encourage researchers to test only straightforward, unambiguous theory when using variables that exhibit multicollinearity, and to ensure that correlated co-variates exhibit the expected signs.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139005307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Qualitative Restudies: Research Designs for Retheorizing 定性再研究:重新理论化的研究设计
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2023-12-03 DOI: 10.1177/10944281231216323
T. Köhler, Maria N. Rumyantseva, Catherine Welch
Qualitative research methods are deemed best suited to exploring novel phenomena and generating new concepts. Their potential to reevaluate existing theorizing, however, is underestimated. Qualitative restudies that return to the data and settings on which the original theories were built are a well-established tradition in other disciplines (e.g., history, sociology, and anthropology), but have received little recognition in management and organization studies. We introduce qualitative restudies as a powerful means to improve theorizing by revising or challenging theories that have become outdated or obsolete and establishing transferability and longevity of findings and interpretations. We provide a typology of qualitative restudy designs drawing on an integrative review of literature in management, strategy, and the social sciences and humanities. We highlight the main design and ethical considerations for researchers in undertaking a restudy. We argue for the strengths of restudies as lying in their possibilities for retheorizing, above and beyond verifying or updating prior studies. Restudies draw on the strengths of in-depth qualitative work to uncover how interpretations and theorizing are shaped by methodological traditions, historical contexts, existing societal structures, and researcher backgrounds.
定性研究方法被认为最适合探索新现象和产生新概念。然而,他们重新评估现有理论的潜力被低估了。在其他学科(如历史学、社会学和人类学)中,回归原始理论所依据的数据和背景的定性再研究是一个公认的传统,但在管理和组织研究中却很少得到认可。我们引入定性再研究作为一种强有力的手段,通过修订或挑战已经过时或过时的理论,并建立发现和解释的可转移性和持久性,来改进理论。我们提供了一种定性再研究设计的类型学,借鉴了管理、战略、社会科学和人文科学方面的综合文献综述。我们强调了研究人员在进行重新研究时的主要设计和伦理考虑。我们认为,再研究的优势在于,它们可以在验证或更新先前研究的基础上,重新理论化。再研究利用深入的定性工作的优势,揭示解释和理论化是如何被方法论传统、历史背景、现有社会结构和研究人员背景所塑造的。
{"title":"Qualitative Restudies: Research Designs for Retheorizing","authors":"T. Köhler, Maria N. Rumyantseva, Catherine Welch","doi":"10.1177/10944281231216323","DOIUrl":"https://doi.org/10.1177/10944281231216323","url":null,"abstract":"Qualitative research methods are deemed best suited to exploring novel phenomena and generating new concepts. Their potential to reevaluate existing theorizing, however, is underestimated. Qualitative restudies that return to the data and settings on which the original theories were built are a well-established tradition in other disciplines (e.g., history, sociology, and anthropology), but have received little recognition in management and organization studies. We introduce qualitative restudies as a powerful means to improve theorizing by revising or challenging theories that have become outdated or obsolete and establishing transferability and longevity of findings and interpretations. We provide a typology of qualitative restudy designs drawing on an integrative review of literature in management, strategy, and the social sciences and humanities. We highlight the main design and ethical considerations for researchers in undertaking a restudy. We argue for the strengths of restudies as lying in their possibilities for retheorizing, above and beyond verifying or updating prior studies. Restudies draw on the strengths of in-depth qualitative work to uncover how interpretations and theorizing are shaped by methodological traditions, historical contexts, existing societal structures, and researcher backgrounds.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2023-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138605211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Vector Space Approach for Measuring Relationality and Multidimensionality of Meaning in Large Text Collections 基于向量空间的大型文本集意义相关性和多维度度量方法
2区 管理学 Q1 Business, Management and Accounting Pub Date : 2023-11-13 DOI: 10.1177/10944281231213068
Philipp Poschmann, Jan Goldenstein, Sven Büchel, Udo Hahn
In this article, we develop a methodological approach for organizational research regarding the construction of multidimensional and relational similarity measures by using the vector space model in natural language processing (NLP). Our vector space approach draws on the well-established premise in organizational research that texts provide a window into social reality and allow measuring theory-based constructs ( e.g., organizations’ self-representations). Using a vector space approach allows capturing the multidimensionality of these theory-based constructs and computing relational similarities between organizational entities ( e.g., organizations, their members, and subunits) in social spaces and with their environments, such as the organization itself, industries, or countries. Thus, our methodological approach contributes to the recent trend in organizational research to use the potential inherent in big (textual) data by using NLP. In an example, we provide guidance for organizational scholars by illustrating how they can ensure validity when applying our methodological contribution in concrete research practice.
在本文中,我们利用自然语言处理(NLP)中的向量空间模型,开发了一种方法方法,用于组织研究有关多维和关系相似性度量的构建。我们的向量空间方法借鉴了组织研究中公认的前提,即文本提供了一个了解社会现实的窗口,并允许测量基于理论的结构(例如,组织的自我表征)。使用向量空间方法可以捕获这些基于理论的结构的多维度,并计算社会空间中的组织实体(例如,组织、其成员和子单位)及其环境(例如组织本身、行业或国家)之间的关系相似性。因此,我们的方法论方法有助于组织研究的最新趋势,即通过使用NLP来利用大(文本)数据中固有的潜力。在一个例子中,我们通过说明他们如何在具体研究实践中应用我们的方法贡献时确保有效性,为组织学者提供指导。
{"title":"A Vector Space Approach for Measuring Relationality and Multidimensionality of Meaning in Large Text Collections","authors":"Philipp Poschmann, Jan Goldenstein, Sven Büchel, Udo Hahn","doi":"10.1177/10944281231213068","DOIUrl":"https://doi.org/10.1177/10944281231213068","url":null,"abstract":"In this article, we develop a methodological approach for organizational research regarding the construction of multidimensional and relational similarity measures by using the vector space model in natural language processing (NLP). Our vector space approach draws on the well-established premise in organizational research that texts provide a window into social reality and allow measuring theory-based constructs ( e.g., organizations’ self-representations). Using a vector space approach allows capturing the multidimensionality of these theory-based constructs and computing relational similarities between organizational entities ( e.g., organizations, their members, and subunits) in social spaces and with their environments, such as the organization itself, industries, or countries. Thus, our methodological approach contributes to the recent trend in organizational research to use the potential inherent in big (textual) data by using NLP. In an example, we provide guidance for organizational scholars by illustrating how they can ensure validity when applying our methodological contribution in concrete research practice.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136351297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Organizational Research Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1