首页 > 最新文献

Organizational Research Methods最新文献

英文 中文
Macro-iterativity: A Qualitative Multi-arc Design for Studying Complex Issues and Big Questions 宏观迭代性:研究复杂问题和大问题的定性多弧设计
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2023-04-17 DOI: 10.1177/10944281231166649
Christina Hoon, Alina M. Baluch
The impact and relevance of our discipline's research is determined by its ability to engage the big questions of the grand challenges we face today. Our central argument is that we need innovative methods that engage large-scope phenomena, not least because these phenomena benefit from going beyond individual study design. We introduce the concept of macro-iterativity which involves multiple iterations that move between, and link across, a set of research cycles. We offer a multi-arc research design that comprises the discovery arc and extension arc and three extension logics through which scholars can combine these arcs of inquiry in a coherent way. Based on this research design, we develop a roadmap that guides scholars through the four steps of how to engage in multi-arc research along with the main techniques and outputs. We argue that a multi-arc design supports the move toward more generative theorizing that is required for researching problems dealing with the complex issues and big questions of our time.
我们学科研究的影响力和相关性取决于它处理我们今天面临的重大挑战中的重大问题的能力。我们的核心论点是,我们需要创新的方法来处理大范围的现象,尤其是因为这些现象受益于超越个人学习设计。我们引入了宏观迭代性的概念,它涉及在一组研究周期之间移动和链接的多次迭代。我们提供了一个多弧研究设计,包括发现弧和扩展弧,以及三个扩展逻辑,通过这些逻辑,学者可以以连贯的方式将这些研究弧结合起来。基于这一研究设计,我们制定了一个路线图,指导学者完成如何进行多弧研究的四个步骤以及主要技术和产出。我们认为,多弧设计支持向更具生成性的理论化迈进,这是研究处理我们这个时代的复杂问题和重大问题所必需的。
{"title":"Macro-iterativity: A Qualitative Multi-arc Design for Studying Complex Issues and Big Questions","authors":"Christina Hoon, Alina M. Baluch","doi":"10.1177/10944281231166649","DOIUrl":"https://doi.org/10.1177/10944281231166649","url":null,"abstract":"The impact and relevance of our discipline's research is determined by its ability to engage the big questions of the grand challenges we face today. Our central argument is that we need innovative methods that engage large-scope phenomena, not least because these phenomena benefit from going beyond individual study design. We introduce the concept of macro-iterativity which involves multiple iterations that move between, and link across, a set of research cycles. We offer a multi-arc research design that comprises the discovery arc and extension arc and three extension logics through which scholars can combine these arcs of inquiry in a coherent way. Based on this research design, we develop a roadmap that guides scholars through the four steps of how to engage in multi-arc research along with the main techniques and outputs. We argue that a multi-arc design supports the move toward more generative theorizing that is required for researching problems dealing with the complex issues and big questions of our time.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2023-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41372087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Publication Notice 公告
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2023-03-31 DOI: 10.1177/10944281231155392
{"title":"Publication Notice","authors":"","doi":"10.1177/10944281231155392","DOIUrl":"https://doi.org/10.1177/10944281231155392","url":null,"abstract":"","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2023-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42379322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
“Transforming” Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing “转换”人格量表的发展:说明最先进的自然语言处理的潜力
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2023-03-06 DOI: 10.1177/10944281231155771
Shea Fyffe, Philseok Lee, Seth A. Kaplan
Natural language processing (NLP) techniques are becoming increasingly popular in industrial and organizational psychology. One promising area for NLP-based applications is scale development; yet, while many possibilities exist, so far these applications have been restricted—mainly focusing on automated item generation. The current research expands this potential by illustrating an NLP-based approach to content analysis, which manually categorizes scale items by their measured constructs. In NLP, content analysis is performed as a text classification task whereby a model is trained to automatically assign scale items to the construct that they measure. Here, we present an approach to text classification—using state-of-the-art transformer models—that builds upon past approaches. We begin by introducing transformer models and their advantages over alternative methods. Next, we illustrate how to train a transformer to content analyze Big Five personality items. Then, we compare the models trained to human raters, finding that transformer models outperform human raters and several alternative models. Finally, we present practical considerations, limitations, and future research directions.
自然语言处理(NLP)技术在工业心理学和组织心理学中越来越受欢迎。基于nlp的应用程序的一个有前途的领域是规模开发;然而,尽管存在许多可能性,但到目前为止,这些应用程序还受到限制——主要集中在自动生成项目上。目前的研究通过说明基于nlp的内容分析方法扩展了这一潜力,该方法通过测量的结构手动对量表项目进行分类。在NLP中,内容分析作为文本分类任务执行,其中模型被训练以自动将刻度项分配给它们测量的构造。在这里,我们提出了一种基于过去方法的文本分类方法——使用最先进的变压器模型。我们首先介绍变压器模型及其相对于替代方法的优势。接下来,我们将说明如何训练一个转换器来分析五大人格项目。然后,我们将训练的模型与人类评级器进行比较,发现变压器模型优于人类评级器和几个替代模型。最后,提出了现实考虑、局限性和未来的研究方向。
{"title":"“Transforming” Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing","authors":"Shea Fyffe, Philseok Lee, Seth A. Kaplan","doi":"10.1177/10944281231155771","DOIUrl":"https://doi.org/10.1177/10944281231155771","url":null,"abstract":"Natural language processing (NLP) techniques are becoming increasingly popular in industrial and organizational psychology. One promising area for NLP-based applications is scale development; yet, while many possibilities exist, so far these applications have been restricted—mainly focusing on automated item generation. The current research expands this potential by illustrating an NLP-based approach to content analysis, which manually categorizes scale items by their measured constructs. In NLP, content analysis is performed as a text classification task whereby a model is trained to automatically assign scale items to the construct that they measure. Here, we present an approach to text classification—using state-of-the-art transformer models—that builds upon past approaches. We begin by introducing transformer models and their advantages over alternative methods. Next, we illustrate how to train a transformer to content analyze Big Five personality items. Then, we compare the models trained to human raters, finding that transformer models outperform human raters and several alternative models. Finally, we present practical considerations, limitations, and future research directions.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2023-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47097386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Supervised Construct Scoring to Reduce Personality Assessment Length: A Field Study and Introduction to the Short 10 监督构式计分法减少人格评估长度:一项实地研究及简短的介绍
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2023-01-03 DOI: 10.1177/10944281221145694
Andrew B. Speer, James Perrotta, R. Jacobs
Personality assessments help identify qualified job applicants when making hiring decisions and are used broadly in the organizational sciences. However, many existing personality measures are quite lengthy, and companies and researchers frequently seek ways to shorten personality scales. The current research investigated the effectiveness of a new scale-shortening method called supervised construct scoring (SCS), testing the efficacy of this method across two applied samples. Using a combination of machine learning with content validity considerations, we show that multidimensional personality scales can be significantly shortened while maintaining reliability and validity, and especially when compared to traditional shortening methods. In Study 1, we shortened a 100-item personality assessment of DeYoung et al.'s 10 facets, producing a scale 26% the original length. SCS scores exhibited strong evidence of reliability, convergence with full scale scores, and criterion-related validity. This measure, labeled the Short 10, is made freely available. In Study 2, we applied SCS to shorten an operational police personality assessment. By using SCS, we reduced test length to 25% of the original length while maintaining similar levels of reliability and criterion-related validity when predicting job performance ratings.
性格评估有助于在做出招聘决定时确定合格的求职者,并在组织科学中得到广泛应用。然而,许多现有的人格测试都相当长,公司和研究人员经常寻求缩短人格量表的方法。目前的研究调查了一种名为监督结构评分(SCS)的新型量表缩短方法的有效性,测试了该方法在两个应用样本中的有效性。结合机器学习和内容效度的考虑,我们表明多维人格量表可以在保持信度和效度的同时显着缩短,特别是与传统的缩短方法相比。在研究1中,我们缩短了DeYoung等人的10个方面的100项人格评估,产生了原始长度的26%。SCS评分表现出强有力的可靠性、与全量表评分的收敛性和标准相关的效度。这个指标被称为Short 10,是免费提供的。在研究2中,我们应用SCS来缩短一个行动警察的人格评估。通过使用SCS,我们将测试长度减少到原始长度的25%,同时在预测工作绩效评级时保持相似的信度和标准相关效度水平。
{"title":"Supervised Construct Scoring to Reduce Personality Assessment Length: A Field Study and Introduction to the Short 10","authors":"Andrew B. Speer, James Perrotta, R. Jacobs","doi":"10.1177/10944281221145694","DOIUrl":"https://doi.org/10.1177/10944281221145694","url":null,"abstract":"Personality assessments help identify qualified job applicants when making hiring decisions and are used broadly in the organizational sciences. However, many existing personality measures are quite lengthy, and companies and researchers frequently seek ways to shorten personality scales. The current research investigated the effectiveness of a new scale-shortening method called supervised construct scoring (SCS), testing the efficacy of this method across two applied samples. Using a combination of machine learning with content validity considerations, we show that multidimensional personality scales can be significantly shortened while maintaining reliability and validity, and especially when compared to traditional shortening methods. In Study 1, we shortened a 100-item personality assessment of DeYoung et al.'s 10 facets, producing a scale 26% the original length. SCS scores exhibited strong evidence of reliability, convergence with full scale scores, and criterion-related validity. This measure, labeled the Short 10, is made freely available. In Study 2, we applied SCS to shorten an operational police personality assessment. By using SCS, we reduced test length to 25% of the original length while maintaining similar levels of reliability and criterion-related validity when predicting job performance ratings.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2023-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48250283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Review Research as Scientific Inquiry 评论研究作为科学探究
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2022-12-26 DOI: 10.1177/10944281221127292
Sven Kunisch, D. Denyer, J. Bartunek, Markus Menz, Laura B. Cardinal
This article and the related Feature Topic at Organizational Research Methods upcoming were motivated by the concern that despite the bourgeoning number and diversity of review articles, there was a lack of guidance on how to produce rigorous and impactful literature reviews. In this article, we introduce review research as a class of research inquiries that uses prior research as data sources to develop knowledge contributions for academia, practice and policy. We first trace the evolution of review research both outside of and within management including the articles published in this Feature Topic, and provide a holistic definition of review research. Then, we argue that in the plurality of forms of review research, the alignment of purpose and methods is crucial for high-quality review research. To accomplish this, we discuss several review purposes and criteria for assessing review research's rigor and impact, and discuss how these and the review methods need to be aligned with its purpose. Our paper provides guidance for conducting or evaluating review research and helps establish review research as a credible and legitimate scientific endeavor.
这篇文章和即将发表的组织研究方法的相关专题的动机是,尽管综述文章的数量和多样性不断增加,但缺乏关于如何产生严格和有影响力的文献综述的指导。在这篇文章中,我们将回顾研究作为一类研究调查,使用先前的研究作为数据源,为学术界、实践和政策发展知识贡献。我们首先追溯了管理层内外评论研究的演变,包括本专题中发表的文章,并对评论研究进行了全面定义。然后,我们认为,在多种形式的综述研究中,目的和方法的一致性对于高质量的综述研究至关重要。为了实现这一点,我们讨论了评估综述研究的严谨性和影响的几个综述目的和标准,并讨论了这些目的和综述方法需要如何与其目的相一致。我们的论文为开展或评估综述研究提供了指导,并有助于将综述研究确立为一项可信和合法的科学努力。
{"title":"Review Research as Scientific Inquiry","authors":"Sven Kunisch, D. Denyer, J. Bartunek, Markus Menz, Laura B. Cardinal","doi":"10.1177/10944281221127292","DOIUrl":"https://doi.org/10.1177/10944281221127292","url":null,"abstract":"This article and the related Feature Topic at Organizational Research Methods upcoming were motivated by the concern that despite the bourgeoning number and diversity of review articles, there was a lack of guidance on how to produce rigorous and impactful literature reviews. In this article, we introduce review research as a class of research inquiries that uses prior research as data sources to develop knowledge contributions for academia, practice and policy. We first trace the evolution of review research both outside of and within management including the articles published in this Feature Topic, and provide a holistic definition of review research. Then, we argue that in the plurality of forms of review research, the alignment of purpose and methods is crucial for high-quality review research. To accomplish this, we discuss several review purposes and criteria for assessing review research's rigor and impact, and discuss how these and the review methods need to be aligned with its purpose. Our paper provides guidance for conducting or evaluating review research and helps establish review research as a credible and legitimate scientific endeavor.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2022-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43364600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
SRM_R: A Web-Based Shiny App for Social Relations Analyses SRM_R:一个基于网络的闪亮的社会关系分析应用程序
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2022-11-20 DOI: 10.1177/10944281221134104
Man-Nok Wong, D. Kenny, A. Knight
Many topics in organizational research involve examining the interpersonal perceptions and behaviors of group members. The resulting data can be analyzed using the social relations model (SRM). This model enables researchers to address several important questions regarding relational phenomena. In the model, variance can be partitioned into group, actor, partner, and relationship; reciprocity can be assessed in terms of individuals and dyads; and predictors at each of these levels can be analyzed. However, analyzing data using the currently available SRM software can be challenging and can deter organizational researchers from using the model. In this article, we provide a “go-to” introduction to SRM analyses and propose SRM_R ( https://davidakenny.shinyapps.io/SRM_R/ ), an accessible and user-friendly, web-based application for SRM analyses. The basic steps of conducting SRM analyses in the app are illustrated with a sample dataset of 47 teams, 228 members, and 884 dyadic observations, using the participants’ ratings of the advice-seeking behavior of their fellow employees.
组织研究中的许多主题都涉及到考察团队成员的人际感知和行为。可以使用社会关系模型(SRM)来分析所得到的数据。该模型使研究人员能够解决有关关系现象的几个重要问题。在模型中,方差可以划分为群体、参与者、伙伴和关系;互惠可以从个人和二人组的角度进行评估;并且可以分析这些级别中的每一个级别的预测因子。然而,使用当前可用的SRM软件分析数据可能具有挑战性,并可能阻止组织研究人员使用该模型。在本文中,我们提供了SRM分析的“入门”介绍,并提出了SRM_R(https://davidakenny.shinyapps.io/SRM_R/),一个可访问且用户友好的基于web的SRM分析应用程序。应用程序中进行SRM分析的基本步骤由47个团队、228名成员和884个二元观察的样本数据集说明,使用参与者对同事寻求建议行为的评分。
{"title":"SRM_R: A Web-Based Shiny App for Social Relations Analyses","authors":"Man-Nok Wong, D. Kenny, A. Knight","doi":"10.1177/10944281221134104","DOIUrl":"https://doi.org/10.1177/10944281221134104","url":null,"abstract":"Many topics in organizational research involve examining the interpersonal perceptions and behaviors of group members. The resulting data can be analyzed using the social relations model (SRM). This model enables researchers to address several important questions regarding relational phenomena. In the model, variance can be partitioned into group, actor, partner, and relationship; reciprocity can be assessed in terms of individuals and dyads; and predictors at each of these levels can be analyzed. However, analyzing data using the currently available SRM software can be challenging and can deter organizational researchers from using the model. In this article, we provide a “go-to” introduction to SRM analyses and propose SRM_R ( https://davidakenny.shinyapps.io/SRM_R/ ), an accessible and user-friendly, web-based application for SRM analyses. The basic steps of conducting SRM analyses in the app are illustrated with a sample dataset of 47 teams, 228 members, and 884 dyadic observations, using the participants’ ratings of the advice-seeking behavior of their fellow employees.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2022-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48039279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Sensitizing Social Interaction with a Mode-Enhanced Transcribing Process 用模式增强转录过程使社会互动敏感化
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2022-10-31 DOI: 10.1177/10944281221134096
Qian Li
Qualitative researchers often work with texts transcribed from social interactions such as interviews, meetings, and presentations. However, how we make sense of such data to generate promising cues for further analysis is rarely discussed. This article proposes mode-enhanced transcription as a tool for sensitizing social interaction data, defined as a process in which researchers attune their attention to the dynamic interplay of verbal and nonverbal features, expressions, and acts when transcribing and proofreading professional transcripts. Two scenarios for using mode-enhanced transcription are introduced: sensitizing previously collected data and engaging with modes purposefully. Their implications for research focus, data collection, and data analysis are discussed based on a demonstration of the process with a previously collected dataset and an illustrative review of published articles that display mode-enhanced excerpts. The article outlines the benefits and further considerations of using mode-enhanced transcription as a sensitizing tool.
定性研究人员经常使用从访谈、会议和演讲等社会互动中转录的文本。然而,我们如何理解这些数据,为进一步分析提供有希望的线索,却很少被讨论。本文提出模式增强转录作为敏感社会互动数据的工具,定义为一个过程,在这个过程中,研究人员在转录和校对专业成绩单时,将他们的注意力调整到语言和非语言特征、表情和行为的动态相互作用上。介绍了使用模式增强转录的两种情况:敏感化以前收集的数据和有目的地参与模式。它们对研究重点、数据收集和数据分析的影响是基于先前收集的数据集的过程演示和对显示模式增强摘录的已发表文章的说明性回顾来讨论的。文章概述了使用模式增强转录作为增敏工具的好处和进一步的考虑。
{"title":"Sensitizing Social Interaction with a Mode-Enhanced Transcribing Process","authors":"Qian Li","doi":"10.1177/10944281221134096","DOIUrl":"https://doi.org/10.1177/10944281221134096","url":null,"abstract":"Qualitative researchers often work with texts transcribed from social interactions such as interviews, meetings, and presentations. However, how we make sense of such data to generate promising cues for further analysis is rarely discussed. This article proposes mode-enhanced transcription as a tool for sensitizing social interaction data, defined as a process in which researchers attune their attention to the dynamic interplay of verbal and nonverbal features, expressions, and acts when transcribing and proofreading professional transcripts. Two scenarios for using mode-enhanced transcription are introduced: sensitizing previously collected data and engaging with modes purposefully. Their implications for research focus, data collection, and data analysis are discussed based on a demonstration of the process with a previously collected dataset and an illustrative review of published articles that display mode-enhanced excerpts. The article outlines the benefits and further considerations of using mode-enhanced transcription as a sensitizing tool.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2022-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45729472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessment of Path Model Fit: Evidence of Effectiveness and Recommendations for use of the RMSEA-P 路径模型拟合评估:有效性证据和RMSEA-P使用建议
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2022-10-17 DOI: 10.1177/10944281221124946
L. J. Williams, Aaron R. Williams, Ernest H. O’Boyle
We review the development of path model fit measures for latent variable models and highlight how they are different from global fit measures. Next, we consider findings from two published simulation articles that reach different conclusions about the effectiveness of one path model fit measure (RMSEA-P). We then report the results of a new simulation study aimed at resolving the questions of whether and how the RMSEA-P should be used by organizational researchers. These results show that the RMSEA-P and its confidence interval is very effective with multiple indicator models at identifying misspecifications across large and small sample sizes and is effective at identifying true models at moderate to large sample sizes. We conclude with recommendations for how the RMSEA-P can be incorporated along with other information into model evaluation.
我们回顾了潜在变量模型的路径模型拟合措施的发展,并强调了它们与全局拟合措施的不同之处。接下来,我们考虑了两篇发表的模拟文章的发现,这些文章对单路径模型拟合度量(RMSEA-P)的有效性得出了不同的结论。然后,我们报告了一项新的模拟研究的结果,该研究旨在解决组织研究人员是否应该以及如何使用RMSEA-P的问题。这些结果表明,RMSEA-P及其置信区间在识别大样本和小样本的错误规范方面对多指标模型非常有效,并且在识别中等到大样本的真实模型方面非常有效。最后,我们对如何将RMSEA-P与其他信息一起纳入模型评估提出了建议。
{"title":"Assessment of Path Model Fit: Evidence of Effectiveness and Recommendations for use of the RMSEA-P","authors":"L. J. Williams, Aaron R. Williams, Ernest H. O’Boyle","doi":"10.1177/10944281221124946","DOIUrl":"https://doi.org/10.1177/10944281221124946","url":null,"abstract":"We review the development of path model fit measures for latent variable models and highlight how they are different from global fit measures. Next, we consider findings from two published simulation articles that reach different conclusions about the effectiveness of one path model fit measure (RMSEA-P). We then report the results of a new simulation study aimed at resolving the questions of whether and how the RMSEA-P should be used by organizational researchers. These results show that the RMSEA-P and its confidence interval is very effective with multiple indicator models at identifying misspecifications across large and small sample sizes and is effective at identifying true models at moderate to large sample sizes. We conclude with recommendations for how the RMSEA-P can be incorporated along with other information into model evaluation.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2022-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44950558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measuring What Matters: Assessing how Executives Reference Firm Performance in Corporate Filings 衡量重要因素:评估高管在公司文件中如何参考公司业绩
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2022-10-11 DOI: 10.1177/10944281221125160
S. Certo, Chunhu Jeon, Kristen A. Raney, Wookyung Lee
We know very little about the performance measures executives use to make decisions. To fill this void, we investigate the performance variables that executives reference in corporate filings with the SEC. Our analyses suggest that executives refer to monetary variables (i.e., revenue, profit, and cash flow) in over 98% of filings. In contrast, executives refer to the unitless performance measures scaled by size (i.e., return on assets, return on equity), which are favored by organizational scholars, in less than 15% of filings. We find that this preference for unscaled measures remains across market capitalization and actual firm performance. In other words, even observations with the highest levels of ROA and ROE are more likely to include monetary measures as opposed to ratios. In fact, we find that almost every observation that references ratios also includes monetary measures of firm performance. Stated differently, our findings suggest executives use ratios in addition to—and not instead of—monetary measures. We discuss research opportunities for scholars to further align with the practitioner perspective and to revisit conceptualizations of firm performance.
我们对高管们用于决策的绩效指标知之甚少。为了填补这一空白,我们调查了高管在向美国证券交易委员会提交的公司文件中提到的绩效变量。我们的分析表明,高管在98%以上的文件中提到了货币变量(即收入、利润和现金流)。相比之下,高管们在不到15%的文件中提到了按规模衡量的无单位绩效指标(即资产回报率、股本回报率),这受到了组织学者的青睐。我们发现,这种对未分级指标的偏好在整个市值和实际公司业绩中仍然存在。换言之,即使ROA和ROE水平最高的观察结果也更有可能包括货币措施,而不是比率。事实上,我们发现几乎每一个引用比率的观察结果都包括对公司业绩的货币衡量。换句话说,我们的研究结果表明,高管们除了使用货币指标之外,还使用比率,而不是代替货币指标。我们讨论了学者进一步与从业者观点保持一致并重新审视企业绩效概念的研究机会。
{"title":"Measuring What Matters: Assessing how Executives Reference Firm Performance in Corporate Filings","authors":"S. Certo, Chunhu Jeon, Kristen A. Raney, Wookyung Lee","doi":"10.1177/10944281221125160","DOIUrl":"https://doi.org/10.1177/10944281221125160","url":null,"abstract":"We know very little about the performance measures executives use to make decisions. To fill this void, we investigate the performance variables that executives reference in corporate filings with the SEC. Our analyses suggest that executives refer to monetary variables (i.e., revenue, profit, and cash flow) in over 98% of filings. In contrast, executives refer to the unitless performance measures scaled by size (i.e., return on assets, return on equity), which are favored by organizational scholars, in less than 15% of filings. We find that this preference for unscaled measures remains across market capitalization and actual firm performance. In other words, even observations with the highest levels of ROA and ROE are more likely to include monetary measures as opposed to ratios. In fact, we find that almost every observation that references ratios also includes monetary measures of firm performance. Stated differently, our findings suggest executives use ratios in addition to—and not instead of—monetary measures. We discuss research opportunities for scholars to further align with the practitioner perspective and to revisit conceptualizations of firm performance.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2022-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45607947","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Should Moderated Regressions Include or Exclude Quadratic Terms? Present Both! Then Apply Our Linear Algebraic Analysis to Identify the Preferable Specification 适度回归应该包括还是排除二次项?同时出示!然后应用我们的线性代数分析来识别优选规范
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2022-10-11 DOI: 10.1177/10944281221124945
A. Kalnins
Organizational research increasingly tests moderated relationships using multiple regression with interaction terms. Most research does so with little concern regarding curvilinear relationships. But methodologists have established that omitting quadratic terms of correlated primary variables may create false interaction positives (type 1 errors). If dependent variables are generated by the canonical process where fully specified regressions satisfy the Gauss-Markov assumptions, including quadratics solves the problem. But our empirical analysis of published organizational research suggests that dependent variables are often generated by processes where, even with quadratics included, regression analyses will remain Gauss-Markov non-compliant. In such cases, our linear algebraic analysis demonstrates that including quadratics—even those motivated by compelling theory—may exacerbate rather than mitigate the incidence of false interaction positives. The interaction coefficient may substantially change its magnitude and even flip sign once quadratics are included, and not necessarily for the better. We encourage researchers to present two full sets of results when testing moderating hypotheses—one with, and one without, quadratic terms. Researchers should then answer five questions developed here in order to determine the preferable set of results.
组织研究越来越多地使用交互项的多元回归来测试调节关系。大多数研究都很少关注曲线关系。但方法论者已经证实,省略相关主变量的二次项可能会产生假交互阳性(1型错误)。如果因变量是由正则过程生成的,其中完全指定的回归满足高斯-马尔可夫假设,包括二次方可以解决问题。但我们对已发表的组织研究的实证分析表明,因变量通常是由过程产生的,即使包括二次方,回归分析也将保持高斯-马尔可夫不符合。在这种情况下,我们的线性代数分析表明,包括象限——即使是那些受令人信服的理论驱动的象限——可能会加剧而不是减轻虚假交互阳性的发生率。一旦包括象限,相互作用系数可能会显著改变其大小,甚至翻转符号,而不一定是为了更好。我们鼓励研究人员在测试调节假设时提出两组完整的结果——一组有二次项,另一组没有二次项。然后,研究人员应该回答这里提出的五个问题,以确定一组更可取的结果。
{"title":"Should Moderated Regressions Include or Exclude Quadratic Terms? Present Both! Then Apply Our Linear Algebraic Analysis to Identify the Preferable Specification","authors":"A. Kalnins","doi":"10.1177/10944281221124945","DOIUrl":"https://doi.org/10.1177/10944281221124945","url":null,"abstract":"Organizational research increasingly tests moderated relationships using multiple regression with interaction terms. Most research does so with little concern regarding curvilinear relationships. But methodologists have established that omitting quadratic terms of correlated primary variables may create false interaction positives (type 1 errors). If dependent variables are generated by the canonical process where fully specified regressions satisfy the Gauss-Markov assumptions, including quadratics solves the problem. But our empirical analysis of published organizational research suggests that dependent variables are often generated by processes where, even with quadratics included, regression analyses will remain Gauss-Markov non-compliant. In such cases, our linear algebraic analysis demonstrates that including quadratics—even those motivated by compelling theory—may exacerbate rather than mitigate the incidence of false interaction positives. The interaction coefficient may substantially change its magnitude and even flip sign once quadratics are included, and not necessarily for the better. We encourage researchers to present two full sets of results when testing moderating hypotheses—one with, and one without, quadratic terms. Researchers should then answer five questions developed here in order to determine the preferable set of results.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2022-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45785943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Organizational Research Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1