首页 > 最新文献

Organizational Research Methods最新文献

英文 中文
New Network Models for the Analysis of Social Contagion in Organizations: An Introduction to Autologistic Actor Attribute Models 组织中社会传染分析的新网络模型:自行为者属性模型导论
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-04-20 DOI: 10.1177/10944281211005167
Andrew Parker, F. Pallotti, A. Lomi
Autologistic actor attribute models (ALAAMs) provide new analytical opportunities to advance research on how individual attitudes, cognitions, behaviors, and outcomes diffuse through networks of social relations in which individuals in organizations are embedded. ALAAMs add to available statistical models of social contagion the possibility of formulating and testing competing hypotheses about the specific mechanisms that shape patterns of adoption/diffusion. The main objective of this article is to provide an introduction and a guide to the specification, estimation, interpretation and evaluation of ALAAMs. Using original data, we demonstrate the value of ALAAMs in an analysis of academic performance and social networks in a class of graduate management students. We find evidence that both high and low performance are contagious, that is, diffuse through social contact. However, the contagion mechanisms that contribute to the diffusion of high performance and low performance differ subtly and systematically. Our results help us identify new questions that ALAAMs allow us to ask, new answers they may be able to provide, and the constraints that need to be relaxed to facilitate their more general adoption in organizational research.
自言行为者属性模型(ALAAMs)为研究个体态度、认知、行为和结果如何在组织中嵌入个体的社会关系网络中扩散提供了新的分析机会。alaam增加了现有社会传染统计模型的可能性,使我们能够就形成采用/扩散模式的具体机制提出和检验相互竞争的假设。本文的主要目的是提供一个介绍和指导的规范,估计,解释和评估的警报。利用原始数据,我们通过分析一个管理学研究生班级的学习成绩和社会网络来证明alaam的价值。我们发现证据表明,高绩效和低绩效都是具有传染性的,即通过社会接触传播。然而,导致高绩效和低绩效扩散的传染机制存在微妙而系统的差异。我们的结果帮助我们确定alaam允许我们提出的新问题,它们可能提供的新答案,以及需要放松的约束,以促进它们在组织研究中的更普遍采用。
{"title":"New Network Models for the Analysis of Social Contagion in Organizations: An Introduction to Autologistic Actor Attribute Models","authors":"Andrew Parker, F. Pallotti, A. Lomi","doi":"10.1177/10944281211005167","DOIUrl":"https://doi.org/10.1177/10944281211005167","url":null,"abstract":"Autologistic actor attribute models (ALAAMs) provide new analytical opportunities to advance research on how individual attitudes, cognitions, behaviors, and outcomes diffuse through networks of social relations in which individuals in organizations are embedded. ALAAMs add to available statistical models of social contagion the possibility of formulating and testing competing hypotheses about the specific mechanisms that shape patterns of adoption/diffusion. The main objective of this article is to provide an introduction and a guide to the specification, estimation, interpretation and evaluation of ALAAMs. Using original data, we demonstrate the value of ALAAMs in an analysis of academic performance and social networks in a class of graduate management students. We find evidence that both high and low performance are contagious, that is, diffuse through social contact. However, the contagion mechanisms that contribute to the diffusion of high performance and low performance differ subtly and systematically. Our results help us identify new questions that ALAAMs allow us to ask, new answers they may be able to provide, and the constraints that need to be relaxed to facilitate their more general adoption in organizational research.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/10944281211005167","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41724651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Temporal Brokering: A Measure of Brokerage as a Behavioral Process 时间中介:作为一种行为过程的中介度量
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-04-15 DOI: 10.1177/10944281211002911
E. Quintane, M. Wood, John Dunn, L. Falzon
Extant research in organizational networks has provided critical insights into understanding the benefits of occupying a brokerage position. More recently, researchers have moved beyond the brokerage position to consider the brokering processes (arbitration and collaboration) brokers engage in and their implications for performance. However, brokering processes are typically measured using scales that reflect individuals’ orientation toward engaging in a behavior, rather than the behavior itself. In this article, we propose a measure that captures the behavioral process of brokering. The measure indicates the extent to which actors engage in arbitration versus collaboration based on sequences of time stamped relational events, such as emails, message boards, and recordings of meetings. We demonstrate the validity of our measure as well as its predictive ability. By leveraging the temporal information inherent in sequences of relational events, our behavioral measure of brokering creates opportunities for researchers to explore the dynamics of brokerage and their impact on individuals, and also paves the way for a systematic examination of the temporal dynamics of networks.
对组织网络的现有研究为理解担任经纪职位的好处提供了重要的见解。最近,研究人员已经超越了经纪的立场,考虑了经纪参与的经纪过程(仲裁和合作)及其对业绩的影响。然而,中介过程通常使用反映个人参与行为取向的量表来衡量,而不是行为本身。在本文中,我们提出了一种捕捉代理行为过程的度量。该指标表明了参与者参与仲裁与基于时间戳关系事件序列的合作的程度,如电子邮件、留言板和会议记录。我们证明了我们的测量方法的有效性及其预测能力。通过利用关系事件序列中固有的时间信息,我们对中介的行为测量为研究人员探索中介的动态及其对个人的影响创造了机会,也为系统地研究网络的时间动态铺平了道路。
{"title":"Temporal Brokering: A Measure of Brokerage as a Behavioral Process","authors":"E. Quintane, M. Wood, John Dunn, L. Falzon","doi":"10.1177/10944281211002911","DOIUrl":"https://doi.org/10.1177/10944281211002911","url":null,"abstract":"Extant research in organizational networks has provided critical insights into understanding the benefits of occupying a brokerage position. More recently, researchers have moved beyond the brokerage position to consider the brokering processes (arbitration and collaboration) brokers engage in and their implications for performance. However, brokering processes are typically measured using scales that reflect individuals’ orientation toward engaging in a behavior, rather than the behavior itself. In this article, we propose a measure that captures the behavioral process of brokering. The measure indicates the extent to which actors engage in arbitration versus collaboration based on sequences of time stamped relational events, such as emails, message boards, and recordings of meetings. We demonstrate the validity of our measure as well as its predictive ability. By leveraging the temporal information inherent in sequences of relational events, our behavioral measure of brokering creates opportunities for researchers to explore the dynamics of brokerage and their impact on individuals, and also paves the way for a systematic examination of the temporal dynamics of networks.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/10944281211002911","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47591297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Faking Detection Improved: Adopting a Likert Item Response Process Tree Model 改进伪造检测:采用李克特项目反应过程树模型
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-04-15 DOI: 10.1177/10944281211002904
Tianjun Sun, Bo Zhang, Mengyang Cao, F. Drasgow
With the increasing popularity of noncognitive inventories in personnel selection, organizations typically wish to be able to tell when a job applicant purposefully manufactures a favorable impression. Past faking research has primarily focused on how to reduce faking via instrument design, warnings, and statistical corrections for faking. This article took a new approach by examining the effects of faking (experimentally manipulated and contextually driven) on response processes. We modified a recently introduced item response theory tree modeling procedure, the three-process model, to identify faking in two studies. Study 1 examined self-reported vocational interest assessment responses using an induced faking experimental design. Study 2 examined self-reported personality assessment responses when some people were in a high-stakes situation (i.e., selection). Across the two studies, individuals instructed or expected to fake were found to engage in more extreme responding. By identifying the underlying differences between fakers and honest respondents, the new approach improves our understanding of faking. Percentage cutoffs based on extreme responding produced a faker classification precision of 85% on average.
随着非认知量表在人员选择中的日益普及,组织通常希望能够判断求职者何时有意制造一个良好的印象。过去的作假研究主要集中在如何通过仪器设计、警告和作假的统计校正来减少作假。本文采用了一种新的方法,通过研究作假(实验操纵和情境驱动)对反应过程的影响。我们修改了最近引入的项目反应理论树模型程序,即三过程模型,以在两项研究中识别虚假。研究1采用诱导伪造实验设计检验自我报告的职业兴趣评估反应。研究2检查了一些人在高风险情况下(即选择)自我报告的人格评估反应。在这两项研究中,被指示或被期望撒谎的人会做出更极端的反应。通过识别伪造者和诚实受访者之间的潜在差异,这种新方法提高了我们对伪造的理解。基于极端反应的百分比截断产生了平均85%的虚假分类精度。
{"title":"Faking Detection Improved: Adopting a Likert Item Response Process Tree Model","authors":"Tianjun Sun, Bo Zhang, Mengyang Cao, F. Drasgow","doi":"10.1177/10944281211002904","DOIUrl":"https://doi.org/10.1177/10944281211002904","url":null,"abstract":"With the increasing popularity of noncognitive inventories in personnel selection, organizations typically wish to be able to tell when a job applicant purposefully manufactures a favorable impression. Past faking research has primarily focused on how to reduce faking via instrument design, warnings, and statistical corrections for faking. This article took a new approach by examining the effects of faking (experimentally manipulated and contextually driven) on response processes. We modified a recently introduced item response theory tree modeling procedure, the three-process model, to identify faking in two studies. Study 1 examined self-reported vocational interest assessment responses using an induced faking experimental design. Study 2 examined self-reported personality assessment responses when some people were in a high-stakes situation (i.e., selection). Across the two studies, individuals instructed or expected to fake were found to engage in more extreme responding. By identifying the underlying differences between fakers and honest respondents, the new approach improves our understanding of faking. Percentage cutoffs based on extreme responding produced a faker classification precision of 85% on average.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/10944281211002904","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45621939","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
Corrigendum to On Ignoring the Random Effects Assumption in Multilevel Models: Review, Critique, and Recommendations 关于忽略多层次模型中随机效应假设的更正:综述、批评和建议
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-04-01 DOI: 10.1177/10944281211002293
{"title":"Corrigendum to On Ignoring the Random Effects Assumption in Multilevel Models: Review, Critique, and Recommendations","authors":"","doi":"10.1177/10944281211002293","DOIUrl":"https://doi.org/10.1177/10944281211002293","url":null,"abstract":"","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/10944281211002293","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43139192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Meta-Analyses as a Multi-Level Model 元分析作为一个多层次模型
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-04-01 DOI: 10.1177/1094428119857471
Janaki Gooty, G. Banks, Andrew C. Loignon, Scott Tonidandel, Courtney E. Williams
Meta-analyses are well known and widely implemented in almost every domain of research in management as well as the social, medical, and behavioral sciences. While this technique is useful for determining validity coefficients (i.e., effect sizes), meta-analyses are predicated on the assumption of independence of primary effect sizes, which might be routinely violated in the organizational sciences. Here, we discuss the implications of violating the independence assumption and demonstrate how meta-analysis could be cast as a multilevel, variance known (Vknown) model to account for such dependency in primary studies’ effect sizes. We illustrate such techniques for meta-analytic data via the HLM 7.0 software as it remains the most widely used multilevel analyses software in management. In so doing, we draw on examples in educational psychology (where such techniques were first developed), organizational sciences, and a Monte Carlo simulation (Appendix). We conclude with a discussion of implications, caveats, and future extensions. Our Appendix details features of a newly developed application that is free (based on R), user-friendly, and provides an alternative to the HLM program.
元分析是众所周知的,并在管理以及社会、医学和行为科学的几乎每个研究领域广泛应用。虽然这项技术有助于确定有效性系数(即效应大小),但荟萃分析是基于主要效应大小独立性的假设进行的,这在组织科学中可能经常被违反。在这里,我们讨论了违反独立性假设的含义,并证明了荟萃分析如何被视为一个多水平、方差已知(Vknown)模型,以解释初级研究效果大小中的这种依赖性。我们通过HLM 7.0软件说明了元分析数据的这些技术,因为它仍然是管理中使用最广泛的多级分析软件。在这样做的过程中,我们借鉴了教育心理学(这类技术最初是在那里开发的)、组织科学和蒙特卡洛模拟(附录)中的例子。最后,我们讨论了影响、注意事项和未来的扩展。我们的附录详细介绍了一个新开发的应用程序的功能,该应用程序是免费的(基于R),用户友好,并提供了HLM程序的替代方案。
{"title":"Meta-Analyses as a Multi-Level Model","authors":"Janaki Gooty, G. Banks, Andrew C. Loignon, Scott Tonidandel, Courtney E. Williams","doi":"10.1177/1094428119857471","DOIUrl":"https://doi.org/10.1177/1094428119857471","url":null,"abstract":"Meta-analyses are well known and widely implemented in almost every domain of research in management as well as the social, medical, and behavioral sciences. While this technique is useful for determining validity coefficients (i.e., effect sizes), meta-analyses are predicated on the assumption of independence of primary effect sizes, which might be routinely violated in the organizational sciences. Here, we discuss the implications of violating the independence assumption and demonstrate how meta-analysis could be cast as a multilevel, variance known (Vknown) model to account for such dependency in primary studies’ effect sizes. We illustrate such techniques for meta-analytic data via the HLM 7.0 software as it remains the most widely used multilevel analyses software in management. In so doing, we draw on examples in educational psychology (where such techniques were first developed), organizational sciences, and a Monte Carlo simulation (Appendix). We conclude with a discussion of implications, caveats, and future extensions. Our Appendix details features of a newly developed application that is free (based on R), user-friendly, and provides an alternative to the HLM program.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428119857471","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47635585","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Long-Run Effects in Dynamic Systems: New Tools for Cross-Lagged Panel Models 动态系统的长期效应:交叉滞后面板模型的新工具
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-03-19 DOI: 10.1177/1094428121993228
A. Shamsollahi, M. Zyphur, Ozlem Ozkok
Cross-lagged panel models (CLPMs) are common, but their applications often focus on “short-run” effects among temporally proximal observations. This addresses questions about how dynamic systems may immediately respond to interventions, but fails to show how systems evolve over longer timeframes. We explore three types of “long-run” effects in dynamic systems that extend recent work on “impulse responses,” which reflect potential long-run effects of one-time interventions. Going beyond these, we first treat evaluations of system (in)stability by testing for “permanent effects,” which are important because in unstable systems even a one-time intervention may have enduring effects. Second, we explore classic econometric long-run effects that show how dynamic systems may respond to interventions that are sustained over time. Third, we treat “accumulated responses” to model how systems may respond to repeated interventions over time. We illustrate tests of each long-run effect in a simulated dataset and we provide all materials online including user-friendly R code that automates estimating, testing, reporting, and plotting all effects (see https://doi.org/10.26188/13506861). We conclude by emphasizing the value of aligning specific longitudinal hypotheses with quantitative methods.
交叉滞后面板模型(clpm)是常见的,但它们的应用往往侧重于“短期”影响的时间近端观测。这解决了动态系统如何立即对干预作出反应的问题,但未能显示系统如何在更长的时间框架内进化。我们探索了动态系统中三种类型的“长期”效应,这些效应扩展了最近对“冲动反应”的研究,反映了一次性干预的潜在长期效应。除此之外,我们首先通过测试“永久影响”来评估系统的稳定性,这很重要,因为在不稳定的系统中,即使是一次性的干预也可能产生持久的影响。其次,我们探索了经典的计量经济学长期效应,展示了动态系统如何对持续一段时间的干预做出反应。第三,我们处理“累积反应”来模拟系统如何随着时间的推移对重复干预作出反应。我们在模拟数据集中演示了每个长期效果的测试,并在线提供了所有材料,包括用户友好的R代码,可自动评估、测试、报告和绘制所有效果(参见https://doi.org/10.26188/13506861)。最后,我们强调将具体的纵向假设与定量方法结合起来的价值。
{"title":"Long-Run Effects in Dynamic Systems: New Tools for Cross-Lagged Panel Models","authors":"A. Shamsollahi, M. Zyphur, Ozlem Ozkok","doi":"10.1177/1094428121993228","DOIUrl":"https://doi.org/10.1177/1094428121993228","url":null,"abstract":"Cross-lagged panel models (CLPMs) are common, but their applications often focus on “short-run” effects among temporally proximal observations. This addresses questions about how dynamic systems may immediately respond to interventions, but fails to show how systems evolve over longer timeframes. We explore three types of “long-run” effects in dynamic systems that extend recent work on “impulse responses,” which reflect potential long-run effects of one-time interventions. Going beyond these, we first treat evaluations of system (in)stability by testing for “permanent effects,” which are important because in unstable systems even a one-time intervention may have enduring effects. Second, we explore classic econometric long-run effects that show how dynamic systems may respond to interventions that are sustained over time. Third, we treat “accumulated responses” to model how systems may respond to repeated interventions over time. We illustrate tests of each long-run effect in a simulated dataset and we provide all materials online including user-friendly R code that automates estimating, testing, reporting, and plotting all effects (see https://doi.org/10.26188/13506861). We conclude by emphasizing the value of aligning specific longitudinal hypotheses with quantitative methods.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428121993228","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45394357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Eight Simple Guidelines for Improved Understanding of Transformations and Nonlinear Effects 提高对变换和非线性效应理解的八个简单指南
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-03-11 DOI: 10.1177/1094428121991907
Mikko Rönkkö, E. Aalto, H. Tenhunen, Miguel I. Aguirre-Urreta
Transforming variables before analysis or applying a transformation as a part of a generalized linear model are common practices in organizational research. Several methodological articles addressing the topic, either directly or indirectly, have been published in the recent past. In this article, we point out a few misconceptions about transformations and propose a set of eight simple guidelines for addressing them. Our main argument is that transformations should not be chosen based on the nature or distribution of the individual variables but based on the functional form of the relationship between two or more variables that is expected from theory or discovered empirically. Building on a systematic review of six leading management journals, we point to several ways the specification and interpretation of nonlinear models can be improved.
在分析之前转换变量或将转换作为广义线性模型的一部分应用是组织研究中的常见做法。最近发表了几篇直接或间接涉及这一主题的方法论文章。在本文中,我们指出了一些关于转换的误解,并提出了一套八条简单的指导方针来解决这些误解。我们的主要论点是,转换不应基于单个变量的性质或分布来选择,而应基于理论预期或经验发现的两个或多个变量之间关系的函数形式。在对六种主要管理期刊进行系统综述的基础上,我们指出了改进非线性模型规范和解释的几种方法。
{"title":"Eight Simple Guidelines for Improved Understanding of Transformations and Nonlinear Effects","authors":"Mikko Rönkkö, E. Aalto, H. Tenhunen, Miguel I. Aguirre-Urreta","doi":"10.1177/1094428121991907","DOIUrl":"https://doi.org/10.1177/1094428121991907","url":null,"abstract":"Transforming variables before analysis or applying a transformation as a part of a generalized linear model are common practices in organizational research. Several methodological articles addressing the topic, either directly or indirectly, have been published in the recent past. In this article, we point out a few misconceptions about transformations and propose a set of eight simple guidelines for addressing them. Our main argument is that transformations should not be chosen based on the nature or distribution of the individual variables but based on the functional form of the relationship between two or more variables that is expected from theory or discovered empirically. Building on a systematic review of six leading management journals, we point to several ways the specification and interpretation of nonlinear models can be improved.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428121991907","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42879922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Reliability Estimates for IRT-Based Forced-Choice Assessment Scores 基于irt的强迫选择评估分数的可靠性评估
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-03-11 DOI: 10.1177/1094428121999086
Yin Lin
Forced-choice (FC) assessments of noncognitive psychological constructs (e.g., personality, behavioral tendencies) are popular in high-stakes organizational testing scenarios (e.g., informing hiring decisions) due to their enhanced resistance against response distortions (e.g., faking good, impression management). The measurement precisions of FC assessment scores used to inform personnel decisions are of paramount importance in practice. Different types of reliability estimates are reported for FC assessment scores in current publications, while consensus on best practices appears to be lacking. In order to provide understanding and structure around the reporting of FC reliability, this study systematically examined different types of reliability estimation methods for Thurstonian IRT-based FC assessment scores: their theoretical differences were discussed, and their numerical differences were illustrated through a series of simulations and empirical studies. In doing so, this study provides a practical guide for appraising different reliability estimation methods for IRT-based FC assessment scores.
对非认知心理结构(如个性、行为倾向)的强迫选择(FC)评估在高风险的组织测试场景中很受欢迎(如为招聘决策提供信息),因为它们增强了对反应扭曲(如假装好、印象管理)的抵抗力。用于为人事决策提供信息的FC评估分数的测量精度在实践中至关重要。目前的出版物报道了FC评估分数的不同类型的可靠性估计,而对最佳实践似乎缺乏共识。为了提供对FC可靠性报告的理解和结构,本研究系统地研究了基于Thurstonian IRT的FC评估分数的不同类型的可靠性估计方法:讨论了它们的理论差异,并通过一系列模拟和实证研究说明了它们的数值差异。通过这样做,本研究为评估基于IRT的FC评估分数的不同可靠性估计方法提供了实用指南。
{"title":"Reliability Estimates for IRT-Based Forced-Choice Assessment Scores","authors":"Yin Lin","doi":"10.1177/1094428121999086","DOIUrl":"https://doi.org/10.1177/1094428121999086","url":null,"abstract":"Forced-choice (FC) assessments of noncognitive psychological constructs (e.g., personality, behavioral tendencies) are popular in high-stakes organizational testing scenarios (e.g., informing hiring decisions) due to their enhanced resistance against response distortions (e.g., faking good, impression management). The measurement precisions of FC assessment scores used to inform personnel decisions are of paramount importance in practice. Different types of reliability estimates are reported for FC assessment scores in current publications, while consensus on best practices appears to be lacking. In order to provide understanding and structure around the reporting of FC reliability, this study systematically examined different types of reliability estimation methods for Thurstonian IRT-based FC assessment scores: their theoretical differences were discussed, and their numerical differences were illustrated through a series of simulations and empirical studies. In doing so, this study provides a practical guide for appraising different reliability estimation methods for IRT-based FC assessment scores.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428121999086","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47986107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Computational Literature Reviews: Method, Algorithms, and Roadmap 计算文献综述:方法、算法和路线图
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-03-09 DOI: 10.1177/1094428121991230
David Antons, Christoph F. Breidbach, Amol M. Joshi, T. Salge
The substantial volume, continued growth, and resulting complexity of the scientific literature not only increases the need for systematic, replicable, and rigorous literature reviews, but also highlights the natural limits of human researchers’ information processing capabilities. In search of a solution to this dilemma, computational techniques are beginning to support human researchers in synthesizing large bodies of literature. However, actionable methodological guidance on how to design, conduct, and document such computationally augmented literature reviews is lacking to date. We respond by introducing and defining computational literature reviews (CLRs) as a new review method and put forward a six-step roadmap, covering the CLR process from identifying the review objectives to selecting algorithms and reporting findings. We make the CLR method accessible to novice and expert users alike by identifying critical design decisions and typical challenges for each step and provide practical guidelines for tailoring the CLR method to four conceptual review goals. As such, we present CLRs as a literature review method where the choice, design, and implementation of a CLR are guided by specific review objectives, methodological capabilities, and resource constraints of the human researcher.
科学文献的大量、持续增长和由此产生的复杂性不仅增加了对系统、可复制和严格的文献综述的需求,而且也突出了人类研究人员信息处理能力的自然局限性。为了寻找解决这一困境的方法,计算技术开始支持人类研究人员合成大量文献。然而,迄今为止,关于如何设计、实施和记录这种计算增强的文献综述的可操作的方法指导是缺乏的。作为回应,我们引入并定义了计算文献综述(CLR)作为一种新的综述方法,并提出了一个六步路线图,涵盖了从确定综述目标到选择算法和报告结果的CLR过程。我们通过确定每个步骤的关键设计决策和典型挑战,使新手和专家用户都可以访问CLR方法,并提供将CLR方法裁剪为四个概念性审查目标的实用指南。因此,我们将CLR作为一种文献综述方法,其中CLR的选择、设计和实施受到人类研究人员特定综述目标、方法能力和资源限制的指导。
{"title":"Computational Literature Reviews: Method, Algorithms, and Roadmap","authors":"David Antons, Christoph F. Breidbach, Amol M. Joshi, T. Salge","doi":"10.1177/1094428121991230","DOIUrl":"https://doi.org/10.1177/1094428121991230","url":null,"abstract":"The substantial volume, continued growth, and resulting complexity of the scientific literature not only increases the need for systematic, replicable, and rigorous literature reviews, but also highlights the natural limits of human researchers’ information processing capabilities. In search of a solution to this dilemma, computational techniques are beginning to support human researchers in synthesizing large bodies of literature. However, actionable methodological guidance on how to design, conduct, and document such computationally augmented literature reviews is lacking to date. We respond by introducing and defining computational literature reviews (CLRs) as a new review method and put forward a six-step roadmap, covering the CLR process from identifying the review objectives to selecting algorithms and reporting findings. We make the CLR method accessible to novice and expert users alike by identifying critical design decisions and typical challenges for each step and provide practical guidelines for tailoring the CLR method to four conceptual review goals. As such, we present CLRs as a literature review method where the choice, design, and implementation of a CLR are guided by specific review objectives, methodological capabilities, and resource constraints of the human researcher.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1094428121991230","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48441588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 40
Using CATA and Machine Learning to Operationalize Old Constructs in New Ways: An Illustration Using U.S. Governors’ COVID-19 Press Briefings 使用CATA和机器学习以新方式实现旧结构的操作:以美国州长COVID-19新闻发布会为例
IF 9.5 2区 管理学 Q1 Business, Management and Accounting Pub Date : 2021-02-23 DOI: 10.1177/10944281221098607
J. Marshall, F. Yammarino, S. Parameswaran, Minyoung Cheong
Increased computing power and greater access to online data have led to rapid growth in the use of computer-aided text analysis (CATA) and machine learning methods. Using “big data”, researchers have not only advanced new streams of research, but also new research methodologies. Noting this trend and simultaneously recognizing the value of traditional research methods, we lay out a methodology that bridges the gap between old and new approaches to operationalize old constructs in new ways. With a combination of web scraping, CATA, and supervised machine learning, using labeled ground truth data (i.e., data with known inputs and outputs), we train a model to predict CIP (Charismatic-Ideological-Pragmatic) leadership styles from running text. To illustrate this method, we apply the model to classify U.S. state governors’ COVID-19 press briefings according to their CIP leadership style. In addition, we demonstrate content and convergent validity of the method.
计算能力的增强和对在线数据的更大访问使得计算机辅助文本分析(CATA)和机器学习方法的使用迅速增长。利用“大数据”,研究人员不仅提出了新的研究思路,而且提出了新的研究方法。注意到这一趋势,同时认识到传统研究方法的价值,我们提出了一种方法,可以弥合新旧方法之间的差距,以新的方式实现旧结构的操作。结合网络抓取、数据分析和监督机器学习,使用标记的基础事实数据(即已知输入和输出的数据),我们训练一个模型,从运行文本中预测CIP(魅力-意识形态-务实)领导风格。为了说明这种方法,我们将该模型应用于美国州长根据其CIP领导风格对COVID-19新闻发布会进行分类。此外,我们还证明了该方法的内容和收敛有效性。
{"title":"Using CATA and Machine Learning to Operationalize Old Constructs in New Ways: An Illustration Using U.S. Governors’ COVID-19 Press Briefings","authors":"J. Marshall, F. Yammarino, S. Parameswaran, Minyoung Cheong","doi":"10.1177/10944281221098607","DOIUrl":"https://doi.org/10.1177/10944281221098607","url":null,"abstract":"Increased computing power and greater access to online data have led to rapid growth in the use of computer-aided text analysis (CATA) and machine learning methods. Using “big data”, researchers have not only advanced new streams of research, but also new research methodologies. Noting this trend and simultaneously recognizing the value of traditional research methods, we lay out a methodology that bridges the gap between old and new approaches to operationalize old constructs in new ways. With a combination of web scraping, CATA, and supervised machine learning, using labeled ground truth data (i.e., data with known inputs and outputs), we train a model to predict CIP (Charismatic-Ideological-Pragmatic) leadership styles from running text. To illustrate this method, we apply the model to classify U.S. state governors’ COVID-19 press briefings according to their CIP leadership style. In addition, we demonstrate content and convergent validity of the method.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":null,"pages":null},"PeriodicalIF":9.5,"publicationDate":"2021-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43328744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Organizational Research Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1