Pub Date : 2022-08-31DOI: 10.1177/10944281221120541
Christopher D. Nye
Confirmatory factor analyses (CFA) are widely used in the organizational literature. As a result, understanding how to properly conduct these analyses, report the results, and interpret their implications is critically important for advancing organizational research. The goal of this paper is to summarize the complexities of CFA models and, therefore, to provide a resource for journal reviewers and researchers who are using CFA in their research. The topics covered in this paper include the estimation process, power analyses, model fit, and model modifications, among other things. In addition, this paper concludes with a checklist that summarizes the key points that are discussed and can be used to evaluate future studies that incorporate CFA.
{"title":"Reviewer Resources: Confirmatory Factor Analysis","authors":"Christopher D. Nye","doi":"10.1177/10944281221120541","DOIUrl":"https://doi.org/10.1177/10944281221120541","url":null,"abstract":"Confirmatory factor analyses (CFA) are widely used in the organizational literature. As a result, understanding how to properly conduct these analyses, report the results, and interpret their implications is critically important for advancing organizational research. The goal of this paper is to summarize the complexities of CFA models and, therefore, to provide a resource for journal reviewers and researchers who are using CFA in their research. The topics covered in this paper include the estimation process, power analyses, model fit, and model modifications, among other things. In addition, this paper concludes with a checklist that summarizes the key points that are discussed and can be used to evaluate future studies that incorporate CFA.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":" ","pages":""},"PeriodicalIF":9.5,"publicationDate":"2022-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47697424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-15DOI: 10.1177/10944281221115374
L. Lambert, Daniel A. Newman
We review contemporary best practice for developing and validating measures of constructs in the organizational sciences. The three basic steps in scale development are: (a) construct definition, (b) choosing operationalizations that match the construct definition, and (c) obtaining empirical evidence to confirm construct validity. While summarizing this 3-step process [i.e., Define-Operationalize-Confirm], we address many issues in establishing construct validity and provide a checklist for journal reviewers and authors when evaluating the validity of measures used in organizational research. Among other points, we pay special attention to construct conceptualization, acknowledging existing constructs, improving existing measures, multidimensional constructs, macro-level constructs, and the need for independent samples to confirm construct validity and measurement equivalence across subpopulations.
{"title":"Construct Development and Validation in Three Practical Steps: Recommendations for Reviewers, Editors, and Authors*","authors":"L. Lambert, Daniel A. Newman","doi":"10.1177/10944281221115374","DOIUrl":"https://doi.org/10.1177/10944281221115374","url":null,"abstract":"We review contemporary best practice for developing and validating measures of constructs in the organizational sciences. The three basic steps in scale development are: (a) construct definition, (b) choosing operationalizations that match the construct definition, and (c) obtaining empirical evidence to confirm construct validity. While summarizing this 3-step process [i.e., Define-Operationalize-Confirm], we address many issues in establishing construct validity and provide a checklist for journal reviewers and authors when evaluating the validity of measures used in organizational research. Among other points, we pay special attention to construct conceptualization, acknowledging existing constructs, improving existing measures, multidimensional constructs, macro-level constructs, and the need for independent samples to confirm construct validity and measurement equivalence across subpopulations.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":" ","pages":""},"PeriodicalIF":9.5,"publicationDate":"2022-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41912909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-06-30DOI: 10.1177/10944281221111401
Yemisi Bolade-Ogunfodun, Lebene Richmond Soga, B. Laker
This paper investigates the ethnographic researcher's positionality and its role in sensemaking within the research process. Using autoethnographic data of the first author - a black female West African (Yoruba) scholar in a Western organizational context, we adopt a critical sensemaking approach to make sense of the researcher's field experience. We propose a conceptualization of the researcher's positionality as one that is entwined in the field, being an active interaction of the researcher's formative context with her sensory capabilities. We demonstrate how openness to the researcher's entwined positionality generates interpretive frames of reference and uncovers nuances in the sensemaking process, which widens the scope for reflexivity. We offer a methodological roadmap for engaging entwined positionality in reflexive practice and contribute to the body of research which challenges the idea of the detached researcher; thus, we respond to the growing calls for integrating the elements of a researcher's positionality into research in a way that enhances reflexivity.
{"title":"Entwined Positionality and Interpretive Frames of Reference: An Autoethnographic Account","authors":"Yemisi Bolade-Ogunfodun, Lebene Richmond Soga, B. Laker","doi":"10.1177/10944281221111401","DOIUrl":"https://doi.org/10.1177/10944281221111401","url":null,"abstract":"This paper investigates the ethnographic researcher's positionality and its role in sensemaking within the research process. Using autoethnographic data of the first author - a black female West African (Yoruba) scholar in a Western organizational context, we adopt a critical sensemaking approach to make sense of the researcher's field experience. We propose a conceptualization of the researcher's positionality as one that is entwined in the field, being an active interaction of the researcher's formative context with her sensory capabilities. We demonstrate how openness to the researcher's entwined positionality generates interpretive frames of reference and uncovers nuances in the sensemaking process, which widens the scope for reflexivity. We offer a methodological roadmap for engaging entwined positionality in reflexive practice and contribute to the body of research which challenges the idea of the detached researcher; thus, we respond to the growing calls for integrating the elements of a researcher's positionality into research in a way that enhances reflexivity.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":" ","pages":""},"PeriodicalIF":9.5,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47035015","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-03-01DOI: 10.1177/10944281221083197
H. Woo, John P. Berns, Pol Solanelles
The use of logit and probit models when examining binary dependent variables including those in the form 0/1 (i.e., dummy variables), yes/no, and true/false (hereafter binary DVs) is commonplace. Yet, the appropriateness and effectiveness of such models are challenged when the event rate of a binary DV is rare or common. To better understand the impact on the field of strategy, we undertook a literature review and assessed recently published research in the Strategic Management Journal. We then utilized Monte Carlo simulations with results showing that as event rates become rarer or more common, issues including biased coefficients, standard error inflation, low statistical power to detect significant effects, and model convergence failure increasingly arise. In addition, small sample sizes amplified these empirical issues. Using a strategy example study, we also show how various analytic tools can lead to different findings when empirical models face an extreme event rate with small sample sizes. Based on our findings, we provide step-by-step guidance for strategy researchers going forward.
{"title":"How Rare Is Rare? How Common Is Common? Empirical Issues Associated With Binary Dependent Variables With Rare Or Common Event Rates","authors":"H. Woo, John P. Berns, Pol Solanelles","doi":"10.1177/10944281221083197","DOIUrl":"https://doi.org/10.1177/10944281221083197","url":null,"abstract":"The use of logit and probit models when examining binary dependent variables including those in the form 0/1 (i.e., dummy variables), yes/no, and true/false (hereafter binary DVs) is commonplace. Yet, the appropriateness and effectiveness of such models are challenged when the event rate of a binary DV is rare or common. To better understand the impact on the field of strategy, we undertook a literature review and assessed recently published research in the Strategic Management Journal. We then utilized Monte Carlo simulations with results showing that as event rates become rarer or more common, issues including biased coefficients, standard error inflation, low statistical power to detect significant effects, and model convergence failure increasingly arise. In addition, small sample sizes amplified these empirical issues. Using a strategy example study, we also show how various analytic tools can lead to different findings when empirical models face an extreme event rate with small sample sizes. Based on our findings, we provide step-by-step guidance for strategy researchers going forward.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"1 1","pages":""},"PeriodicalIF":9.5,"publicationDate":"2022-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41573269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-02-01DOI: 10.1177/10944281221075361
B. Miller, Marcia J. Simmering
Researchers often turn to post hoc statistical techniques to identify common method variance (CMV) in same source data and one viable option is to use a marker variable. The choice of marker variable is important, yet these variables are difficult to find, primarily because they must be theoretically unrelated to study variables but measured in the same way (e.g., perceptual; on a Likert scale). This manuscript uses scale development best practices to create a marker variable—attitude toward the color blue—that can be applied in a wide variety of social science research. Scale reliability and validity are addressed, discriminant validity with other measures that detect CMV is tested, and the Confirmatory Factor Analysis Marker Technique is applied with this scale. An experiment designed to analyze the effect of the placement of the scale in surveys is reported. Recommendations to researchers for use of this new scale to detect CMV are provided.
{"title":"Attitude Toward the Color Blue: An Ideal Marker Variable","authors":"B. Miller, Marcia J. Simmering","doi":"10.1177/10944281221075361","DOIUrl":"https://doi.org/10.1177/10944281221075361","url":null,"abstract":"Researchers often turn to post hoc statistical techniques to identify common method variance (CMV) in same source data and one viable option is to use a marker variable. The choice of marker variable is important, yet these variables are difficult to find, primarily because they must be theoretically unrelated to study variables but measured in the same way (e.g., perceptual; on a Likert scale). This manuscript uses scale development best practices to create a marker variable—attitude toward the color blue—that can be applied in a wide variety of social science research. Scale reliability and validity are addressed, discriminant validity with other measures that detect CMV is tested, and the Confirmatory Factor Analysis Marker Technique is applied with this scale. An experiment designed to analyze the effect of the placement of the scale in surveys is reported. Recommendations to researchers for use of this new scale to detect CMV are provided.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"409 - 440"},"PeriodicalIF":9.5,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44421742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-28DOI: 10.1177/10944281211068179
D. Griffin, Ajay V. Somaraju, Christopher R. Dishop, R. DeShon
Interdependence is a defining characteristic of groups and teams. However, a vast range of constructs and conceptualizations for interdependence has left researchers with a dizzying array of frameworks, metrics, and perspectives with which to evaluate interdependence. This situation leaves researchers with little guidance on how to theorize about or measure interdependence. As a solution, we propose a network-based perspective of interdependence. This network-based framework moves beyond network approaches to understanding interdependence that have been proposed in the past in three ways. First, this framework is applied generally to interdependence and not to an isolated form of interdependence. Second, building on previous network-based perspectives of interdependence, we present a procedure to conceptualize a team's interdependent relationships in terms of networks. Third, we utilize the network perspective to present a standardized index of interdependence. Using illustrative examples, we demonstrate the utility of this network-based approach and present various recommendations discussing how these approaches advance the study of interdependence.
{"title":"Evaluating Interdependence in Workgroups: A Network-Based Method","authors":"D. Griffin, Ajay V. Somaraju, Christopher R. Dishop, R. DeShon","doi":"10.1177/10944281211068179","DOIUrl":"https://doi.org/10.1177/10944281211068179","url":null,"abstract":"Interdependence is a defining characteristic of groups and teams. However, a vast range of constructs and conceptualizations for interdependence has left researchers with a dizzying array of frameworks, metrics, and perspectives with which to evaluate interdependence. This situation leaves researchers with little guidance on how to theorize about or measure interdependence. As a solution, we propose a network-based perspective of interdependence. This network-based framework moves beyond network approaches to understanding interdependence that have been proposed in the past in three ways. First, this framework is applied generally to interdependence and not to an isolated form of interdependence. Second, building on previous network-based perspectives of interdependence, we present a procedure to conceptualize a team's interdependent relationships in terms of networks. Third, we utilize the network perspective to present a standardized index of interdependence. Using illustrative examples, we demonstrate the utility of this network-based approach and present various recommendations discussing how these approaches advance the study of interdependence.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"459 - 498"},"PeriodicalIF":9.5,"publicationDate":"2022-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44185207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-25DOI: 10.1177/10944281221075365
G. Dumont
This article addresses the question of how to achieve immersion in organizational ethnography. Working through a broad set of ethnographies in organization studies, sociology, and anthropology, I develop a multi-faceted conceptualization of immersion and offer a framework that integrates four methodological principles—involvement, engagement, duration, and sites—to help organizational ethnographers achieve immersion. In closing, I discuss how this framework advances ongoing debates about involvement, multi-sitedness, and fieldwork design, resulting in a more systematic and reflexive approach to immersion in organizational ethnography.
{"title":"Immersion in Organizational Ethnography: Four Methodological Requirements to Immerse Oneself in the Field","authors":"G. Dumont","doi":"10.1177/10944281221075365","DOIUrl":"https://doi.org/10.1177/10944281221075365","url":null,"abstract":"This article addresses the question of how to achieve immersion in organizational ethnography. Working through a broad set of ethnographies in organization studies, sociology, and anthropology, I develop a multi-faceted conceptualization of immersion and offer a framework that integrates four methodological principles—involvement, engagement, duration, and sites—to help organizational ethnographers achieve immersion. In closing, I discuss how this framework advances ongoing debates about involvement, multi-sitedness, and fieldwork design, resulting in a more systematic and reflexive approach to immersion in organizational ethnography.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"441 - 458"},"PeriodicalIF":9.5,"publicationDate":"2022-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46534384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-06DOI: 10.1177/10944281211065111
J. Cortina, C. Dormann, Hannah M. Markell, Sheila K. Keener
Models that combine moderation and mediation are increasingly common. One such model is that in which one variable causes another variable that, in turn, moderates the relationship between two other variables. There are many recent examples of these Endogenous Moderator Models (EMMs). They bear little superficial resemblance to second-stage moderation models, and they are almost never conceptualized and tested as such. We use path analytic equations to show that this is precisely what EMMs are. Specifically, we use these path analytic equations and a review of recent EMMs in order to show that these models are seldom conceptualized or tested properly and to understand the best ways to handle such models. We then use Monte Carlo simulation to show the consequences of testing these models as they are typically tested rather than as second-stage moderation models. We end with recommendations and provide example datasets and code for SPSS and R.
{"title":"Endogenous Moderator Models: What They are, What They Aren’t, and Why it Matters","authors":"J. Cortina, C. Dormann, Hannah M. Markell, Sheila K. Keener","doi":"10.1177/10944281211065111","DOIUrl":"https://doi.org/10.1177/10944281211065111","url":null,"abstract":"Models that combine moderation and mediation are increasingly common. One such model is that in which one variable causes another variable that, in turn, moderates the relationship between two other variables. There are many recent examples of these Endogenous Moderator Models (EMMs). They bear little superficial resemblance to second-stage moderation models, and they are almost never conceptualized and tested as such. We use path analytic equations to show that this is precisely what EMMs are. Specifically, we use these path analytic equations and a review of recent EMMs in order to show that these models are seldom conceptualized or tested properly and to understand the best ways to handle such models. We then use Monte Carlo simulation to show the consequences of testing these models as they are typically tested rather than as second-stage moderation models. We end with recommendations and provide example datasets and code for SPSS and R.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"499 - 523"},"PeriodicalIF":9.5,"publicationDate":"2022-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46761191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-05DOI: 10.1177/10944281211060712
Vicente González-Romá, Ana Hernández
Multilevel methods allow researchers to investigate relationships that expand across levels (e.g., individuals, teams, and organizations). The popularity of these methods for studying organizational phenomena has increased in recent decades. Methodologists have examined how these methods work under different conditions, providing an empirical base for making sound decisions when using these methods. In this article, we provide recommendations, tools, resources, and a checklist that can be useful for scholars involved in conducting or assessing multilevel studies. The focus of our article is on two-level designs, in which Level-1 entities are neatly nested within Level-2 entities, and top-down effects are estimated. However, some of our recommendations are also applicable to more complex multilevel designs.
{"title":"Conducting and Evaluating Multilevel Studies: Recommendations, Resources, and a Checklist","authors":"Vicente González-Romá, Ana Hernández","doi":"10.1177/10944281211060712","DOIUrl":"https://doi.org/10.1177/10944281211060712","url":null,"abstract":"Multilevel methods allow researchers to investigate relationships that expand across levels (e.g., individuals, teams, and organizations). The popularity of these methods for studying organizational phenomena has increased in recent decades. Methodologists have examined how these methods work under different conditions, providing an empirical base for making sound decisions when using these methods. In this article, we provide recommendations, tools, resources, and a checklist that can be useful for scholars involved in conducting or assessing multilevel studies. The focus of our article is on two-level designs, in which Level-1 entities are neatly nested within Level-2 entities, and top-down effects are estimated. However, some of our recommendations are also applicable to more complex multilevel designs.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":" ","pages":""},"PeriodicalIF":9.5,"publicationDate":"2022-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42544757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：