Pub Date : 2022-02-01DOI: 10.1177/10944281221075361
B. Miller, Marcia J. Simmering
Researchers often turn to post hoc statistical techniques to identify common method variance (CMV) in same source data and one viable option is to use a marker variable. The choice of marker variable is important, yet these variables are difficult to find, primarily because they must be theoretically unrelated to study variables but measured in the same way (e.g., perceptual; on a Likert scale). This manuscript uses scale development best practices to create a marker variable—attitude toward the color blue—that can be applied in a wide variety of social science research. Scale reliability and validity are addressed, discriminant validity with other measures that detect CMV is tested, and the Confirmatory Factor Analysis Marker Technique is applied with this scale. An experiment designed to analyze the effect of the placement of the scale in surveys is reported. Recommendations to researchers for use of this new scale to detect CMV are provided.
{"title":"Attitude Toward the Color Blue: An Ideal Marker Variable","authors":"B. Miller, Marcia J. Simmering","doi":"10.1177/10944281221075361","DOIUrl":"https://doi.org/10.1177/10944281221075361","url":null,"abstract":"Researchers often turn to post hoc statistical techniques to identify common method variance (CMV) in same source data and one viable option is to use a marker variable. The choice of marker variable is important, yet these variables are difficult to find, primarily because they must be theoretically unrelated to study variables but measured in the same way (e.g., perceptual; on a Likert scale). This manuscript uses scale development best practices to create a marker variable—attitude toward the color blue—that can be applied in a wide variety of social science research. Scale reliability and validity are addressed, discriminant validity with other measures that detect CMV is tested, and the Confirmatory Factor Analysis Marker Technique is applied with this scale. An experiment designed to analyze the effect of the placement of the scale in surveys is reported. Recommendations to researchers for use of this new scale to detect CMV are provided.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"409 - 440"},"PeriodicalIF":9.5,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44421742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-28DOI: 10.1177/10944281211068179
D. Griffin, Ajay V. Somaraju, Christopher R. Dishop, R. DeShon
Interdependence is a defining characteristic of groups and teams. However, a vast range of constructs and conceptualizations for interdependence has left researchers with a dizzying array of frameworks, metrics, and perspectives with which to evaluate interdependence. This situation leaves researchers with little guidance on how to theorize about or measure interdependence. As a solution, we propose a network-based perspective of interdependence. This network-based framework moves beyond network approaches to understanding interdependence that have been proposed in the past in three ways. First, this framework is applied generally to interdependence and not to an isolated form of interdependence. Second, building on previous network-based perspectives of interdependence, we present a procedure to conceptualize a team's interdependent relationships in terms of networks. Third, we utilize the network perspective to present a standardized index of interdependence. Using illustrative examples, we demonstrate the utility of this network-based approach and present various recommendations discussing how these approaches advance the study of interdependence.
{"title":"Evaluating Interdependence in Workgroups: A Network-Based Method","authors":"D. Griffin, Ajay V. Somaraju, Christopher R. Dishop, R. DeShon","doi":"10.1177/10944281211068179","DOIUrl":"https://doi.org/10.1177/10944281211068179","url":null,"abstract":"Interdependence is a defining characteristic of groups and teams. However, a vast range of constructs and conceptualizations for interdependence has left researchers with a dizzying array of frameworks, metrics, and perspectives with which to evaluate interdependence. This situation leaves researchers with little guidance on how to theorize about or measure interdependence. As a solution, we propose a network-based perspective of interdependence. This network-based framework moves beyond network approaches to understanding interdependence that have been proposed in the past in three ways. First, this framework is applied generally to interdependence and not to an isolated form of interdependence. Second, building on previous network-based perspectives of interdependence, we present a procedure to conceptualize a team's interdependent relationships in terms of networks. Third, we utilize the network perspective to present a standardized index of interdependence. Using illustrative examples, we demonstrate the utility of this network-based approach and present various recommendations discussing how these approaches advance the study of interdependence.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"459 - 498"},"PeriodicalIF":9.5,"publicationDate":"2022-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44185207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-25DOI: 10.1177/10944281221075365
G. Dumont
This article addresses the question of how to achieve immersion in organizational ethnography. Working through a broad set of ethnographies in organization studies, sociology, and anthropology, I develop a multi-faceted conceptualization of immersion and offer a framework that integrates four methodological principles—involvement, engagement, duration, and sites—to help organizational ethnographers achieve immersion. In closing, I discuss how this framework advances ongoing debates about involvement, multi-sitedness, and fieldwork design, resulting in a more systematic and reflexive approach to immersion in organizational ethnography.
{"title":"Immersion in Organizational Ethnography: Four Methodological Requirements to Immerse Oneself in the Field","authors":"G. Dumont","doi":"10.1177/10944281221075365","DOIUrl":"https://doi.org/10.1177/10944281221075365","url":null,"abstract":"This article addresses the question of how to achieve immersion in organizational ethnography. Working through a broad set of ethnographies in organization studies, sociology, and anthropology, I develop a multi-faceted conceptualization of immersion and offer a framework that integrates four methodological principles—involvement, engagement, duration, and sites—to help organizational ethnographers achieve immersion. In closing, I discuss how this framework advances ongoing debates about involvement, multi-sitedness, and fieldwork design, resulting in a more systematic and reflexive approach to immersion in organizational ethnography.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"441 - 458"},"PeriodicalIF":9.5,"publicationDate":"2022-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46534384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-06DOI: 10.1177/10944281211065111
J. Cortina, C. Dormann, Hannah M. Markell, Sheila K. Keener
Models that combine moderation and mediation are increasingly common. One such model is that in which one variable causes another variable that, in turn, moderates the relationship between two other variables. There are many recent examples of these Endogenous Moderator Models (EMMs). They bear little superficial resemblance to second-stage moderation models, and they are almost never conceptualized and tested as such. We use path analytic equations to show that this is precisely what EMMs are. Specifically, we use these path analytic equations and a review of recent EMMs in order to show that these models are seldom conceptualized or tested properly and to understand the best ways to handle such models. We then use Monte Carlo simulation to show the consequences of testing these models as they are typically tested rather than as second-stage moderation models. We end with recommendations and provide example datasets and code for SPSS and R.
{"title":"Endogenous Moderator Models: What They are, What They Aren’t, and Why it Matters","authors":"J. Cortina, C. Dormann, Hannah M. Markell, Sheila K. Keener","doi":"10.1177/10944281211065111","DOIUrl":"https://doi.org/10.1177/10944281211065111","url":null,"abstract":"Models that combine moderation and mediation are increasingly common. One such model is that in which one variable causes another variable that, in turn, moderates the relationship between two other variables. There are many recent examples of these Endogenous Moderator Models (EMMs). They bear little superficial resemblance to second-stage moderation models, and they are almost never conceptualized and tested as such. We use path analytic equations to show that this is precisely what EMMs are. Specifically, we use these path analytic equations and a review of recent EMMs in order to show that these models are seldom conceptualized or tested properly and to understand the best ways to handle such models. We then use Monte Carlo simulation to show the consequences of testing these models as they are typically tested rather than as second-stage moderation models. We end with recommendations and provide example datasets and code for SPSS and R.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"499 - 523"},"PeriodicalIF":9.5,"publicationDate":"2022-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46761191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-05DOI: 10.1177/10944281211060712
Vicente González-Romá, Ana Hernández
Multilevel methods allow researchers to investigate relationships that expand across levels (e.g., individuals, teams, and organizations). The popularity of these methods for studying organizational phenomena has increased in recent decades. Methodologists have examined how these methods work under different conditions, providing an empirical base for making sound decisions when using these methods. In this article, we provide recommendations, tools, resources, and a checklist that can be useful for scholars involved in conducting or assessing multilevel studies. The focus of our article is on two-level designs, in which Level-1 entities are neatly nested within Level-2 entities, and top-down effects are estimated. However, some of our recommendations are also applicable to more complex multilevel designs.
{"title":"Conducting and Evaluating Multilevel Studies: Recommendations, Resources, and a Checklist","authors":"Vicente González-Romá, Ana Hernández","doi":"10.1177/10944281211060712","DOIUrl":"https://doi.org/10.1177/10944281211060712","url":null,"abstract":"Multilevel methods allow researchers to investigate relationships that expand across levels (e.g., individuals, teams, and organizations). The popularity of these methods for studying organizational phenomena has increased in recent decades. Methodologists have examined how these methods work under different conditions, providing an empirical base for making sound decisions when using these methods. In this article, we provide recommendations, tools, resources, and a checklist that can be useful for scholars involved in conducting or assessing multilevel studies. The focus of our article is on two-level designs, in which Level-1 entities are neatly nested within Level-2 entities, and top-down effects are estimated. However, some of our recommendations are also applicable to more complex multilevel designs.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":" ","pages":""},"PeriodicalIF":9.5,"publicationDate":"2022-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42544757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-12-17DOI: 10.1177/10944281211056524
Ajay V. Somaraju, Christopher D. Nye, J. Olenick
The study of measurement equivalence has important implications for organizational research. Nonequivalence across groups or over time can affect the results of a study and the conclusions that are drawn from it. As a result, the review paper by Vandenberg & Lance (2000) has been highly cited and has played an important role in understanding the measurement of organizational constructs. However, that paper is now 20 years old, and a number of advances have been made in the application and interpretation of measurement equivalence (ME) since its publication. Therefore, the goal of the present paper is to provide an updated review of ME techniques that describes recent advances in testing for ME and proposes a taxonomy of potential sources of nonequivalence. Finally, we articulate recommendations for applying these newer methods and consider future directions for measurement equivalence research in the organizational literature.
{"title":"A Review of Measurement Equivalence in Organizational Research: What's Old, What's New, What's Next?","authors":"Ajay V. Somaraju, Christopher D. Nye, J. Olenick","doi":"10.1177/10944281211056524","DOIUrl":"https://doi.org/10.1177/10944281211056524","url":null,"abstract":"The study of measurement equivalence has important implications for organizational research. Nonequivalence across groups or over time can affect the results of a study and the conclusions that are drawn from it. As a result, the review paper by Vandenberg & Lance (2000) has been highly cited and has played an important role in understanding the measurement of organizational constructs. However, that paper is now 20 years old, and a number of advances have been made in the application and interpretation of measurement equivalence (ME) since its publication. Therefore, the goal of the present paper is to provide an updated review of ME techniques that describes recent advances in testing for ME and proposes a taxonomy of potential sources of nonequivalence. Finally, we articulate recommendations for applying these newer methods and consider future directions for measurement equivalence research in the organizational literature.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"25 1","pages":"741 - 785"},"PeriodicalIF":9.5,"publicationDate":"2021-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43395326","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-12-06DOI: 10.1177/10944281211056520
N. Bowling, Jason L. Huang, Cheyna K. Brower, Caleb B. Bragg
Several recent studies have examined the prevention, causes, and consequences of insufficient effort responding (IER) to surveys. Scientific progress in this area, however, rests on the availability of construct-valid IER measures. In the current paper we describe the potential merits of the page time index, which is computed by counting the number of questionnaire pages to which a participant has responded more quickly than two seconds per item (see Huang et al., 2012). We conducted three studies (total N = 1,056) to examine the page time index's construct validity. Across these studies, we found that page time converged highly with other IER indices, that it was sensitive to an experimental manipulation warning participants to respond carefully, and that it predicted the extent to which participants were unable to recognize item content. We also found that page time's validity was superior to that of total completion time and that the two-seconds-per-item rule yielded a construct-valid page time score for items of various word lengths. Given its apparent validity, we provide practical recommendations for the use of the page time index.
{"title":"The Quick and the Careless: The Construct Validity of Page Time as a Measure of Insufficient Effort Responding to Surveys","authors":"N. Bowling, Jason L. Huang, Cheyna K. Brower, Caleb B. Bragg","doi":"10.1177/10944281211056520","DOIUrl":"https://doi.org/10.1177/10944281211056520","url":null,"abstract":"Several recent studies have examined the prevention, causes, and consequences of insufficient effort responding (IER) to surveys. Scientific progress in this area, however, rests on the availability of construct-valid IER measures. In the current paper we describe the potential merits of the page time index, which is computed by counting the number of questionnaire pages to which a participant has responded more quickly than two seconds per item (see Huang et al., 2012). We conducted three studies (total N = 1,056) to examine the page time index's construct validity. Across these studies, we found that page time converged highly with other IER indices, that it was sensitive to an experimental manipulation warning participants to respond carefully, and that it predicted the extent to which participants were unable to recognize item content. We also found that page time's validity was superior to that of total completion time and that the two-seconds-per-item rule yielded a construct-valid page time score for items of various word lengths. Given its apparent validity, we provide practical recommendations for the use of the page time index.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"323 - 352"},"PeriodicalIF":9.5,"publicationDate":"2021-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41503816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-12-04DOI: 10.1177/10944281211067746
{"title":"Erratum to Interaction Effects in Cross-Lagged Panel Models: SEM with Latent Interactions Applied to Work-Family Conflict, Job Satisfaction, and Gender","authors":"","doi":"10.1177/10944281211067746","DOIUrl":"https://doi.org/10.1177/10944281211067746","url":null,"abstract":"","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"25 1","pages":"815 - 816"},"PeriodicalIF":9.5,"publicationDate":"2021-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48479731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-12-03DOI: 10.1177/10944281211060706
Liana M. Kreamer, Betsy H. Albritton, Scott Tonidandel, S. Rogelberg
This study explores how researchers in the organizational sciences use and/or cite methodological ‘best practice’ (BP) articles. Namely, are scholars adhering fully to the prescribed practices they cite, or are they cherry picking from recommended practices without disclosing? Or worse yet, are scholars inaccurately following the methodological best practices they cite? To answer these questions, we selected three seminal and highly cited best practice articles published in Organizational Research Methods (ORM) within the past ten years. These articles offer clear and specific methodological recommendations for researchers as they make decisions regarding the design, measurement, and interpretation of empirical studies. We then gathered all articles that have cited these best practice pieces. Using comprehensive coding forms, we evaluated how authors are using and citing best practice articles (e.g., if they are appropriately following the recommended practices). Our results revealed substantial variation in how authors cited best practice articles, with 17.4% appropriately citing, 47.7% citing with minor inaccuracies, and 34.5% inappropriately citing BP articles. These findings shed light on the use (and misuse) of methodological recommendations, offering insight into how we can better improve our digestion and implementation of best practices as we design and test research and theory. Key implications and recommendations for editors, reviewers, and authors are discussed.
{"title":"The Use and Misuse of Organizational Research Methods ‘Best Practice’ Articles","authors":"Liana M. Kreamer, Betsy H. Albritton, Scott Tonidandel, S. Rogelberg","doi":"10.1177/10944281211060706","DOIUrl":"https://doi.org/10.1177/10944281211060706","url":null,"abstract":"This study explores how researchers in the organizational sciences use and/or cite methodological ‘best practice’ (BP) articles. Namely, are scholars adhering fully to the prescribed practices they cite, or are they cherry picking from recommended practices without disclosing? Or worse yet, are scholars inaccurately following the methodological best practices they cite? To answer these questions, we selected three seminal and highly cited best practice articles published in Organizational Research Methods (ORM) within the past ten years. These articles offer clear and specific methodological recommendations for researchers as they make decisions regarding the design, measurement, and interpretation of empirical studies. We then gathered all articles that have cited these best practice pieces. Using comprehensive coding forms, we evaluated how authors are using and citing best practice articles (e.g., if they are appropriately following the recommended practices). Our results revealed substantial variation in how authors cited best practice articles, with 17.4% appropriately citing, 47.7% citing with minor inaccuracies, and 34.5% inappropriately citing BP articles. These findings shed light on the use (and misuse) of methodological recommendations, offering insight into how we can better improve our digestion and implementation of best practices as we design and test research and theory. Key implications and recommendations for editors, reviewers, and authors are discussed.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"26 1","pages":"387 - 408"},"PeriodicalIF":9.5,"publicationDate":"2021-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44669351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-12-03DOI: 10.1177/10944281211058466
Peren Arin, M. Minniti, S. Murtinu, Nicola Spagnolo
Inflection points, kinks, and jumps identify places where the relationship between dependent and independent variables switches in some important way. Although these switch points are often mentioned in management research, their presence in the data is either ignored, or postulated ad hoc by testing arbitrarily specified functional forms (e.g., U or inverted U-shaped relationships). This is problematic if we want accurate tests for our theories. To address this issue, we provide an integrative framework for the identification of nonlinearities. Our approach constitutes a precursor step that researchers will want to conduct before deciding which estimation model may be most appropriate. We also provide instructions on how our approach can be implemented, and a replicable illustration of the procedure. Our illustrative example shows how the identification of endogenous switch points may lead to significantly different conclusions compared to those obtained when switch points are ignored or their existence is conjectured arbitrarily. This supports our claim that capturing empirically the presence of nonlinearity is important and should be included in our empirical investigations.
{"title":"Inflection Points, Kinks, and Jumps: A Statistical Approach to Detecting Nonlinearities","authors":"Peren Arin, M. Minniti, S. Murtinu, Nicola Spagnolo","doi":"10.1177/10944281211058466","DOIUrl":"https://doi.org/10.1177/10944281211058466","url":null,"abstract":"Inflection points, kinks, and jumps identify places where the relationship between dependent and independent variables switches in some important way. Although these switch points are often mentioned in management research, their presence in the data is either ignored, or postulated ad hoc by testing arbitrarily specified functional forms (e.g., U or inverted U-shaped relationships). This is problematic if we want accurate tests for our theories. To address this issue, we provide an integrative framework for the identification of nonlinearities. Our approach constitutes a precursor step that researchers will want to conduct before deciding which estimation model may be most appropriate. We also provide instructions on how our approach can be implemented, and a replicable illustration of the procedure. Our illustrative example shows how the identification of endogenous switch points may lead to significantly different conclusions compared to those obtained when switch points are ignored or their existence is conjectured arbitrarily. This supports our claim that capturing empirically the presence of nonlinearity is important and should be included in our empirical investigations.","PeriodicalId":19689,"journal":{"name":"Organizational Research Methods","volume":"25 1","pages":"786 - 814"},"PeriodicalIF":9.5,"publicationDate":"2021-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45552385","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：