In survey research, vignette experiments typically employ short, systematically varied descriptions of situations or persons (called vignettes) to elicit the beliefs, attitudes, or behaviors of respondents with respect to the presented scenarios. Using a case study on the fair gender income gap in Austria, we discuss how different design elements can be used to increase a vignette experiment’s validity and reliability. With respect to the experimental design, the design elements considered include a confounded factorial design, a between-subjects factor, anchoring vignettes, and blocking by respondent strata and interviewers. The design elements for the sampling and survey design consist of stratification, covariate measurements, and the systematic assignment of vignette sets to respondents and interviewers. Moreover, the vignettes’ construct validity is empirically validated with respect to the real gender income gap in Austria. We demonstrate how a broad range of design elements can successfully increase a vignette study’s validity and reliability.
{"title":"Designing Valid and Reliable Vignette Experiments for Survey Research: A Case Study on the Fair Gender Income Gap","authors":"Peter M Steiner, C. Atzmüller, Dan Su","doi":"10.2458/V7I2.20321","DOIUrl":"https://doi.org/10.2458/V7I2.20321","url":null,"abstract":"In survey research, vignette experiments typically employ short, systematically varied descriptions of situations or persons (called vignettes) to elicit the beliefs, attitudes, or behaviors of respondents with respect to the presented scenarios. Using a case study on the fair gender income gap in Austria, we discuss how different design elements can be used to increase a vignette experiment’s validity and reliability. With respect to the experimental design, the design elements considered include a confounded factorial design, a between-subjects factor, anchoring vignettes, and blocking by respondent strata and interviewers. The design elements for the sampling and survey design consist of stratification, covariate measurements, and the systematic assignment of vignette sets to respondents and interviewers. Moreover, the vignettes’ construct validity is empirically validated with respect to the real gender income gap in Austria. We demonstrate how a broad range of design elements can successfully increase a vignette study’s validity and reliability.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"7 1","pages":"52-94"},"PeriodicalIF":0.0,"publicationDate":"2017-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V7I2.20321","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44740626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. García, T. C. Baca, Candace J Black, Marcela Sotomayor-Peterson, V. Smith-Castro, A. Figueredo
The psychometric trait approach to human life history, based on common factor modeling, has recently come under some criticism for neglecting to inquire into the developmental progression that orients and executes human life history trajectories (Copping, Campbell, & Muncer, 2014). It was asserted that the psychometric approach wholly focuses on creating a higher-order latent factor of life history by subsuming individual differences with developmental and social experiences, ignoring ontogenetic progression. Implicit in the critique is the assumption that developmental perspectives and latent approaches are mutually exclusive and incompatible with each other. The response to this critique by Figueredo and colleagues (2015) proposed instead that developmental perspectives and latent trait approaches are both compatible and necessary to further research on human life history strategies. The current paper uses three independent cross-sectional samples to examine whether models of human life history are best informed by a developmental perspective, psychometric trait approach, or both.
{"title":"Measures of domain-specific resource allocations in life history strategy: Indicators of a latent common factor or ordered developmental sequence?","authors":"R. García, T. C. Baca, Candace J Black, Marcela Sotomayor-Peterson, V. Smith-Castro, A. Figueredo","doi":"10.2458/V7I1.18798","DOIUrl":"https://doi.org/10.2458/V7I1.18798","url":null,"abstract":"The psychometric trait approach to human life history, based on common factor modeling, has recently come under some criticism for neglecting to inquire into the developmental progression that orients and executes human life history trajectories (Copping, Campbell, & Muncer, 2014). It was asserted that the psychometric approach wholly focuses on creating a higher-order latent factor of life history by subsuming individual differences with developmental and social experiences, ignoring ontogenetic progression. Implicit in the critique is the assumption that developmental perspectives and latent approaches are mutually exclusive and incompatible with each other. The response to this critique by Figueredo and colleagues (2015) proposed instead that developmental perspectives and latent trait approaches are both compatible and necessary to further research on human life history strategies. The current paper uses three independent cross-sectional samples to examine whether models of human life history are best informed by a developmental perspective, psychometric trait approach, or both.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"7 1","pages":"23-51"},"PeriodicalIF":0.0,"publicationDate":"2016-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69074239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Although significant attention has been paid to the impact of the recent economic crisis on European economies, less attention has been devoted to the association between the economic crisis and corruption. Utilizing structural equation modeling (SEM), the present study investigated the structural relationship between the economic crisis and perceptions of corruption in the European Union. Standard and multilevel SEM was used to estimate the relationship between the economic crisis and perceptions of corruption utilizing data from the 2011 Eurobarometer. The results confirmed the hypothesized model. Specifically, the study found a moderately strong direct positive relationship between the economic crisis and perceptions of corruption. The results indicated that a one-size-fits-all policy aimed at combating corruption, or perceptions thereof, is likely to yield inconsistent results.
{"title":"Economic Crisis and Corruption in the European Union","authors":"M. Gugiu, P. C. Gugiu","doi":"10.2458/V7I1.19398","DOIUrl":"https://doi.org/10.2458/V7I1.19398","url":null,"abstract":"Although significant attention has been paid to the impact of the recent economic crisis on European economies, less attention has been devoted to the association between the economic crisis and corruption. Utilizing structural equation modeling (SEM), the present study investigated the structural relationship between the economic crisis and perceptions of corruption in the European Union. Standard and multilevel SEM was used to estimate the relationship between the economic crisis and perceptions of corruption utilizing data from the 2011 Eurobarometer. The results confirmed the hypothesized model. Specifically, the study found a moderately strong direct positive relationship between the economic crisis and perceptions of corruption. The results indicated that a one-size-fits-all policy aimed at combating corruption, or perceptions thereof, is likely to yield inconsistent results.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"7 1","pages":"1-22"},"PeriodicalIF":0.0,"publicationDate":"2016-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V7I1.19398","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69074291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The present paper argues for teaching statistics and psychometric theory using the GLM as a unifying conceptual framework. This helps students understand what analyses have in common, and also provides a firm grounding for understanding that more general cases of the GLM (canonical correlation analysis and SEM) can be interpreted with the same rubric used throughout the GLM. And this approach also helps students better understand analyses that are not part of the GLM, such as predictive discriminant analysis (PDA). The approach helps students understand that all GLM analyses (a) are correlational, and thus are all susceptible to sampling error, (b) can yield r2-type effect sizes, and (c) use weights applied to measured variables to estimate the latent variables really of primary interest. DOI:10.2458/azu_jmmss_v6i2_thompson
{"title":"The Case for Using the General Linear Model as a Unifying Conceptual Framework for Teaching Statistics and Psychometric Theory","authors":"B. Thompson","doi":"10.2458/V6I2.18801","DOIUrl":"https://doi.org/10.2458/V6I2.18801","url":null,"abstract":"The present paper argues for teaching statistics and psychometric theory using the GLM as a unifying conceptual framework. This helps students understand what analyses have in common, and also provides a firm grounding for understanding that more general cases of the GLM (canonical correlation analysis and SEM) can be interpreted with the same rubric used throughout the GLM. And this approach also helps students better understand analyses that are not part of the GLM, such as predictive discriminant analysis (PDA). The approach helps students understand that all GLM analyses (a) are correlational, and thus are all susceptible to sampling error, (b) can yield r2-type effect sizes, and (c) use weights applied to measured variables to estimate the latent variables really of primary interest. DOI:10.2458/azu_jmmss_v6i2_thompson","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"6 1","pages":"30-41"},"PeriodicalIF":0.0,"publicationDate":"2015-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V6I2.18801","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69073892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The purpose of the present paper is to encourage textbook authors, quantitative instructors, curriculum writers, and software developers to move away from the use of isolated apparently disconnected analyses and instead move towards the use of the general linear model as a foundational framework for graduate level statistics training. It is argued that an understanding of modeling, simple linear equations, and commonly used analogous statistical terms will facilitate students understanding of frequently used parametric analyses. Additionally, this holistic approach will equip students with the necessary preparatory skills to understand newer analytical approaches. Three heuristic examples are provided. DOI:10.2458/azu_jmmss_v6i2_skidmore
{"title":"Teaching GLM Concepts: Explicating the Connections","authors":"S. T. Skidmore","doi":"10.2458/V6I2.18802","DOIUrl":"https://doi.org/10.2458/V6I2.18802","url":null,"abstract":"The purpose of the present paper is to encourage textbook authors, quantitative instructors, curriculum writers, and software developers to move away from the use of isolated apparently disconnected analyses and instead move towards the use of the general linear model as a foundational framework for graduate level statistics training. It is argued that an understanding of modeling, simple linear equations, and commonly used analogous statistical terms will facilitate students understanding of frequently used parametric analyses. Additionally, this holistic approach will equip students with the necessary preparatory skills to understand newer analytical approaches. Three heuristic examples are provided. DOI:10.2458/azu_jmmss_v6i2_skidmore","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"6 1","pages":"42-59"},"PeriodicalIF":0.0,"publicationDate":"2015-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69073749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Special Issue Introduction: Teaching the General Linear Model","authors":"R. García, Melinda F. Davis","doi":"10.2458/V6I2.18810","DOIUrl":"https://doi.org/10.2458/V6I2.18810","url":null,"abstract":"","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"6 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2015-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V6I2.18810","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69074185","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Increased elegance in math and science is by the use of more comprehensive, easier to understand, and easier to use models. Increasing elegance allows courses to cover more material in greater depth. While the GLM is more elegant than the traditional ANOVA / Regression models, it has in practice been just one more topic added to already filled statistics courses and has had little impact on day-to-day statistical analyses. Introduced in the 1960s - 1970s, its impact has been delayed because it has been necessary to produce a new generation that knew the GLM but could also converse with the pre-1970 generation. When considering a possibly more elegant model, the "full" GLM includes not only GLM -- and therefore ANOVA and regression -- but also chi square contingency table analyses as well as multivariate analyses, and uses the F as the hypothesized variance divided by the error variance in all cases. Given advancing technology, the computations are now readily done and typically easier than the traditional ANOVA/Regression programs, allowing more focus on issues ranging from how the information is encapsulated so as to best test the hypotheses (by logs, logits, interactions, polynomials, repeated measures as slope or covariates, etc.) to meta-science and the principles of meta-analysis needed to use research literature. And, as expected, the more elegant full GLM means explicitly GLM software can be easier to learn and use. DOI:10.2458/azu_jmmss_v6i2_gorsuch
{"title":"Enhancing the Teaching of Statistics by Use of the Full GLM","authors":"R. Gorsuch","doi":"10.2458/V6I2.18803","DOIUrl":"https://doi.org/10.2458/V6I2.18803","url":null,"abstract":"Increased elegance in math and science is by the use of more comprehensive, easier to understand, and easier to use models. Increasing elegance allows courses to cover more material in greater depth. While the GLM is more elegant than the traditional ANOVA / Regression models, it has in practice been just one more topic added to already filled statistics courses and has had little impact on day-to-day statistical analyses. Introduced in the 1960s - 1970s, its impact has been delayed because it has been necessary to produce a new generation that knew the GLM but could also converse with the pre-1970 generation. When considering a possibly more elegant model, the \"full\" GLM includes not only GLM -- and therefore ANOVA and regression -- but also chi square contingency table analyses as well as multivariate analyses, and uses the F as the hypothesized variance divided by the error variance in all cases. Given advancing technology, the computations are now readily done and typically easier than the traditional ANOVA/Regression programs, allowing more focus on issues ranging from how the information is encapsulated so as to best test the hypotheses (by logs, logits, interactions, polynomials, repeated measures as slope or covariates, etc.) to meta-science and the principles of meta-analysis needed to use research literature. And, as expected, the more elegant full GLM means explicitly GLM software can be easier to learn and use. DOI:10.2458/azu_jmmss_v6i2_gorsuch","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"6 1","pages":"60-69"},"PeriodicalIF":0.0,"publicationDate":"2015-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69073821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In an attempt to help find meaning within qualitative data, researchers commonly start by coding their data. There are a number of coding systems available to researchers and this reflexive account explores my reflections on the use of two such techniques. As part of a larger investigation, two pilot studies were undertaken as a means to examine the relative merits of open coding and template coding for examining transcripts. This article does not describe the research project per se but attempts to step back and offer a reflexive account of the development of data coding tools. Here I reflect upon and evaluate the two data coding techniques that were piloted, and discuss how using appropriate aspects of both led to the development of my final data coding approach. My exploration found there was no clear-cut ‘best’ option but that the data coding techniques needed to be reflexively-aligned to meet the specific needs of my project. This reflection suggests that, when coding qualitative data, researchers should be methodologically thoughtful when they attempt to apply any data coding technique; that they do not assume pre-established tools are aligned to their particular paradigm; and that they consider combining and refining established techniques as a means to define their own specific codes. DOI:10.2458/azu_jmmss_v6i1_blair
{"title":"A reflexive exploration of two qualitative data coding techniques","authors":"E. Blair","doi":"10.2458/V6I1.18772","DOIUrl":"https://doi.org/10.2458/V6I1.18772","url":null,"abstract":"In an attempt to help find meaning within qualitative data, researchers commonly start by coding their data. There are a number of coding systems available to researchers and this reflexive account explores my reflections on the use of two such techniques. As part of a larger investigation, two pilot studies were undertaken as a means to examine the relative merits of open coding and template coding for examining transcripts. This article does not describe the research project per se but attempts to step back and offer a reflexive account of the development of data coding tools. Here I reflect upon and evaluate the two data coding techniques that were piloted, and discuss how using appropriate aspects of both led to the development of my final data coding approach. My exploration found there was no clear-cut ‘best’ option but that the data coding techniques needed to be reflexively-aligned to meet the specific needs of my project. This reflection suggests that, when coding qualitative data, researchers should be methodologically thoughtful when they attempt to apply any data coding technique; that they do not assume pre-established tools are aligned to their particular paradigm; and that they consider combining and refining established techniques as a means to define their own specific codes. DOI:10.2458/azu_jmmss_v6i1_blair","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"1 1","pages":"14-29"},"PeriodicalIF":0.0,"publicationDate":"2015-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V6I1.18772","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69070056","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study examines the relations between sociodemographic sex differences and life history strategies in the populations of Mexican States. Sex differences in anatomy and behavior was measured with traits such as educational achievement, mortality, and morbidity. The data were obtained from the Instituto Nacional de Estadistica y Geografia (INEGI) and sampled from thirty-one Mexican states and the Federal District (N = 32). An extension analysis was performed selecting only the sex ratio variables that had a correlation with the slow Life History factor greater than or equal to an absolute value of .25. A unit-weighted sex ratio factor was created using these variables. Across 32 Mexican states, the correlation between latent slow life history and sex ratio was .57 (p < .05). These results are consistent with our hypothesis that slower life histories favor reduced sexual dimorphism in physiology and behavior among human subnational populations. The results of the study further understanding of variations in population sex differences, male-biased behaviors toward sexual equality, and the differences among subnational (regional) populations within the United States of Mexico. DOI:10.2458/azu_jmmss_v6i1_chavarria_minera
{"title":"Do Slower Life History Strategies Reduce Sociodemographic Sex Differences","authors":"C. E. C. Minera, A. Figueredo, L. Lunsford","doi":"10.2458/V6I1.18771","DOIUrl":"https://doi.org/10.2458/V6I1.18771","url":null,"abstract":"This study examines the relations between sociodemographic sex differences and life history strategies in the populations of Mexican States. Sex differences in anatomy and behavior was measured with traits such as educational achievement, mortality, and morbidity. The data were obtained from the Instituto Nacional de Estadistica y Geografia (INEGI) and sampled from thirty-one Mexican states and the Federal District (N = 32). An extension analysis was performed selecting only the sex ratio variables that had a correlation with the slow Life History factor greater than or equal to an absolute value of .25. A unit-weighted sex ratio factor was created using these variables. Across 32 Mexican states, the correlation between latent slow life history and sex ratio was .57 (p < .05). These results are consistent with our hypothesis that slower life histories favor reduced sexual dimorphism in physiology and behavior among human subnational populations. The results of the study further understanding of variations in population sex differences, male-biased behaviors toward sexual equality, and the differences among subnational (regional) populations within the United States of Mexico. DOI:10.2458/azu_jmmss_v6i1_chavarria_minera","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"6 1","pages":"1-13"},"PeriodicalIF":0.0,"publicationDate":"2015-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69069998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Introduction to The Control Group and Meta-Analysis","authors":"J. Jenson","doi":"10.2458/V5I1.18301","DOIUrl":"https://doi.org/10.2458/V5I1.18301","url":null,"abstract":"","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"5 1","pages":"1-2"},"PeriodicalIF":0.0,"publicationDate":"2014-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V5I1.18301","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69067602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：