首页 > 最新文献

Journal of methods and measurement in the social sciences最新文献

英文 中文
A Field Experiment to Test the Labor Market Value of a Credential from a For-Profit Postsecondary School 一项测试营利性高等教育证书在劳动力市场价值的实地实验
Pub Date : 2014-09-19 DOI: 10.2458/V5I1.18308
Carolyn Arcand
The attainment of postsecondary credentials holds particular promise in improving economic security for low-income single mothers. However, the type of school attended may matter when determining whether postsecondary credentials will foster positive labor market outcomes and financial stability for former students. This paper describes the pre-test of a field experiment to examine whether the school type listed on a job applicant’s resume has an impact on receiving a call for a job interview, in fields commonly pursued by low-income women. School types tested were for-profit schools and community colleges. Results revealed little difference in outcomes for job seekers with credentials from each school type. However, more reliable results could be obtained by repeating this study in a stronger economy, using job candidates with minimal applicable experience, applying to a greater number of positions, and selecting occupations for which an academic credential is widely seen as a prerequisite for entry. DOI:10.2458/azu_jmmss_v5i1_arcand
获得高等教育证书对改善低收入单身母亲的经济保障尤其有希望。然而,在决定高等教育证书是否会促进积极的劳动力市场结果和前学生的经济稳定时,就读的学校类型可能很重要。本文描述了一项实地实验的预测试,以检验求职者简历上列出的学校类型是否对接受工作面试的电话有影响,在低收入女性通常追求的领域。接受测试的学校类型是盈利性学校和社区学院。结果显示,拥有不同类型学校文凭的求职者在求职结果上差别不大。然而,如果在经济更强劲的情况下重复这项研究,使用具有最少适用经验的求职者,申请更多的职位,并选择学术证书被广泛视为进入先决条件的职业,则可以获得更可靠的结果。DOI: 10.2458 / azu_jmmss_v5i1_arcand
{"title":"A Field Experiment to Test the Labor Market Value of a Credential from a For-Profit Postsecondary School","authors":"Carolyn Arcand","doi":"10.2458/V5I1.18308","DOIUrl":"https://doi.org/10.2458/V5I1.18308","url":null,"abstract":"The attainment of postsecondary credentials holds particular promise in improving economic security for low-income single mothers. However, the type of school attended may matter when determining whether postsecondary credentials will foster positive labor market outcomes and financial stability for former students. This paper describes the pre-test of a field experiment to examine whether the school type listed on a job applicant’s resume has an impact on receiving a call for a job interview, in fields commonly pursued by low-income women. School types tested were for-profit schools and community colleges. Results revealed little difference in outcomes for job seekers with credentials from each school type. However, more reliable results could be obtained by repeating this study in a stronger economy, using job candidates with minimal applicable experience, applying to a greater number of positions, and selecting occupations for which an academic credential is widely seen as a prerequisite for entry. DOI:10.2458/azu_jmmss_v5i1_arcand","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"5 1","pages":"40-55"},"PeriodicalIF":0.0,"publicationDate":"2014-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69068000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Control Group and Meta-Analysis 对照组和荟萃分析
Pub Date : 2014-09-19 DOI: 10.2458/V5I1.18302
J. Hunter, Jason L. Jensen, R. Rodgers
Social scientists use a mixture of different methodologies, which creates problems for researchers attempting to review the cumulative results of all studies.  Standard practice for review studies using meta-analysis is to adjust the findings of all studies that use control groups and to include studies not having control groups without adjustment for extraneous effects, or to not use studies that lack a control group, which could produce an erroneous result.  Our study develops a novel meta-analytic procedure that combines the evidence on control group change with evidence on change from the intervention, making it possible to adjust for the effects of extraneous factors in all studies and bridges the gap between control group studies and other types of studies. DOI:10.2458/azu_jmmss_v5i1_hunter
社会科学家混合使用不同的方法,这给试图回顾所有研究的累积结果的研究人员带来了问题。使用荟萃分析的回顾性研究的标准做法是对所有使用对照组的研究结果进行调整,并纳入没有对照组的研究,而不需要对无关效应进行调整,或者不使用缺乏对照组的研究,否则可能产生错误的结果。我们的研究开发了一种新的荟萃分析程序,将对照组变化的证据与干预措施变化的证据结合起来,使所有研究中对外来因素的影响进行调整成为可能,并弥合了对照组研究与其他类型研究之间的差距。DOI: 10.2458 / azu_jmmss_v5i1_hunter
{"title":"The Control Group and Meta-Analysis","authors":"J. Hunter, Jason L. Jensen, R. Rodgers","doi":"10.2458/V5I1.18302","DOIUrl":"https://doi.org/10.2458/V5I1.18302","url":null,"abstract":"Social scientists use a mixture of different methodologies, which creates problems for researchers attempting to review the cumulative results of all studies.  Standard practice for review studies using meta-analysis is to adjust the findings of all studies that use control groups and to include studies not having control groups without adjustment for extraneous effects, or to not use studies that lack a control group, which could produce an erroneous result.  Our study develops a novel meta-analytic procedure that combines the evidence on control group change with evidence on change from the intervention, making it possible to adjust for the effects of extraneous factors in all studies and bridges the gap between control group studies and other types of studies. DOI:10.2458/azu_jmmss_v5i1_hunter","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"5 1","pages":"3-21"},"PeriodicalIF":0.0,"publicationDate":"2014-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V5I1.18302","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69067685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Measuring Perceived Anonymity: The Development of a Context Independent Instrument 测量感知匿名性:一种情境无关工具的开发
Pub Date : 2014-09-19 DOI: 10.2458/V5I1.18305
D. Hite, Troy A. Voelker, Adrian Robertson
In order to assess relationships between perceptions of anonymity and behaviors, a context independent instrument is required for measuring the perceptions of anonymity held by individuals.  To date, no such measurement instrument exists that has been shown to be reliable and valid.  The authors employ a rigorous design methodology to develop, test, and substantiate a reliable and valid instrument for measuring perceptions of anonymity across different contexts. The PA measure presented is a five item Likert scale designed to measure perceptions of anonymity across multiple contexts. Results from two separate EFA pilot tests (n=61 and n=60), a test-retest, and a CFA final test (n=292) indicate that the PA measure has good internal consistency reliability (a=.82), test-retest reliability, factorial validity, and a single factor structure. DOI:10.2458/azu_jmmss_v5i1_hite
为了评估匿名感知与行为之间的关系,需要一种与情境无关的工具来测量个人持有的匿名感知。到目前为止,还没有这样的测量仪器被证明是可靠和有效的。作者采用严格的设计方法来开发、测试和证实一个可靠而有效的工具,用于测量不同背景下的匿名性感知。PA测量是一个五项李克特量表,旨在测量在多种情况下匿名的感知。两个独立的EFA先导测试(n=61和n=60)、一次重测和一次CFA最终测试(n=292)的结果表明,PA测量具有良好的内部一致性信度(a= 0.82)、重测信度、析因效度和单因素结构。DOI: 10.2458 / azu_jmmss_v5i1_hite
{"title":"Measuring Perceived Anonymity: The Development of a Context Independent Instrument","authors":"D. Hite, Troy A. Voelker, Adrian Robertson","doi":"10.2458/V5I1.18305","DOIUrl":"https://doi.org/10.2458/V5I1.18305","url":null,"abstract":"In order to assess relationships between perceptions of anonymity and behaviors, a context independent instrument is required for measuring the perceptions of anonymity held by individuals.  To date, no such measurement instrument exists that has been shown to be reliable and valid.  The authors employ a rigorous design methodology to develop, test, and substantiate a reliable and valid instrument for measuring perceptions of anonymity across different contexts. The PA measure presented is a five item Likert scale designed to measure perceptions of anonymity across multiple contexts. Results from two separate EFA pilot tests (n=61 and n=60), a test-retest, and a CFA final test (n=292) indicate that the PA measure has good internal consistency reliability (a=.82), test-retest reliability, factorial validity, and a single factor structure. DOI:10.2458/azu_jmmss_v5i1_hite","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"5 1","pages":"22-39"},"PeriodicalIF":0.0,"publicationDate":"2014-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V5I1.18305","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69067976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
Numeric Estimation and Response Options: An Examination of the Accuracy of Numeric and Vague Quantifier Responses 数字估计和反应选项:对数字和模糊量词反应的准确性的检验
Pub Date : 2014-02-18 DOI: 10.2458/V5I2.18476
T. Baghal
Many survey questions ask respondents to provide responses that contain quantitative information, often using either numeric open-ended responses or vague quantifier scales. Generally, survey researchers have argued against the use of vague quantifier scales. However, no study has compared accuracy between vague quantifiers and numeric open-ended responses. This study is the first to do so, using a unique data set created through an experiment. 124 participants studied word lists of paired words, where the experiment employed a 2 (context) x 2 (response form) x 6 (actual frequency) factorial design, with the context and form factors manipulated between subjects, and the frequency factor manipulated within subjects. The two conditions for the context factor are same-context and different-context conditions where the context word either was the same or different for each presentation of the target word. The other between subject factor was response form, where participants responded to a recall test using either vague quantifiers or numeric open-ended responses. Translations of vague quantifiers were obtained and used in accuracy tests. Finally, a numeracy test was administered to collect information about respondent numeracy. Different accuracy measures are estimated and analyzed. Results show context memory did not have a significant effect. Numeracy has an effect, but the direction depends on form and context. Actual frequency had a significant effect on accuracy, but did not interact with other variables. Importantly, results suggest vague quantifiers tend to improve accuracy more often relative to numeric open-ended response. DOI:10.2458/azu_jmmss_v5i2_Al_baghal
许多调查问题要求受访者提供包含定量信息的回答,通常使用数字开放式回答或模糊的量词尺度。一般来说,调查研究人员反对使用模糊量词量表。然而,没有研究比较模糊量词和数字开放式回答之间的准确性。这项研究是第一次这样做,使用了一个通过实验创建的独特数据集。124名参与者研究了成对单词的单词列表,实验采用2(上下文)x 2(响应形式)x 6(实际频率)因子设计,在受试者之间操纵上下文和形式因素,在受试者内部操纵频率因素。上下文因素的两个条件是相同上下文和不同上下文条件,其中上下文单词对于目标单词的每次表示都是相同或不同的。另一个主题之间的因素是反应形式,参与者用模糊的量词或数字开放式的回答来回应回忆测试。获得了模糊量词的翻译,并将其用于准确性测试。最后,进行计算能力测试以收集有关被调查者计算能力的信息。对不同的精度措施进行了估计和分析。结果显示,情境记忆没有显著影响。计算能力是有影响的,但方向取决于形式和语境。实际频率对准确性有显著影响,但与其他变量没有交互作用。重要的是,结果表明,相对于数字开放式回答,模糊量词往往更能提高准确性。DOI: 10.2458 / azu_jmmss_v5i2_Al_baghal
{"title":"Numeric Estimation and Response Options: An Examination of the Accuracy of Numeric and Vague Quantifier Responses","authors":"T. Baghal","doi":"10.2458/V5I2.18476","DOIUrl":"https://doi.org/10.2458/V5I2.18476","url":null,"abstract":"Many survey questions ask respondents to provide responses that contain quantitative information, often using either numeric open-ended responses or vague quantifier scales. Generally, survey researchers have argued against the use of vague quantifier scales. However, no study has compared accuracy between vague quantifiers and numeric open-ended responses. This study is the first to do so, using a unique data set created through an experiment. 124 participants studied word lists of paired words, where the experiment employed a 2 (context) x 2 (response form) x 6 (actual frequency) factorial design, with the context and form factors manipulated between subjects, and the frequency factor manipulated within subjects. The two conditions for the context factor are same-context and different-context conditions where the context word either was the same or different for each presentation of the target word. The other between subject factor was response form, where participants responded to a recall test using either vague quantifiers or numeric open-ended responses. Translations of vague quantifiers were obtained and used in accuracy tests. Finally, a numeracy test was administered to collect information about respondent numeracy. Different accuracy measures are estimated and analyzed. Results show context memory did not have a significant effect. Numeracy has an effect, but the direction depends on form and context. Actual frequency had a significant effect on accuracy, but did not interact with other variables. Importantly, results suggest vague quantifiers tend to improve accuracy more often relative to numeric open-ended response. DOI:10.2458/azu_jmmss_v5i2_Al_baghal","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"46 1","pages":"58-75"},"PeriodicalIF":0.0,"publicationDate":"2014-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69070448","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
No matter Where You Go, There You Are: The Genetic Foundations of Temporal Stability 无论你去哪里,你在哪里:时间稳定的遗传基础
Pub Date : 2014-02-18 DOI: 10.2458/V5I2.18477
A. Figueredo, T. C. Baca, Candace J Black
We present empirical tests of the stability of individual differences over the lifespan using a novel methodological technique to combine behavior-genetic data from twin dyads with longitudinal measures of life history-related traits (including health and personality) from non-twin samples.  Using data from The Midlife in the United States (MIDUS) Longitudinal Survey, we constructed a series of “hybrid” models that permitted the estimation of both temporal stability parameters and behavior-genetic variance components to determine the contributions of genetic and environmental influences on individual differences.  Our results indicate that changes in a higher-order factor of life history strategy (Super-K, composed of the K-Factor, Covitality, and Personality) over the study period were very small in magnitude and that this temporal stability is under a considerable degree of shared genetic influence and a substantial degree of non-shared environmental influence, but a statistically non-significant degree of shared environmental influence.  Implications and future directions are discussed.  DOI:10.2458/azu_jmmss_v5i1_figueredo
我们采用一种新颖的方法技术,将来自双胞胎双体的行为遗传数据与来自非双胞胎样本的生活史相关特征(包括健康和个性)的纵向测量相结合,对个体差异在整个生命周期中的稳定性进行实证检验。利用美国中年纵向调查(MIDUS)的数据,我们构建了一系列“混合”模型,该模型允许估计时间稳定性参数和行为遗传方差成分,以确定遗传和环境对个体差异的影响。我们的研究结果表明,在研究期间,生活史策略的高阶因子(Super-K,由k因子、共生力和人格组成)的变化幅度非常小,这种时间稳定性受到相当程度的共同遗传影响和相当程度的非共同环境影响,但共同环境影响的统计程度不显著。讨论了影响和未来的发展方向。DOI: 10.2458 / azu_jmmss_v5i1_figueredo
{"title":"No matter Where You Go, There You Are: The Genetic Foundations of Temporal Stability","authors":"A. Figueredo, T. C. Baca, Candace J Black","doi":"10.2458/V5I2.18477","DOIUrl":"https://doi.org/10.2458/V5I2.18477","url":null,"abstract":"We present empirical tests of the stability of individual differences over the lifespan using a novel methodological technique to combine behavior-genetic data from twin dyads with longitudinal measures of life history-related traits (including health and personality) from non-twin samples.  Using data from The Midlife in the United States (MIDUS) Longitudinal Survey, we constructed a series of “hybrid” models that permitted the estimation of both temporal stability parameters and behavior-genetic variance components to determine the contributions of genetic and environmental influences on individual differences.  Our results indicate that changes in a higher-order factor of life history strategy (Super-K, composed of the K-Factor, Covitality, and Personality) over the study period were very small in magnitude and that this temporal stability is under a considerable degree of shared genetic influence and a substantial degree of non-shared environmental influence, but a statistically non-significant degree of shared environmental influence.  Implications and future directions are discussed.  DOI:10.2458/azu_jmmss_v5i1_figueredo","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"15 1","pages":"76-106"},"PeriodicalIF":0.0,"publicationDate":"2014-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69070467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
The Experimenting Society 实验社会
Pub Date : 2014-02-18 DOI: 10.2458/azu_jmmss.v3i2.16477
Melinda F. Davis
Donald Campbell wrote eloquently about the need to evaluate social reforms and lamented the lack of solid evaluation research to guide these reforms (1973).  He suggested that social reforms be thought of as experiments, and society’s focus be on important problems rather than single solutions to these problems.  Campbell’s vision of an experimenting society, in which reforms are evaluated and new approaches to social problems are developed based on evaluation outcomes has yet to be realized. DOI:10.2458/azu_jmmss_v5i2_davis
唐纳德·坎贝尔雄辩地论述了评估社会改革的必要性,并哀叹缺乏可靠的评估研究来指导这些改革(1973年)。他建议将社会改革视为一种实验,社会的焦点应该放在重要的问题上,而不是解决这些问题的单一方法上。坎贝尔所设想的实验社会——对改革进行评估,并根据评估结果制定解决社会问题的新方法——尚未实现。DOI: 10.2458 / azu_jmmss_v5i2_davis
{"title":"The Experimenting Society","authors":"Melinda F. Davis","doi":"10.2458/azu_jmmss.v3i2.16477","DOIUrl":"https://doi.org/10.2458/azu_jmmss.v3i2.16477","url":null,"abstract":"Donald Campbell wrote eloquently about the need to evaluate social reforms and lamented the lack of solid evaluation research to guide these reforms (1973).  He suggested that social reforms be thought of as experiments, and society’s focus be on important problems rather than single solutions to these problems.  Campbell’s vision of an experimenting society, in which reforms are evaluated and new approaches to social problems are developed based on evaluation outcomes has yet to be realized. DOI:10.2458/azu_jmmss_v5i2_davis","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"5 1","pages":"56-57"},"PeriodicalIF":0.0,"publicationDate":"2014-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69054811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reproductive Strategy and Sexual Conflict Slow Life History Strategy Inihibts Negative Androcentrism 生殖策略与性冲突慢生活史策略抑制负男性中心主义
Pub Date : 2013-11-01 DOI: 10.2458/V4I1.17774
P. Gladden, A. Figueredo, D. J. Andrejzak, Daniel N. Jones, V. Smith-Castro
Recent findings indicate that a slow Life History (LH) strategy factor is associated with increased levels of Executive Functioning (EF), increased emotional intelligence, decreased levels of sexually coercive behaviors, and decreased levels of negative ethnocentrism. Based on these findings, as well as the generative theory, we predicted that slow LH strategy should inhibit negative androcentrism (bias against women). A sample of undergraduates responded to a battery of questionnaires measuring various facets of their LH Strategy, (e.g., sociosexual orientation, mating effort, mate-value, psychopathy, executive functioning, and emotional intelligence) and various convergent measures of Negative Androcentrism. A structural model that the data fit well indicated a latent protective LH strategy trait predicted decreased negative androcentrism. This trait fully mediated the relationship between participant biological sex and androcentrism. We suggest that slow LH strategy may inhibit negative attitudes toward women because of relatively decreased intrasexual competition and intersexual conflict among slow LH strategists. DOI:10.2458/azu_jmmss_v4i1_gladden
最近的研究结果表明,慢生活史(LH)策略因素与执行功能(EF)水平的提高、情商的提高、性强迫行为水平的降低和消极种族中心主义水平的降低有关。基于这些发现,以及生成理论,我们预测慢LH策略应该抑制负面的男性中心主义(对女性的偏见)。一组大学生回答了一系列问卷调查,测量了他们的LH策略的各个方面(例如,社会性取向、交配努力、伴侣价值、精神病、执行功能和情商)和消极男性中心主义的各种趋同措施。一个数据拟合良好的结构模型表明,潜在的保护性LH策略性状预测了负雄性化的减少。这一特征完全介导了参与者生理性别与男性中心主义之间的关系。我们认为,慢LH策略可能会抑制对女性的负面态度,因为慢LH策略者的性内竞争和两性冲突相对较少。DOI: 10.2458 / azu_jmmss_v4i1_gladden
{"title":"Reproductive Strategy and Sexual Conflict Slow Life History Strategy Inihibts Negative Androcentrism","authors":"P. Gladden, A. Figueredo, D. J. Andrejzak, Daniel N. Jones, V. Smith-Castro","doi":"10.2458/V4I1.17774","DOIUrl":"https://doi.org/10.2458/V4I1.17774","url":null,"abstract":"Recent findings indicate that a slow Life History (LH) strategy factor is associated with increased levels of Executive Functioning (EF), increased emotional intelligence, decreased levels of sexually coercive behaviors, and decreased levels of negative ethnocentrism. Based on these findings, as well as the generative theory, we predicted that slow LH strategy should inhibit negative androcentrism (bias against women). A sample of undergraduates responded to a battery of questionnaires measuring various facets of their LH Strategy, (e.g., sociosexual orientation, mating effort, mate-value, psychopathy, executive functioning, and emotional intelligence) and various convergent measures of Negative Androcentrism. A structural model that the data fit well indicated a latent protective LH strategy trait predicted decreased negative androcentrism. This trait fully mediated the relationship between participant biological sex and androcentrism. We suggest that slow LH strategy may inhibit negative attitudes toward women because of relatively decreased intrasexual competition and intersexual conflict among slow LH strategists. DOI:10.2458/azu_jmmss_v4i1_gladden","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"4 1","pages":"48-71"},"PeriodicalIF":0.0,"publicationDate":"2013-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V4I1.17774","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69067223","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 23
Comparison of Power for Multiple Comparison Procedures 多个比较程序的功率比较
Pub Date : 2013-11-01 DOI: 10.2458/V4I1.17775
R. S. Rodger, Mark D. Roberts
The number of methods for evaluating, and possibly making statistical decisions about, null contrasts - or their small sub-set, multiple comparisons - has grown extensively since the early 1950s. That demonstrates how important the subject is, but most of the growth consists of modest variations of the early methods. This paper examines nine fairly basic procedures, six of which are methods designed to evaluate contrasts chosen post hoc, i.e., after an examination of the test data. Three of these use experimentwise or familywise type 1 error rates (Scheffe 1953, Tukey 1953, Newman-Keuls, 1939 and 1952), two use decision-based type 1 error rates (Duncan 1951 and Rodger 1975a) and one (Fisher's LSD 1935) uses a mixture of the two type 1 error rate definitions. The other three methods examined are for evaluating, and possibly deciding about, a limited number of null contrasts that have been chosen independently of the sample data - preferably before the data are collected. One of these (planned t-tests) uses decision-based type 1 error rates and the other two (one based on Bonferroni's Inequality 1936, and the other Dunnett's 1964 Many-One procedure) use a familywise type 1 error rate. The use of these different type 1 error rate definitionsA creates quite large discrepancies in the capacities of the methods to detect true non-zero effects in the contrasts being evaluated. This article describes those discrepancies in power and, especially, how they are exacerbated by increases in the size of an investigation (i.e., an increase in J, the number of samples being examined). It is also true that the capacity of a multiple contrast procedure to 'unpick' 'true' differences from the sample data is influenced by the type of contrast the procedure permits. For example, multiple range procedures (such as that of Newman-Keuls and that of Duncan) permit only comparisons (i.e., two-group differences) and that greatly limits their discriminating capacity (which is not, technically speaking, their power). Many methods (those of Scheffe, Tukey's HSD, Newman-Keuls, Fisher's LSD, Bonferroni and Dunnett) place their emphasis on one particular question, "Are there any differences at all among the groups?" Some other procedures concentrate on individual contrasts (i.e., those of Duncan, Rodger and Planned Contrasts); so are more concerned with how many false null contrasts the method can detect. This results in two basically different definitions of detection capacity. Finally, there is a categorical difference between what post hoc methods and those evaluating pre-planned contrasts can find. The success of the latter depends on how wisely (or honestly well informed) the user has been in planning the limited number of statistically revealing contrasts to test. That can greatly affect the method's discriminating success, but it is often not included in power evaluations. These matters are elaborated upon as they arise in the exposition below. DOI:10.2458/azu_jmmss_v4i1_
自20世纪50年代初以来,评估零对比(或它们的小子集,多重比较)并可能做出统计决策的方法的数量已经广泛增长。这表明了这门学科的重要性,但大多数增长都是早期方法的适度变化。本文考察了9个相当基本的程序,其中6个是设计用来评价事后选择的对比的方法,即在检查测试数据之后。其中三个使用实验型或家庭型1型错误率(Scheffe 1953, Tukey 1953, Newman-Keuls, 1939和1952),两个使用基于决策的1型错误率(Duncan 1951和Rodger 1975),一个(Fisher的LSD 1935)使用两种1型错误率定义的混合。研究的其他三种方法是用于评估和可能决定有限数量的零对比,这些零对比是独立于样本数据而选择的——最好是在收集数据之前。其中一个(计划t检验)使用基于决策的1型错误率,另外两个(一个基于Bonferroni的不等式1936年,另一个是Dunnett的1964年多一程序)使用家庭的1型错误率。使用这些不同的第1类错误率定义会在方法检测正在评估的对比中真正的非零效应的能力方面产生相当大的差异。本文描述了这些权力上的差异,特别是,它们是如何随着调查规模的增加而加剧的(例如,J的增加,即被检查的样本数量的增加)。多重对比程序从样本数据中“解出”“真实”差异的能力也受到该程序所允许的对比类型的影响。例如,多范围程序(如Newman-Keuls和Duncan的程序)只允许比较(即两组差异),这极大地限制了它们的判别能力(从技术上讲,这不是它们的权力)。许多方法(Scheffe, Tukey的HSD, Newman-Keuls, Fisher的LSD, Bonferroni和Dunnett的方法)都把重点放在一个特定的问题上,“这些群体之间有任何差异吗?”其他一些程序集中于个体对比(即邓肯,罗杰和计划对比);因此,我们更关心的是该方法可以检测到多少假null对比。这导致了对检测能力的两种基本不同的定义。最后,在事后方法和那些评估预先计划的对比可以发现的分类差异。后者的成功取决于用户如何明智地(或诚实地了解情况)计划有限数量的统计揭示对比测试。这可以极大地影响该方法的判别成功,但它通常不包括在功率评估中。这些问题将在下面的论述中加以阐述。DOI: 10.2458 / azu_jmmss_v4i1_rodger
{"title":"Comparison of Power for Multiple Comparison Procedures","authors":"R. S. Rodger, Mark D. Roberts","doi":"10.2458/V4I1.17775","DOIUrl":"https://doi.org/10.2458/V4I1.17775","url":null,"abstract":"The number of methods for evaluating, and possibly making statistical decisions about, null contrasts - or their small sub-set, multiple comparisons - has grown extensively since the early 1950s. That demonstrates how important the subject is, but most of the growth consists of modest variations of the early methods. This paper examines nine fairly basic procedures, six of which are methods designed to evaluate contrasts chosen post hoc, i.e., after an examination of the test data. Three of these use experimentwise or familywise type 1 error rates (Scheffe 1953, Tukey 1953, Newman-Keuls, 1939 and 1952), two use decision-based type 1 error rates (Duncan 1951 and Rodger 1975a) and one (Fisher's LSD 1935) uses a mixture of the two type 1 error rate definitions. The other three methods examined are for evaluating, and possibly deciding about, a limited number of null contrasts that have been chosen independently of the sample data - preferably before the data are collected. One of these (planned t-tests) uses decision-based type 1 error rates and the other two (one based on Bonferroni's Inequality 1936, and the other Dunnett's 1964 Many-One procedure) use a familywise type 1 error rate. The use of these different type 1 error rate definitionsA creates quite large discrepancies in the capacities of the methods to detect true non-zero effects in the contrasts being evaluated. This article describes those discrepancies in power and, especially, how they are exacerbated by increases in the size of an investigation (i.e., an increase in J, the number of samples being examined). It is also true that the capacity of a multiple contrast procedure to 'unpick' 'true' differences from the sample data is influenced by the type of contrast the procedure permits. For example, multiple range procedures (such as that of Newman-Keuls and that of Duncan) permit only comparisons (i.e., two-group differences) and that greatly limits their discriminating capacity (which is not, technically speaking, their power). Many methods (those of Scheffe, Tukey's HSD, Newman-Keuls, Fisher's LSD, Bonferroni and Dunnett) place their emphasis on one particular question, \"Are there any differences at all among the groups?\" Some other procedures concentrate on individual contrasts (i.e., those of Duncan, Rodger and Planned Contrasts); so are more concerned with how many false null contrasts the method can detect. This results in two basically different definitions of detection capacity. Finally, there is a categorical difference between what post hoc methods and those evaluating pre-planned contrasts can find. The success of the latter depends on how wisely (or honestly well informed) the user has been in planning the limited number of statistically revealing contrasts to test. That can greatly affect the method's discriminating success, but it is often not included in power evaluations. These matters are elaborated upon as they arise in the exposition below. DOI:10.2458/azu_jmmss_v4i1_","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"4 1","pages":"20-47"},"PeriodicalIF":0.0,"publicationDate":"2013-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V4I1.17775","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69067389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
Revisiting Mediation in the Social and Behavioral Sciences 重新审视社会和行为科学中的调解
Pub Date : 2013-11-01 DOI: 10.2458/V4I1.17761
A. Figueredo, R. García, T. C. Baca, J. C. Gable, Dave Weise
The process of mediation is of critical importance to the social and behavioral sciences and to evolutionary social psychology in particular. As with the concept of evolutionary adaptation, however, one can argue that causal mediation is in need of explicit theoretical justification and empirical support. Mainstream evolutionary social psychology proposes, for example, that organisms are “adaptation executers”, and not “fitness maximizers”. The execution of adaptations is triggered by fitness-relevant ecological contingencies at both ultimate and proximate levels of analysis. This logic is essentially equivalent to what methodologists refer to as the process of mediation; the adaptations to be executed (or not, depending upon the prevailing environmental circumstances) causally mediate the effects of the ecological contingencies upon the fitness outcomes. Thus, the process of mediation can be generally conceptualized as a causal chain of events leading to a given outcome or set of outcomes. If a predictor variable operates through an intervening variable to affect a criterion variable, then mediation is said to exist. Nevertheless, it does not appear that some psychologists (particularly evolutionary-social psychologists) are sufficiently well-versed in the fundamental logic and quantitative methodology of establishing causal mediation to support such claims. In the current paper, we set out to review the ways researchers support their use of mediation statements and also propose critical considerations on this front. We start with more conventional methods for testing mediation, discuss variants of the conventional approach, discuss the limitations of such methods as we see them, and end with our preferred mediation approach. DOI:10.2458/azu_jmmss_v04i1_figueredo3
调解的过程对社会科学和行为科学,特别是对进化社会心理学至关重要。然而,与进化适应的概念一样,人们可以认为因果中介需要明确的理论证明和经验支持。例如,主流进化社会心理学提出,生物体是“适应执行者”,而不是“适应性最大化者”。在最终和近似的分析水平上,适应性的执行是由与健康相关的生态偶然性触发的。这种逻辑在本质上相当于方法论学家所说的中介过程。要执行的适应(或不执行,取决于当时的环境情况)会对生态偶然性对适应度结果的影响进行因果调解。因此,调解过程通常可以被概念化为导致给定结果或一组结果的事件因果链。如果一个预测变量通过一个干预变量来影响一个标准变量,那么就说存在中介。然而,一些心理学家(尤其是进化社会心理学家)似乎并不精通建立因果中介的基本逻辑和定量方法,以支持这些主张。在当前的论文中,我们着手审查研究人员支持他们使用调解声明的方式,并提出了这方面的关键考虑因素。我们从测试中介的更传统的方法开始,讨论传统方法的变体,讨论我们所看到的这些方法的局限性,并以我们首选的中介方法结束。DOI: 10.2458 / azu_jmmss_v04i1_figueredo3
{"title":"Revisiting Mediation in the Social and Behavioral Sciences","authors":"A. Figueredo, R. García, T. C. Baca, J. C. Gable, Dave Weise","doi":"10.2458/V4I1.17761","DOIUrl":"https://doi.org/10.2458/V4I1.17761","url":null,"abstract":"The process of mediation is of critical importance to the social and behavioral sciences and to evolutionary social psychology in particular. As with the concept of evolutionary adaptation, however, one can argue that causal mediation is in need of explicit theoretical justification and empirical support. Mainstream evolutionary social psychology proposes, for example, that organisms are “adaptation executers”, and not “fitness maximizers”. The execution of adaptations is triggered by fitness-relevant ecological contingencies at both ultimate and proximate levels of analysis. This logic is essentially equivalent to what methodologists refer to as the process of mediation; the adaptations to be executed (or not, depending upon the prevailing environmental circumstances) causally mediate the effects of the ecological contingencies upon the fitness outcomes. Thus, the process of mediation can be generally conceptualized as a causal chain of events leading to a given outcome or set of outcomes. If a predictor variable operates through an intervening variable to affect a criterion variable, then mediation is said to exist. Nevertheless, it does not appear that some psychologists (particularly evolutionary-social psychologists) are sufficiently well-versed in the fundamental logic and quantitative methodology of establishing causal mediation to support such claims. In the current paper, we set out to review the ways researchers support their use of mediation statements and also propose critical considerations on this front. We start with more conventional methods for testing mediation, discuss variants of the conventional approach, discuss the limitations of such methods as we see them, and end with our preferred mediation approach. DOI:10.2458/azu_jmmss_v04i1_figueredo3","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"4 1","pages":"1-19"},"PeriodicalIF":0.0,"publicationDate":"2013-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V4I1.17761","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69067177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Complementary Meta-Analytic Methods for the Quantitative Review of Research: 2. An Extended Illustration 研究定量评价的补充性元分析方法:扩展插图
Pub Date : 2013-06-01 DOI: 10.2458/V4I2.17936
A. Figueredo, Candace J Black, A. Scott
In Figueredo, Black, and Scott (this issue), we presented the rationale for a complementary meta-analytic method to accompany traditional effects meta-analytic procedures.  Here, we provide an example using Contents Meta-Analysis so that readers can become familiar with the application of the method and the implications of its use.  This illustration will be presented in two major sections.  First, we will describe an empirical example of a meta-analysis on retention in higher education where a Contents Meta-Analysis was conducted.  Then we will show how the information gained in the Contents Meta-Analysis may be applied to address issues of generalizability. DOI:10.2458/azu_jmmss_v4i2_figueredo
在Figueredo, Black和Scott(本期)中,我们提出了一种补充元分析方法的基本原理,以配合传统的效应元分析程序。在这里,我们提供了一个使用内容元分析的例子,以便读者可以熟悉该方法的应用及其使用的含义。这个插图将分为两个主要部分。首先,我们将描述一个关于高等教育保留的元分析的实证例子,其中进行了内容元分析。然后,我们将展示如何将在内容元分析中获得的信息应用于解决概括性问题。DOI: 10.2458 / azu_jmmss_v4i2_figueredo
{"title":"Complementary Meta-Analytic Methods for the Quantitative Review of Research: 2. An Extended Illustration","authors":"A. Figueredo, Candace J Black, A. Scott","doi":"10.2458/V4I2.17936","DOIUrl":"https://doi.org/10.2458/V4I2.17936","url":null,"abstract":"In Figueredo, Black, and Scott (this issue), we presented the rationale for a complementary meta-analytic method to accompany traditional effects meta-analytic procedures.  Here, we provide an example using Contents Meta-Analysis so that readers can become familiar with the application of the method and the implications of its use.  This illustration will be presented in two major sections.  First, we will describe an empirical example of a meta-analysis on retention in higher education where a Contents Meta-Analysis was conducted.  Then we will show how the information gained in the Contents Meta-Analysis may be applied to address issues of generalizability. DOI:10.2458/azu_jmmss_v4i2_figueredo","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"4 1","pages":"46-67"},"PeriodicalIF":0.0,"publicationDate":"2013-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V4I2.17936","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69067546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Journal of methods and measurement in the social sciences
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1