首页 > 最新文献

European Journal of Psychological Assessment最新文献

英文 中文
Evaluating Gender Differences in Problematic Smartphone Use 评估有问题的智能手机使用中的性别差异
IF 2.5 3区 心理学 Pub Date : 2022-09-13 DOI: 10.1027/1015-5759/a000730
Laura Salerno, Analyn Alquitran, Noor Alibrahim, G. Lo Coco, M. Di Blasi, C. Giordano
Abstract. The Smartphone Addiction Inventory (SPAI) is widely used to measure problematic smartphone use (PSU). Although the SPAI has been translated and validated in different countries, its measurement invariance across gender has received little research attention. This study aimed to examine whether men and women interpreted the Italian version of the SPAI (SPAI-I) similarly and, consequently, whether the observed gender differences in SPAI scores, which have been shown in previous studies, could be due to true differences, rather than to differences in measurement. Six hundred nineteen Italian young adults ( Mage = 22.02 ± 2.63; 55.7% women) took part in the study and completed the SPAI-I. Multigroup CFA was applied to test the measurement invariance across gender, and the item parameter invariance was investigated with the item-response theory (IRT) differential item functioning (DIF) method for multidimensional models. Evidence of measurement invariance across gender was found. Only one item (i.e., item 14, “The idea of using smartphone comes as the first thought on mind when waking up each morning”) out of 24 items of the SPAI-I showed DIF with a large effect size. Gender-related differences found with the SPAI-I reflect true differences in smartphone overuse rather than specific characteristics of the measure.
摘要智能手机成瘾量表(SPAI)被广泛用于衡量有问题的智能手机使用情况(PSU)。尽管SPAI已在不同国家得到翻译和验证,但其跨性别的测量不变性很少受到研究关注。本研究旨在检验男性和女性对意大利版SPAI(SPAI-I)的解释是否相似,因此,先前研究中显示的SPAI评分中观察到的性别差异是否可能是由于真正的差异,而不是测量上的差异。619名意大利年轻人(Mage=22.02±2.63;55.7%的女性)参加了这项研究并完成了SPAI-I。应用多组CFA测试跨性别的测量不变性,并用项目反应理论(IRT)微分项目功能(DIF)方法研究多维模型的项目参数不变性。发现了跨性别测量不变性的证据。在SPAI-i的24个项目中,只有一个项目(即第14项,“每天早上醒来时第一个想到的是使用智能手机”)显示了具有较大效果大小的DIF。SPAI-I发现的与性别相关的差异反映了智能手机过度使用的真实差异,而不是该测量的具体特征。
{"title":"Evaluating Gender Differences in Problematic Smartphone Use","authors":"Laura Salerno, Analyn Alquitran, Noor Alibrahim, G. Lo Coco, M. Di Blasi, C. Giordano","doi":"10.1027/1015-5759/a000730","DOIUrl":"https://doi.org/10.1027/1015-5759/a000730","url":null,"abstract":"Abstract. The Smartphone Addiction Inventory (SPAI) is widely used to measure problematic smartphone use (PSU). Although the SPAI has been translated and validated in different countries, its measurement invariance across gender has received little research attention. This study aimed to examine whether men and women interpreted the Italian version of the SPAI (SPAI-I) similarly and, consequently, whether the observed gender differences in SPAI scores, which have been shown in previous studies, could be due to true differences, rather than to differences in measurement. Six hundred nineteen Italian young adults ( Mage = 22.02 ± 2.63; 55.7% women) took part in the study and completed the SPAI-I. Multigroup CFA was applied to test the measurement invariance across gender, and the item parameter invariance was investigated with the item-response theory (IRT) differential item functioning (DIF) method for multidimensional models. Evidence of measurement invariance across gender was found. Only one item (i.e., item 14, “The idea of using smartphone comes as the first thought on mind when waking up each morning”) out of 24 items of the SPAI-I showed DIF with a large effect size. Gender-related differences found with the SPAI-I reflect true differences in smartphone overuse rather than specific characteristics of the measure.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41683442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Meta-Analysis of Factor Analyses of the General Health Questionnaire – Short Forms GHQ-28 and GHQ-30 一般健康问卷- GHQ-28和GHQ-30简表因子分析的元分析
IF 2.5 3区 心理学 Pub Date : 2022-09-13 DOI: 10.1027/1015-5759/a000727
Alan B. Shafer
Abstract. Two meta-analyses of exploratory factor analyses of the General Health Questionnaire short forms, GHQ-28 ( N = 26,848, k = 40) and GHQ-30 ( N = 43,151  k = 25), were conducted to determine the consistent factors found in each test and any common factors across them. Five databases (PsycINFO, PubMed, BASE, Semantic, and Google Scholar) were searched in 2021. Reproduced correlations derived from the original studies’ factor matrices and aggregated across studies were factor analyzed for the meta-analyses. For the GHQ-28, the standard four subscales of somatic, anxiety, social dysfunction, and depression were clearly identified and strongly supported by a four-factor structure. For the GHQ-30, a four-factor solution identified factors of anxiety, depression, social dysfunction, and social satisfaction, the first three factors shared a number of items with the same scales found in the GHQ-28. These shared factors appear similar across tests and should help bridge research using the GHQ-30 and the GHQ-28. Confirmatory factor analyses supported the four-factor models in both tests. The four standard subscales of GHQ-28 were strongly supported and can be recommended. The three similar factors in the GHQ-30, as well as the social satisfaction factor, appear reasonable to use.
摘要对GHQ-28 (N = 26,848, k = 40)和GHQ-30 (N = 43,151, k = 25)的探索性因子分析进行了两项荟萃分析,以确定每个测试中发现的一致性因素以及它们之间的共同因素。五个数据库(PsycINFO、PubMed、BASE、Semantic和谷歌Scholar)在2021年被检索。从原始研究的因素矩阵中得出的再现相关性和跨研究汇总的相关性在meta分析中进行了因素分析。在GHQ-28中,躯体、焦虑、社交功能障碍和抑郁四个标准分量表被清晰地识别出来,并得到四因素结构的有力支持。对于GHQ-30,一个四因素解决方案确定了焦虑,抑郁,社交功能障碍和社交满意度的因素,前三个因素与GHQ-28中发现的相同量表共享许多项目。这些共同的因素在测试中似乎相似,应该有助于使用GHQ-30和GHQ-28进行研究。验证性因子分析支持两项测试的四因素模型。GHQ-28的四个标准分量表得到了强有力的支持和推荐。GHQ-30中的三个相似因子,以及社会满意度因子,似乎是合理的。
{"title":"Meta-Analysis of Factor Analyses of the General Health Questionnaire – Short Forms GHQ-28 and GHQ-30","authors":"Alan B. Shafer","doi":"10.1027/1015-5759/a000727","DOIUrl":"https://doi.org/10.1027/1015-5759/a000727","url":null,"abstract":"Abstract. Two meta-analyses of exploratory factor analyses of the General Health Questionnaire short forms, GHQ-28 ( N = 26,848, k = 40) and GHQ-30 ( N = 43,151  k = 25), were conducted to determine the consistent factors found in each test and any common factors across them. Five databases (PsycINFO, PubMed, BASE, Semantic, and Google Scholar) were searched in 2021. Reproduced correlations derived from the original studies’ factor matrices and aggregated across studies were factor analyzed for the meta-analyses. For the GHQ-28, the standard four subscales of somatic, anxiety, social dysfunction, and depression were clearly identified and strongly supported by a four-factor structure. For the GHQ-30, a four-factor solution identified factors of anxiety, depression, social dysfunction, and social satisfaction, the first three factors shared a number of items with the same scales found in the GHQ-28. These shared factors appear similar across tests and should help bridge research using the GHQ-30 and the GHQ-28. Confirmatory factor analyses supported the four-factor models in both tests. The four standard subscales of GHQ-28 were strongly supported and can be recommended. The three similar factors in the GHQ-30, as well as the social satisfaction factor, appear reasonable to use.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46321258","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Can Psychological Assessment Contribute to a Better World? 心理评估能为更美好的世界做出贡献吗?
IF 2.5 3区 心理学 Pub Date : 2022-09-01 DOI: 10.1027/1015-5759/a000739
D. Gallardo-Pujol, M. Ziegler, D. Iliescu
{"title":"Can Psychological Assessment Contribute to a Better World?","authors":"D. Gallardo-Pujol, M. Ziegler, D. Iliescu","doi":"10.1027/1015-5759/a000739","DOIUrl":"https://doi.org/10.1027/1015-5759/a000739","url":null,"abstract":"","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46432901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
How Fair Is My Test? 我的考试公平吗?
IF 2.5 3区 心理学 Pub Date : 2022-08-09 DOI: 10.1027/1015-5759/a000724
Denis G. Dumas, Yixiao Dong, Daniel M. McNeish
Abstract. The degree to which test scores can support justified and fair decisions about demographically diverse participants has been an important aspect of educational and psychological testing for millennia. In the last 30 years, this aspect of measurement has come to be known as consequential validity, and it has sparked scholarly debate as to how responsible psychometricians should be for the fairness of the tests they create and how the field might be able to quantify that fairness and communicate it to applied researchers and other stakeholders of testing programs. Here, we formulate a relatively simple-to-calculate ratio coefficient that is meant to capture how well the scores from a given test can predict a criterion free from the undue influence of student demographics. We posit three example calculations of this Consequential Validity Ratio (CVR): one where the CVR is quite strong, another where the CVR is more moderate, and a third where the CVR is weak. We provide preliminary suggestions for interpreting the CVR and discuss its utility in instances where new tests are being developed, tests are being adapted to a new population, or the fairness of an established test has become an empirical question.
摘要几千年来,考试成绩在多大程度上支持对人口统计学上不同的参与者做出合理和公平的决定,一直是教育和心理测试的一个重要方面。在过去的30年里,测量的这一方面被称为结果效度,它引发了关于心理测量学家应该如何对他们创建的测试的公平性负责,以及该领域如何能够量化这种公平性,并将其传达给应用研究人员和测试项目的其他利益相关者的学术辩论。在这里,我们制定了一个相对简单的计算比率系数,旨在捕捉给定测试的分数在不受学生人口统计数据不当影响的情况下预测标准的程度。我们假设了三个计算结果效度比(CVR)的例子:一个CVR很强,另一个CVR比较温和,第三个CVR很弱。我们为解释CVR提供了初步建议,并在正在开发新测试、测试正在适应新人群或既定测试的公平性已成为实证问题的情况下讨论其效用。
{"title":"How Fair Is My Test?","authors":"Denis G. Dumas, Yixiao Dong, Daniel M. McNeish","doi":"10.1027/1015-5759/a000724","DOIUrl":"https://doi.org/10.1027/1015-5759/a000724","url":null,"abstract":"Abstract. The degree to which test scores can support justified and fair decisions about demographically diverse participants has been an important aspect of educational and psychological testing for millennia. In the last 30 years, this aspect of measurement has come to be known as consequential validity, and it has sparked scholarly debate as to how responsible psychometricians should be for the fairness of the tests they create and how the field might be able to quantify that fairness and communicate it to applied researchers and other stakeholders of testing programs. Here, we formulate a relatively simple-to-calculate ratio coefficient that is meant to capture how well the scores from a given test can predict a criterion free from the undue influence of student demographics. We posit three example calculations of this Consequential Validity Ratio (CVR): one where the CVR is quite strong, another where the CVR is more moderate, and a third where the CVR is weak. We provide preliminary suggestions for interpreting the CVR and discuss its utility in instances where new tests are being developed, tests are being adapted to a new population, or the fairness of an established test has become an empirical question.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57277489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Workplace Stress in Real Time 实时工作场所压力
IF 2.5 3区 心理学 Pub Date : 2022-08-03 DOI: 10.1027/1015-5759/a000725
L. Menghini, M. Pastore, C. Balducci
Abstract. Experience sampling methods are increasingly used in workplace stress assessment, yet rarely developed and validated following the available best practices. Here, we developed and evaluated parsimonious measures of momentary stressors (Task Demand and Task Control) and the Italian adaptation of the Multidimensional Mood Questionnaire as an indicator of momentary strain (Negative Valence, Tense Arousal, and Fatigue). Data from 139 full-time office workers that received seven experience sampling questionnaires per day over 3 workdays suggested satisfactory validity (including weak invariance cross-level isomorphism), level-specific reliability, and sensitivity to change. The scales also showed substantial correlations with retrospective measures of the corresponding or similar constructs and a degree of sensitivity to work sampling categories (type and mean of job task, people involved). Opportunities and recommendations for the investigation and the routine assessment of workplace stress are discussed.
摘要经验抽样方法越来越多地用于工作场所压力评估,但很少根据现有的最佳实践进行开发和验证。在这里,我们开发并评估了瞬时压力源(任务需求和任务控制)的简约测量,以及意大利对多维情绪问卷的改编,作为瞬时压力的指标(负价、紧张唤起和疲劳)。来自139名全职上班族的数据显示,他们在3个工作日内每天接受7份经验抽样问卷,具有令人满意的有效性(包括弱不变性跨级别同构)、特定级别的可靠性和对变化的敏感性。该量表还显示出与相应或类似结构的回顾性测量以及对工作抽样类别(工作任务的类型和平均值、相关人员)的敏感性程度存在显著相关性。讨论了工作场所压力调查和日常评估的机会和建议。
{"title":"Workplace Stress in Real Time","authors":"L. Menghini, M. Pastore, C. Balducci","doi":"10.1027/1015-5759/a000725","DOIUrl":"https://doi.org/10.1027/1015-5759/a000725","url":null,"abstract":"Abstract. Experience sampling methods are increasingly used in workplace stress assessment, yet rarely developed and validated following the available best practices. Here, we developed and evaluated parsimonious measures of momentary stressors (Task Demand and Task Control) and the Italian adaptation of the Multidimensional Mood Questionnaire as an indicator of momentary strain (Negative Valence, Tense Arousal, and Fatigue). Data from 139 full-time office workers that received seven experience sampling questionnaires per day over 3 workdays suggested satisfactory validity (including weak invariance cross-level isomorphism), level-specific reliability, and sensitivity to change. The scales also showed substantial correlations with retrospective measures of the corresponding or similar constructs and a degree of sensitivity to work sampling categories (type and mean of job task, people involved). Opportunities and recommendations for the investigation and the routine assessment of workplace stress are discussed.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49383611","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How Vivid Is Your Mental Imagery? 你的心理意象有多生动?
IF 2.5 3区 心理学 Pub Date : 2022-07-27 DOI: 10.1027/1015-5759/a000721
D. Jankowska, M. Karwowski
Abstract. Across five studies (total N > 3,600), we report the psychometric properties of the Polish version of the Vividness of Visual Imagery Questionnaire (VVIQ-2PL). Confirmatory factor analysis confirmed a unidimensional structure of this instrument; measurement invariance concerning participants’ gender was established as well. The VVIQ-2PL showed excellent test-retest reliability, high internal consistency, and adequate construct validity. As predicted, art students scored significantly higher in visual mental imagery than the non-artist group. We discuss these findings alongside future research directions and possible modifications of VVIQ-2PL.
摘要在五项研究中(总N>3600),我们报告了波兰版视觉形象生动性问卷(VVIQ-2PL)的心理测量特性。验证性因子分析证实了该仪器的一维结构;还建立了关于参与者性别的测量不变性。VVIQ-2PL显示出良好的重测可靠性、高度的内部一致性和足够的结构有效性。正如预测的那样,艺术学生在视觉心理意象方面的得分明显高于非艺术家组。我们将这些发现与VVIQ-2PL的未来研究方向和可能的修改一起进行讨论。
{"title":"How Vivid Is Your Mental Imagery?","authors":"D. Jankowska, M. Karwowski","doi":"10.1027/1015-5759/a000721","DOIUrl":"https://doi.org/10.1027/1015-5759/a000721","url":null,"abstract":"Abstract. Across five studies (total N > 3,600), we report the psychometric properties of the Polish version of the Vividness of Visual Imagery Questionnaire (VVIQ-2PL). Confirmatory factor analysis confirmed a unidimensional structure of this instrument; measurement invariance concerning participants’ gender was established as well. The VVIQ-2PL showed excellent test-retest reliability, high internal consistency, and adequate construct validity. As predicted, art students scored significantly higher in visual mental imagery than the non-artist group. We discuss these findings alongside future research directions and possible modifications of VVIQ-2PL.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42706368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Investigating Measurement Invariance of the Psychological Entitlement Scale – Grandiose-Based and Vulnerable-Based 心理权利量表的测量不变性研究——基于宏大和基于脆弱
IF 2.5 3区 心理学 Pub Date : 2022-07-27 DOI: 10.1027/1015-5759/a000726
W. Hart, Joshua T. Lambert, Charlotte Kinrade
Abstract. Entitlement has attracted interest across various social science disciplines due to its broad connection to selfish decision-making outcomes and mental health. Although unidimensional entitlement scales have been widely used, these scales conflate vulnerable- and grandiose-based entitlement forms. The Psychological Entitlement Scale – Grandiose-Based and Vulnerable-Based (PES-G/V) was recently devised to measure these entitlement forms. Prior work has supported the structure and construct validity of the PES-G/V, but no research has addressed the measurement invariance (MI) of the PES-G/V. Hence, we examined MI in relation to gender, two popular sampling frames in psychology studies (US MTurk participants and US college participants), and age. Results supported scalar MI across levels of each of the grouping variables. In sum, the structural properties of the PES-G/V seemed robust to the group distinctions.
摘要由于权利与自私的决策结果和心理健康的广泛联系,它吸引了各个社会科学学科的兴趣。虽然单维权利量表已被广泛使用,但这些量表将基于脆弱和基于宏伟的权利形式混为一谈。最近设计了心理权利量表-基于浮夸和基于脆弱(PES-G/V)来衡量这些权利形式。先前的研究支持了PES-G/V的结构效度和构效度,但没有研究涉及PES-G/V的测量不变性(MI)。因此,我们研究了MI与性别、心理学研究中两种流行的抽样框架(美国MTurk参与者和美国大学参与者)和年龄的关系。结果支持跨每个分组变量级别的标量MI。总而言之,PES-G/V的结构特性对群体差异似乎是稳健的。
{"title":"Investigating Measurement Invariance of the Psychological Entitlement Scale – Grandiose-Based and Vulnerable-Based","authors":"W. Hart, Joshua T. Lambert, Charlotte Kinrade","doi":"10.1027/1015-5759/a000726","DOIUrl":"https://doi.org/10.1027/1015-5759/a000726","url":null,"abstract":"Abstract. Entitlement has attracted interest across various social science disciplines due to its broad connection to selfish decision-making outcomes and mental health. Although unidimensional entitlement scales have been widely used, these scales conflate vulnerable- and grandiose-based entitlement forms. The Psychological Entitlement Scale – Grandiose-Based and Vulnerable-Based (PES-G/V) was recently devised to measure these entitlement forms. Prior work has supported the structure and construct validity of the PES-G/V, but no research has addressed the measurement invariance (MI) of the PES-G/V. Hence, we examined MI in relation to gender, two popular sampling frames in psychology studies (US MTurk participants and US college participants), and age. Results supported scalar MI across levels of each of the grouping variables. In sum, the structural properties of the PES-G/V seemed robust to the group distinctions.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44134511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Semantic Spaces Are Not Created Equal – How Should We Weigh Them in the Sequel? 语义空间生来就不平等——我们应该如何在续集中权衡它们?
IF 2.5 3区 心理学 Pub Date : 2022-07-27 DOI: 10.1027/1015-5759/a000723
Boris Forthmann, R. Beaty, D. Johnson
Abstract. Semantic distance scoring provides an attractive alternative to other scoring approaches for responses in creative thinking tasks. In addition, evidence in support of semantic distance scoring has increased over the last few years. In one recent approach, it has been proposed to combine multiple semantic spaces to better balance the idiosyncratic influences of each space. Thereby, final semantic distance scores for each response are represented by a composite or factor score. However, semantic spaces are not necessarily equally weighted in mean scores, and the usage of factor scores requires high levels of factor determinacy (i.e., the correlation between estimates and true factor scores). Hence, in this work, we examined the weighting underlying mean scores, mean scores of standardized variables, factor loadings, weights that maximize reliability, and equally effective weights on common verbal creative thinking tasks. Both empirical and simulated factor determinacy, as well as Gilmer-Feldt’s composite reliability, were mostly good to excellent (i.e., > .80) across two task types (Alternate Uses and Creative Word Association), eight samples of data, and all weighting approaches. Person-level validity findings were further highly comparable across weighting approaches. Observed nuances and challenges of different weightings and the question of using composites vs. factor scores are thoroughly provided.
摘要语义距离评分为创造性思维任务中的反应提供了一种有吸引力的替代其他评分方法。此外,支持语义距离评分的证据在过去几年中有所增加。在最近的一种方法中,有人提出将多个语义空间结合起来,以更好地平衡每个空间的特殊影响。因此,每个响应的最终语义距离得分由复合得分或因子得分表示。然而,语义空间在平均得分中的权重不一定相等,并且因子得分的使用需要高水平的因子确定性(即估计值和真实因子得分之间的相关性)。因此,在这项工作中,我们检查了潜在平均得分的权重、标准化变量的平均得分、因子负荷、最大化可靠性的权重,以及常见言语创造性思维任务的同等有效权重。经验和模拟因素的确定性,以及Gilmer-Feldt的综合可靠性,在两种任务类型(交替使用和创造性单词联想)、八个数据样本和所有加权方法中,大多从好到优(即>.80)。个体水平的有效性调查结果在加权方法中具有高度可比性。充分提供了观察到的不同权重的细微差别和挑战,以及使用复合物与因子得分的问题。
{"title":"Semantic Spaces Are Not Created Equal – How Should We Weigh Them in the Sequel?","authors":"Boris Forthmann, R. Beaty, D. Johnson","doi":"10.1027/1015-5759/a000723","DOIUrl":"https://doi.org/10.1027/1015-5759/a000723","url":null,"abstract":"Abstract. Semantic distance scoring provides an attractive alternative to other scoring approaches for responses in creative thinking tasks. In addition, evidence in support of semantic distance scoring has increased over the last few years. In one recent approach, it has been proposed to combine multiple semantic spaces to better balance the idiosyncratic influences of each space. Thereby, final semantic distance scores for each response are represented by a composite or factor score. However, semantic spaces are not necessarily equally weighted in mean scores, and the usage of factor scores requires high levels of factor determinacy (i.e., the correlation between estimates and true factor scores). Hence, in this work, we examined the weighting underlying mean scores, mean scores of standardized variables, factor loadings, weights that maximize reliability, and equally effective weights on common verbal creative thinking tasks. Both empirical and simulated factor determinacy, as well as Gilmer-Feldt’s composite reliability, were mostly good to excellent (i.e., > .80) across two task types (Alternate Uses and Creative Word Association), eight samples of data, and all weighting approaches. Person-level validity findings were further highly comparable across weighting approaches. Observed nuances and challenges of different weightings and the question of using composites vs. factor scores are thoroughly provided.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44236298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
How a Few Inconsistent Respondents Can Confound the Structure of Personality Survey Data 少数不一致的被调查者如何混淆人格调查数据的结构
IF 2.5 3区 心理学 Pub Date : 2022-07-21 DOI: 10.1027/1015-5759/a000719
V. Arias, Fernando P. Ponce, A. Martínez-Molina
Abstract. In survey data, inconsistent responses due to careless/insufficient effort (C/IE) can lead to problems of replicability and validity. However, data cleaning prior to the main analyses is not yet a standard practice. We investigated the effect of C/IE responses on the structure of personality survey data. For this purpose, we analyzed the structure of the Core-Self Evaluations scale (CSE-S), including the detection of aberrant responses in the study design. While the original theoretical model of the CSE-S assumes that the construct is unidimensional ( Judge et al., 2003 ), recent studies have argued for a multidimensional solution (positive CSE and negative CSE). We hypothesized that this multidimensionality is not substantive but a result of the tendency of C/IE data to generate spurious dimensions. We estimated the confirmatory models before and after removing highly inconsistent response vectors in two independent samples (6% and 4.7%). The analysis of the raw samples clearly favored retaining the two-dimensional model. In contrast, the analysis of the clean datasets suggested the retention of a single factor. A mere 6% C/IE response rate showed enough power to confound the results of the factor analysis. This result suggests that the factor structure of positive and negative CSE factors is spurious, resulting from uncontrolled wording variance produced by a limited proportion of highly inconsistent response vectors. We encourage researchers to include screening for inconsistent responses in their research designs.
摘要在调查数据中,由于粗心/不充分的努力(C/IE)而导致的不一致的回答可能导致可复制性和有效性的问题。然而,在主要分析之前进行数据清理还不是一种标准做法。我们研究了C/IE反应对人格调查数据结构的影响。为此,我们分析了核心自我评价量表(CSE-S)的结构,包括研究设计中异常反应的检测。虽然CSE- s的原始理论模型假设结构是一维的(Judge等人,2003),但最近的研究已经提出了多维的解决方案(积极的CSE和消极的CSE)。我们假设这种多维性不是实质性的,而是C/IE数据产生虚假维度的趋势的结果。我们对两个独立样本(6%和4.7%)去除高度不一致的响应向量前后的验证模型进行了估计。对原始样品的分析显然倾向于保留二维模型。相比之下,对干净数据集的分析表明保留了单一因素。仅6%的C/IE应答率就足以混淆因子分析的结果。这一结果表明,正面和负面CSE因素的因素结构是虚假的,这是由有限比例的高度不一致的响应向量产生的不受控制的措辞方差造成的。我们鼓励研究人员在他们的研究设计中包括对不一致反应的筛选。
{"title":"How a Few Inconsistent Respondents Can Confound the Structure of Personality Survey Data","authors":"V. Arias, Fernando P. Ponce, A. Martínez-Molina","doi":"10.1027/1015-5759/a000719","DOIUrl":"https://doi.org/10.1027/1015-5759/a000719","url":null,"abstract":"Abstract. In survey data, inconsistent responses due to careless/insufficient effort (C/IE) can lead to problems of replicability and validity. However, data cleaning prior to the main analyses is not yet a standard practice. We investigated the effect of C/IE responses on the structure of personality survey data. For this purpose, we analyzed the structure of the Core-Self Evaluations scale (CSE-S), including the detection of aberrant responses in the study design. While the original theoretical model of the CSE-S assumes that the construct is unidimensional ( Judge et al., 2003 ), recent studies have argued for a multidimensional solution (positive CSE and negative CSE). We hypothesized that this multidimensionality is not substantive but a result of the tendency of C/IE data to generate spurious dimensions. We estimated the confirmatory models before and after removing highly inconsistent response vectors in two independent samples (6% and 4.7%). The analysis of the raw samples clearly favored retaining the two-dimensional model. In contrast, the analysis of the clean datasets suggested the retention of a single factor. A mere 6% C/IE response rate showed enough power to confound the results of the factor analysis. This result suggests that the factor structure of positive and negative CSE factors is spurious, resulting from uncontrolled wording variance produced by a limited proportion of highly inconsistent response vectors. We encourage researchers to include screening for inconsistent responses in their research designs.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42402763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Psychometric Properties and Measurement Invariance of a Short Form of the Unified Multidimensional Calling Scale (UMCS) 统一多维召唤量表(UMCS)简表的心理测量性质及测量不变性
IF 2.5 3区 心理学 Pub Date : 2022-07-15 DOI: 10.1027/1015-5759/a000722
Sophie Gerdel, Anna Dalla Rosa, M. Vianello
Abstract. This paper reports on the development of a unidimensional short scale for measuring career calling (UMCS-7). The scale has been developed drawing from the theoretical model behind the Unified Multidimensional Calling Scale (UMCS; Vianello et al., 2018 ), according to which calling is composed of Passion, Prosociality, Purpose, Pervasiveness, Sacrifice, Transcendent Summons, and Identity. The UMCS-7 integrates classical and modern conceptualizations of career calling and can be used when time constraints prevent using the UMCS. The UMCS-7 has been validated in a sample of Italian workers ( N = 1,246) using exploratory and confirmatory factor analysis. A sample of US employees ( N = 165) was used to estimate measurement invariance across languages, establishing the equivalence of factor loadings, all but two intercepts, and all error variances. The UMCS-7 demonstrated nearly perfect convergent validity with the UMCS ( r = .97), excellent internal consistency (αItaly = .86; αUS = .87), and satisfactory concurrent validity with job satisfaction, life satisfaction, and turnover intentions.
摘要本文报道了一种测量职业召唤的单维短量表(UMCS-7)的研制。该量表是根据统一多维呼叫量表(UMCS;Vianello等人,2018),根据该理论,召唤由激情、亲社会性、目的、普遍性、牺牲、超越召唤和身份组成。UMCS-7集成了职业召唤的经典和现代概念,可以在时间限制无法使用UMCS时使用。UMCS-7在意大利工人样本(N = 1,246)中使用探索性和验证性因素分析进行了验证。美国雇员样本(N = 165)被用来估计跨语言的测量不变性,建立因子负荷的等效性,除两个截距外的所有截距,以及所有误差方差。UMCS-7与UMCS具有接近完美的收敛效度(r = 0.97),良好的内部一致性(α -意大利= 0.86;αUS = .87),满意的同时效度与工作满意度、生活满意度和离职意向有关。
{"title":"Psychometric Properties and Measurement Invariance of a Short Form of the Unified Multidimensional Calling Scale (UMCS)","authors":"Sophie Gerdel, Anna Dalla Rosa, M. Vianello","doi":"10.1027/1015-5759/a000722","DOIUrl":"https://doi.org/10.1027/1015-5759/a000722","url":null,"abstract":"Abstract. This paper reports on the development of a unidimensional short scale for measuring career calling (UMCS-7). The scale has been developed drawing from the theoretical model behind the Unified Multidimensional Calling Scale (UMCS; Vianello et al., 2018 ), according to which calling is composed of Passion, Prosociality, Purpose, Pervasiveness, Sacrifice, Transcendent Summons, and Identity. The UMCS-7 integrates classical and modern conceptualizations of career calling and can be used when time constraints prevent using the UMCS. The UMCS-7 has been validated in a sample of Italian workers ( N = 1,246) using exploratory and confirmatory factor analysis. A sample of US employees ( N = 165) was used to estimate measurement invariance across languages, establishing the equivalence of factor loadings, all but two intercepts, and all error variances. The UMCS-7 demonstrated nearly perfect convergent validity with the UMCS ( r = .97), excellent internal consistency (αItaly = .86; αUS = .87), and satisfactory concurrent validity with job satisfaction, life satisfaction, and turnover intentions.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2022-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42552979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
European Journal of Psychological Assessment
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1