Pub Date : 2024-03-25DOI: 10.1027/1015-5759/a000818
U. Schroeders, Maximilian Morgenstern, K. Jankowsky, Timo Gnambs
Abstract: The Need for Cognition Scale (NCS) is a self-report scale measuring individual differences in the tendency to engage in and enjoy thinking. The shortened version with 18 items (NCS-18; Cacioppo et al., 1984 ) has widely been administered in research on persuasion, critical thinking, and educational achievement. Whereas most studies advocated for essential uni-dimensionality, the question remains which psychometric model yields the best representation of the NCS-18. In the present study, we compared six competing measurement models for the NCS-18 with meta-analytic structural equation models using summary data of 87 samples ( N = 90,215). Results demonstrated that the negatively worded items introduced considerable measurement bias that was best accounted for with an acquiescence model. In a further analytical step, we showcased how the pooled correlation matrix can be used to compile short versions of the NCS-18 via Ant Colony Optimization. We examined model fit and reliability of short scales with varying item numbers (between 4 and 15) and a balanced ratio of positively and negatively worded items. We discuss the potentials and limits of the newly proposed method.
{"title":"Short-Scale Construction Using Meta-Analytic Ant Colony Optimization","authors":"U. Schroeders, Maximilian Morgenstern, K. Jankowsky, Timo Gnambs","doi":"10.1027/1015-5759/a000818","DOIUrl":"https://doi.org/10.1027/1015-5759/a000818","url":null,"abstract":"Abstract: The Need for Cognition Scale (NCS) is a self-report scale measuring individual differences in the tendency to engage in and enjoy thinking. The shortened version with 18 items (NCS-18; Cacioppo et al., 1984 ) has widely been administered in research on persuasion, critical thinking, and educational achievement. Whereas most studies advocated for essential uni-dimensionality, the question remains which psychometric model yields the best representation of the NCS-18. In the present study, we compared six competing measurement models for the NCS-18 with meta-analytic structural equation models using summary data of 87 samples ( N = 90,215). Results demonstrated that the negatively worded items introduced considerable measurement bias that was best accounted for with an acquiescence model. In a further analytical step, we showcased how the pooled correlation matrix can be used to compile short versions of the NCS-18 via Ant Colony Optimization. We examined model fit and reliability of short scales with varying item numbers (between 4 and 15) and a balanced ratio of positively and negatively worded items. We discuss the potentials and limits of the newly proposed method.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140382969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-12DOI: 10.1027/1015-5759/a000806
Roman Pauli, Jessica Lang
Abstract: Self-report measures are both frequently used and criticized in studies of job-related stress. The question remains whether affective dispositions lead to biased assessments. In this study, we examine the extent to which survey characteristics are susceptible to bias by the characteristics of the person making the assessment. Participants ( N = 1,509) in an online split ballot experiment were randomly assigned to report their job stressors using a 2 (task vs. person-related items) × 2 (frequency vs. agreement response format) factorial design. Participants high in neuroticism or negative affectivity, but not positive affectivity, reported more job stressors when responding to person-related items compared to task-related items. Individuals high in neuroticism reported more job stressors when assessed with agreement compared to frequency response format. However, the response format did not alter the relationship between self-reported job stressors and positive or negative affectivity. Findings indicate how survey design can reinforce affectivity bias in the assessments of job stressors. If an assessment is intended to evaluate objective circumstances rather than subjective experiences at work (e.g., the presence of general risk factors within psychosocial risk assessment), it is recommended to employ condition-related questionnaires with task-related item wordings and frequency response formats.
{"title":"Survey Design Moderates Negativity Bias but not Positivity Bias in Self-Reported Job Stress","authors":"Roman Pauli, Jessica Lang","doi":"10.1027/1015-5759/a000806","DOIUrl":"https://doi.org/10.1027/1015-5759/a000806","url":null,"abstract":"Abstract: Self-report measures are both frequently used and criticized in studies of job-related stress. The question remains whether affective dispositions lead to biased assessments. In this study, we examine the extent to which survey characteristics are susceptible to bias by the characteristics of the person making the assessment. Participants ( N = 1,509) in an online split ballot experiment were randomly assigned to report their job stressors using a 2 (task vs. person-related items) × 2 (frequency vs. agreement response format) factorial design. Participants high in neuroticism or negative affectivity, but not positive affectivity, reported more job stressors when responding to person-related items compared to task-related items. Individuals high in neuroticism reported more job stressors when assessed with agreement compared to frequency response format. However, the response format did not alter the relationship between self-reported job stressors and positive or negative affectivity. Findings indicate how survey design can reinforce affectivity bias in the assessments of job stressors. If an assessment is intended to evaluate objective circumstances rather than subjective experiences at work (e.g., the presence of general risk factors within psychosocial risk assessment), it is recommended to employ condition-related questionnaires with task-related item wordings and frequency response formats.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139624315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-05DOI: 10.1027/1015-5759/a000817
Steven Bißantz, Susanne Frick, Filip Melinscak, D. Iliescu, Eunike Wetzel
{"title":"The Potential of Machine Learning Methods in Psychological Assessment and Test Construction","authors":"Steven Bißantz, Susanne Frick, Filip Melinscak, D. Iliescu, Eunike Wetzel","doi":"10.1027/1015-5759/a000817","DOIUrl":"https://doi.org/10.1027/1015-5759/a000817","url":null,"abstract":"","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139381301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-13DOI: 10.1027/1015-5759/a000805
Christian Blötner, D. Grüning
Abstract: The use of inverted items is under vigorous debate in psychometric research. However, especially in the field of the Dark Tetrad – a compound of the aversive yet subclinical traits Machiavellianism, narcissism, psychopathy, and sadism –, the use of items in which high endorsement indicates low levels appears promising to obtain more information about low scores on the four traits. In this preregistered research ( N = 500), we developed an alternative version of the Short Dark Tetrad (SD4) which – unlike the original SD4 – has a balanced set of regular and inverted items. Following the theory of utilizing inverted items, we demonstrate that more information (in the sense of item response theory) can be obtained from the newly devised Mixed SD4 (MSD4) as compared to the original SD4. Thereby, the scores of the MSD4 can be validly interpreted in the sense of the underlying traits’ theories (i.e., construct validity), and the SD4 and the MSD4 yield highly similar nomological networks. We conclude that including inverted items is advantageous for the assessment of the Dark Tetrad. More generally, we present this case as a demonstration that balanced item sets are necessary to capture traits and behaviors exhaustively.
{"title":"An Examination of the Role of Inverted Dark Tetrad Items on Structural Properties and Construct Validity","authors":"Christian Blötner, D. Grüning","doi":"10.1027/1015-5759/a000805","DOIUrl":"https://doi.org/10.1027/1015-5759/a000805","url":null,"abstract":"Abstract: The use of inverted items is under vigorous debate in psychometric research. However, especially in the field of the Dark Tetrad – a compound of the aversive yet subclinical traits Machiavellianism, narcissism, psychopathy, and sadism –, the use of items in which high endorsement indicates low levels appears promising to obtain more information about low scores on the four traits. In this preregistered research ( N = 500), we developed an alternative version of the Short Dark Tetrad (SD4) which – unlike the original SD4 – has a balanced set of regular and inverted items. Following the theory of utilizing inverted items, we demonstrate that more information (in the sense of item response theory) can be obtained from the newly devised Mixed SD4 (MSD4) as compared to the original SD4. Thereby, the scores of the MSD4 can be validly interpreted in the sense of the underlying traits’ theories (i.e., construct validity), and the SD4 and the MSD4 yield highly similar nomological networks. We conclude that including inverted items is advantageous for the assessment of the Dark Tetrad. More generally, we present this case as a demonstration that balanced item sets are necessary to capture traits and behaviors exhaustively.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139003644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-12DOI: 10.1027/1015-5759/a000804
Norberth-Ioan Okros, D. Vîrgă
Abstract: The present research aims to evaluate the psychometric properties of the Romanian version of the thriving at work scale (TWS). Three studies were conducted to test the reliability and validity of the TWS. The first study ( N = 451) aimed to adapt and validate the Romanian version of TWS. The confirmatory factor analysis results indicated that the second-order model with 10-items has a good value of the fit indices. The second study ( N = 435) tested measurement invariances, demonstrating that the Romanian version of this scale has varying levels of thriving at work across job tenure and a differential functioning of items 2 and 9 across age. The third study ( N = 312) cross-validated the second-order model. It tested the construct-related validity of TWS with other relevant constructs (job and career satisfaction, burnout, mental health complaints, performance). The results indicated that the TWS is a reliable and valid instrument demonstrating the crucial implications for Romanian working people’s well-being and career development.
{"title":"Evaluating the Psychometric Properties of the Romanian Version of Thriving at Work Scale","authors":"Norberth-Ioan Okros, D. Vîrgă","doi":"10.1027/1015-5759/a000804","DOIUrl":"https://doi.org/10.1027/1015-5759/a000804","url":null,"abstract":"Abstract: The present research aims to evaluate the psychometric properties of the Romanian version of the thriving at work scale (TWS). Three studies were conducted to test the reliability and validity of the TWS. The first study ( N = 451) aimed to adapt and validate the Romanian version of TWS. The confirmatory factor analysis results indicated that the second-order model with 10-items has a good value of the fit indices. The second study ( N = 435) tested measurement invariances, demonstrating that the Romanian version of this scale has varying levels of thriving at work across job tenure and a differential functioning of items 2 and 9 across age. The third study ( N = 312) cross-validated the second-order model. It tested the construct-related validity of TWS with other relevant constructs (job and career satisfaction, burnout, mental health complaints, performance). The results indicated that the TWS is a reliable and valid instrument demonstrating the crucial implications for Romanian working people’s well-being and career development.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139008151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-12DOI: 10.1027/1015-5759/a000814
Doudou Liu, Yiming Wang, Chaoping Li
Abstract: This research aims to develop a 15-item short form of the WOQ (WOQ-SF) and provide evidence for its reliability and validity. In Study 1 ( N = 305), we simplified the WOQ into a short version in line with the scale reduction procedure and recommendations ( Kruyen et al., 2013 ; Stanton et al., 2002 ). The exploratory factor analysis (EFA) reveals that the five factors of the WOQ-SF are conceptually distinct and correlated with each other. In Study 2 ( N = 442), the psychometric properties of the WOQ-SF were investigated. The findings of the confirmatory factor analysis (CFA) confirm a good factor structure. In addition, the measurement invariance of this shortened scale was examined across gender, age, education level, and job tenure. Regarding validity, significant correlations between the WOQ-SF and the original WOQ were found. Furthermore, the WOQ-SF demonstrates relationships with career satisfaction, work engagement, job satisfaction, and career planning, providing evidence for its validity. In sum, the WOQ-SF shows good psychometric properties comparable to the WOQ, suggesting it is a suitable alternative.
{"title":"Development and Validation of the Work Orientation Questionnaire Short-Form (WOQ-SF)","authors":"Doudou Liu, Yiming Wang, Chaoping Li","doi":"10.1027/1015-5759/a000814","DOIUrl":"https://doi.org/10.1027/1015-5759/a000814","url":null,"abstract":"Abstract: This research aims to develop a 15-item short form of the WOQ (WOQ-SF) and provide evidence for its reliability and validity. In Study 1 ( N = 305), we simplified the WOQ into a short version in line with the scale reduction procedure and recommendations ( Kruyen et al., 2013 ; Stanton et al., 2002 ). The exploratory factor analysis (EFA) reveals that the five factors of the WOQ-SF are conceptually distinct and correlated with each other. In Study 2 ( N = 442), the psychometric properties of the WOQ-SF were investigated. The findings of the confirmatory factor analysis (CFA) confirm a good factor structure. In addition, the measurement invariance of this shortened scale was examined across gender, age, education level, and job tenure. Regarding validity, significant correlations between the WOQ-SF and the original WOQ were found. Furthermore, the WOQ-SF demonstrates relationships with career satisfaction, work engagement, job satisfaction, and career planning, providing evidence for its validity. In sum, the WOQ-SF shows good psychometric properties comparable to the WOQ, suggesting it is a suitable alternative.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139008877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-10DOI: 10.1027/1015-5759/a000798
Elisha Johnston, Steven P. Reise, Karen L. Spritzer, Ron D. Hays
Abstract: We conducted a secondary analysis to evaluate two glare items versus a composite score from the two items in a sample of 544 patients (38% women; Mdn = 29 years old; 13% high school education or less) before and after eye surgery. The first question was from a National Eye Institute (NEI) survey and the second question included a definition and picture of glare. At baseline, 28% of participants reported glare on the NEI item versus 39% on the question with the definition and picture. There was 76% agreement between the two questions ( K = .46). Three months after baseline, there was no change in the percentage of participants who reported glare on the NEI question (27%), but a significant decrease in participants reporting glare on the question with the definition and picture (38% at baseline to 25% 3 months later). A 2-item glare scale was more reliable and highly correlated with multi-item measures of halos and starbursts than the individual items. Change in the scale was more strongly associated than the items with the change in satisfaction with vision and with satisfaction with surgery. The scale may provide a better indicator of glare than either item alone.
{"title":"Seeing the Light in Self-Reported Glare","authors":"Elisha Johnston, Steven P. Reise, Karen L. Spritzer, Ron D. Hays","doi":"10.1027/1015-5759/a000798","DOIUrl":"https://doi.org/10.1027/1015-5759/a000798","url":null,"abstract":"Abstract: We conducted a secondary analysis to evaluate two glare items versus a composite score from the two items in a sample of 544 patients (38% women; Mdn = 29 years old; 13% high school education or less) before and after eye surgery. The first question was from a National Eye Institute (NEI) survey and the second question included a definition and picture of glare. At baseline, 28% of participants reported glare on the NEI item versus 39% on the question with the definition and picture. There was 76% agreement between the two questions ( K = .46). Three months after baseline, there was no change in the percentage of participants who reported glare on the NEI question (27%), but a significant decrease in participants reporting glare on the question with the definition and picture (38% at baseline to 25% 3 months later). A 2-item glare scale was more reliable and highly correlated with multi-item measures of halos and starbursts than the individual items. Change in the scale was more strongly associated than the items with the change in satisfaction with vision and with satisfaction with surgery. The scale may provide a better indicator of glare than either item alone.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135136615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-06DOI: 10.1027/1015-5759/a000802
Allyson Dubois, Martin Sellbom, Gina Rossi
Abstract: The Personality Inventory for DSM-5 (PID-5; Krueger et al., 2012 ) is a self-report questionnaire measuring pathological traits of personality disorders. Keeley and colleagues (2016) developed an Inconsistency Scale for the PID-5 (PID-5-INC) to detect random responses. We examined the ability of the PID-5-INC to detect inconsistent responders in a new linguistic context (Dutch) and age group (older adults). The Dutch PID-5 version ( van der Heijden et al., 2014 ) was administered to two Dutch community-dwelling younger (18–64 years old: N = 439) and older adults (65 years or older: N = 251). The PID-5-INC item pairs showed large interitem correlations in the younger adult sample and at least medium interitem correlations, except for one item pair, in the older adult sample. Similarly to Keeley and colleagues , a cut-off score of 17 was the optimal cut-off point for both the younger and older adult samples. However, for the younger adult sample, a cut-off score of 16 provided an even better balance between specificity and sensitivity. We concluded that our results support the use of the PID-5-INC in Dutch-speaking community-dwelling younger and older adults and point out the importance of including validity scales for self-report questionnaires.
摘要:DSM-5人格量表(PID-5);Krueger et al., 2012)是一种测量人格障碍病理特征的自我报告问卷。Keeley及其同事(2016)为PID-5 (PID-5- inc)开发了一种不一致量表来检测随机反应。我们检测了PID-5-INC在新的语言背景(荷兰语)和年龄组(老年人)中检测不一致应答者的能力。荷兰PID-5版本(van der Heijden et al., 2014)对两名居住在荷兰社区的年轻人(18-64岁:N = 439)和老年人(65岁及以上:N = 251)进行了研究。在年轻人样本中,PID-5-INC项目对显示出较大的项目间相关性,而在老年人样本中,除了一个项目对外,至少显示出中等的项目间相关性。与基利和他的同事类似,17分是年轻人和老年人样本的最佳分界点。然而,对于较年轻的成人样本,16分的临界值在特异性和敏感性之间提供了更好的平衡。我们的结论是,我们的结果支持在讲荷兰语的社区居住的年轻人和老年人中使用PID-5-INC,并指出在自我报告问卷中加入效度量表的重要性。
{"title":"Validity of an Inconsistency Scale for the PID-5 in Community-Dwelling Younger and Older Adults","authors":"Allyson Dubois, Martin Sellbom, Gina Rossi","doi":"10.1027/1015-5759/a000802","DOIUrl":"https://doi.org/10.1027/1015-5759/a000802","url":null,"abstract":"Abstract: The Personality Inventory for DSM-5 (PID-5; Krueger et al., 2012 ) is a self-report questionnaire measuring pathological traits of personality disorders. Keeley and colleagues (2016) developed an Inconsistency Scale for the PID-5 (PID-5-INC) to detect random responses. We examined the ability of the PID-5-INC to detect inconsistent responders in a new linguistic context (Dutch) and age group (older adults). The Dutch PID-5 version ( van der Heijden et al., 2014 ) was administered to two Dutch community-dwelling younger (18–64 years old: N = 439) and older adults (65 years or older: N = 251). The PID-5-INC item pairs showed large interitem correlations in the younger adult sample and at least medium interitem correlations, except for one item pair, in the older adult sample. Similarly to Keeley and colleagues , a cut-off score of 17 was the optimal cut-off point for both the younger and older adult samples. However, for the younger adult sample, a cut-off score of 16 provided an even better balance between specificity and sensitivity. We concluded that our results support the use of the PID-5-INC in Dutch-speaking community-dwelling younger and older adults and point out the importance of including validity scales for self-report questionnaires.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135637092","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-06DOI: 10.1027/1015-5759/a000801
Philipp Geisen, Friedemann Trutzenberg, Michael Eid
Abstract: To address the complexity of global challenges (e.g., migration, climate change), research must examine many constructs and their interrelationships. Therefore, efficient assessment methods (e.g., short scales) are required, especially when constructing large-scale social surveys. A widely used instrument for assessing global identification as an important predictor of behavior related to coping with global challenges is the Identification With All Humanity (IWAH) scale ( McFarland et al., 2012 ). With the present study, we aimed to investigate whether this scale can be sufficiently represented by a single item. Using bifactor-(S*I − 1) models, we analyzed whether one item from the scale itself (Item 5) and a related single-item measure from the World Values Survey (WVS; Inglehart et al., 2018 ) could adequately represent a German version of the IWAH scale. The sample ( n = 1,369) was representative of the German population regarding age, gender, income, education, and region of residence. Item 5 showed an appropriate single-item reliability (.82) and represented 64–93% of the true variance in the individual IWAH items, whereas the WVS item (Rel( Y WVS ) = .61) represented 52–81%. To reflect the multidimensionality of the IWAH, a 4-item short scale is recommended.
摘要:为了解决全球挑战的复杂性(如移民、气候变化),研究必须考察许多结构及其相互关系。因此,需要有效的评估方法(如短量表),特别是在构建大规模社会调查时。作为应对全球挑战相关行为的重要预测因素,广泛使用的评估全球认同的工具是全人类认同(IWAH)量表(McFarland et al., 2012)。在本研究中,我们的目的是调查这个量表是否可以充分地代表一个单一的项目。使用双因子-(S*I−1)模型,我们分析了来自量表本身的一个项目(项目5)和来自世界价值观调查(WVS;Inglehart等人,2018)可以充分代表德国版的IWAH量表。样本(n = 1369)在年龄、性别、收入、教育程度和居住地区方面代表了德国人口。项目5显示出适当的单项信度(.82),代表了IWAH单项真实方差的64-93%,而WVS项目(Rel(Y WVS) = .61)代表了52-81%。为了反映IWAH的多维度,建议使用4项短量表。
{"title":"Efficient Measurement of Global Human Identification and Citizenship – Is One Item Sufficient?","authors":"Philipp Geisen, Friedemann Trutzenberg, Michael Eid","doi":"10.1027/1015-5759/a000801","DOIUrl":"https://doi.org/10.1027/1015-5759/a000801","url":null,"abstract":"Abstract: To address the complexity of global challenges (e.g., migration, climate change), research must examine many constructs and their interrelationships. Therefore, efficient assessment methods (e.g., short scales) are required, especially when constructing large-scale social surveys. A widely used instrument for assessing global identification as an important predictor of behavior related to coping with global challenges is the Identification With All Humanity (IWAH) scale ( McFarland et al., 2012 ). With the present study, we aimed to investigate whether this scale can be sufficiently represented by a single item. Using bifactor-(S*I − 1) models, we analyzed whether one item from the scale itself (Item 5) and a related single-item measure from the World Values Survey (WVS; Inglehart et al., 2018 ) could adequately represent a German version of the IWAH scale. The sample ( n = 1,369) was representative of the German population regarding age, gender, income, education, and region of residence. Item 5 showed an appropriate single-item reliability (.82) and represented 64–93% of the true variance in the individual IWAH items, whereas the WVS item (Rel( Y WVS ) = .61) represented 52–81%. To reflect the multidimensionality of the IWAH, a 4-item short scale is recommended.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135635840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-06DOI: 10.1027/1015-5759/a000799
Alina N. Stamate, Pascale L. Denis
Abstract: This study aimed was to develop and validate a new instrument called the Work Preferences Questionnaire (WPQ) to measure individuals’ preferences for work characteristics that are relevant to today’s work environment. A multi-step approach and two samples were used to develop and validate the WPQ across various industries. In the first study, a group of experts developed a bank of items that were then administered to 984 workers. Exploratory factor analysis revealed a nine-factor structure with good internal consistency. In the second study, an independent sample of 687 workers was used to confirm the factorial structure and highlight the distinctness of the work preference dimensions. The study found small mean differences in interindividual preference scores based on age and confirmed data equivalence between gender and education level. The WPQ addresses limitations of existing measures by focusing on a narrow set of work preferences that are highly relevant in the current work environment and includes modern aspects such as teleworking and work-life balance. The WPQ promises to be an effective tool for research and human resources practices, enabling individuals and organizations to better understand work preferences and make informed decisions about work design and personnel selection.
{"title":"Exploring the Validity of the Work Preferences Questionnaire","authors":"Alina N. Stamate, Pascale L. Denis","doi":"10.1027/1015-5759/a000799","DOIUrl":"https://doi.org/10.1027/1015-5759/a000799","url":null,"abstract":"Abstract: This study aimed was to develop and validate a new instrument called the Work Preferences Questionnaire (WPQ) to measure individuals’ preferences for work characteristics that are relevant to today’s work environment. A multi-step approach and two samples were used to develop and validate the WPQ across various industries. In the first study, a group of experts developed a bank of items that were then administered to 984 workers. Exploratory factor analysis revealed a nine-factor structure with good internal consistency. In the second study, an independent sample of 687 workers was used to confirm the factorial structure and highlight the distinctness of the work preference dimensions. The study found small mean differences in interindividual preference scores based on age and confirmed data equivalence between gender and education level. The WPQ addresses limitations of existing measures by focusing on a narrow set of work preferences that are highly relevant in the current work environment and includes modern aspects such as teleworking and work-life balance. The WPQ promises to be an effective tool for research and human resources practices, enabling individuals and organizations to better understand work preferences and make informed decisions about work design and personnel selection.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135636048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}