Chen Tang,Louis Hickman,Q Chelsea Song,Leo Alexander
Recent evidence suggests that prediction models using item scores, instead of the traditionally used scale scores, can more accurately predict outcomes of interest. However, little is known about the conditions under which item- or scale-level models are more suitable for prediction in organizational practice. To address this gap, we examined several real-world data sets for the presence of valid item nuances (i.e., criterion-valid item-specific variance that is lost when aggregating to scale scores). We then designed and conducted a Monte Carlo simulation based on empirical estimates to investigate the criterion-related validity of item- and scale-level models. In the simulation, we varied (a) the distribution of nuances among items, (b) the effect size of nuances, (c) the effect size of constructs, (d) scale internal consistency, and (e) training sample size. Results suggested that item-level models are recommended when relatively few items in a scale carry nuances, the nuance effect sizes are similar or larger in magnitude to the scale effect sizes, internal consistency is high, and training sample size is large. Our review of prior studies and analyses of real-world data suggest that the conditions favoring item-level models are not uncommon in organizational data. For conditions that do not substantiate the use of either item- or scale-level models, we also examined ensemble models and found that they can be an attractive alternative when the choice is unclear. We provide R code and recommendations for examining valid nuances in one's data and developing item-level, scale-level, and ensemble predictive models. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
最近的证据表明，使用项目分数的预测模型，而不是传统上使用的量表分数，可以更准确地预测感兴趣的结果。然而，在何种条件下项目级模型或规模级模型更适合于组织实践中的预测，人们知之甚少。为了解决这一差距，我们检查了几个真实世界的数据集，看看是否存在有效的项目细微差别（即，在汇总到规模分数时丢失的标准有效的特定项目方差）。在此基础上，我们设计并进行了蒙特卡洛模拟，以考察项目和尺度水平模型的效度。在模拟中，我们改变了(a)项目之间细微差别的分布，(b)细微差别的效应大小，(c)构念的效应大小，(d)量表内部一致性，(e)训练样本量。结果表明，当量表中包含细微差别的项目较少，细微差别效应大小与量表效应大小相似或较大，内部一致性高，训练样本量大时，建议采用项目级模型。我们对以往研究的回顾和对真实世界数据的分析表明，有利于项目级模型的条件在组织数据中并不罕见。对于不能证明使用项目级或比例级模型的条件，我们也检查了集成模型，发现当选择不明确时，它们可能是一个有吸引力的选择。我们提供R代码和建议，用于检查数据中的有效细微差别，并开发项目级，规模级和集成预测模型。（PsycInfo Database Record (c) 2025 APA，版权所有）。
{"title":"When are item nuances useful for prediction in organizations? Comparing the validity of item-level, scale-level, and ensemble machine learning models.","authors":"Chen Tang,Louis Hickman,Q Chelsea Song,Leo Alexander","doi":"10.1037/apl0001339","DOIUrl":"https://doi.org/10.1037/apl0001339","url":null,"abstract":"Recent evidence suggests that prediction models using item scores, instead of the traditionally used scale scores, can more accurately predict outcomes of interest. However, little is known about the conditions under which item- or scale-level models are more suitable for prediction in organizational practice. To address this gap, we examined several real-world data sets for the presence of valid item nuances (i.e., criterion-valid item-specific variance that is lost when aggregating to scale scores). We then designed and conducted a Monte Carlo simulation based on empirical estimates to investigate the criterion-related validity of item- and scale-level models. In the simulation, we varied (a) the distribution of nuances among items, (b) the effect size of nuances, (c) the effect size of constructs, (d) scale internal consistency, and (e) training sample size. Results suggested that item-level models are recommended when relatively few items in a scale carry nuances, the nuance effect sizes are similar or larger in magnitude to the scale effect sizes, internal consistency is high, and training sample size is large. Our review of prior studies and analyses of real-world data suggest that the conditions favoring item-level models are not uncommon in organizational data. For conditions that do not substantiate the use of either item- or scale-level models, we also examined ensemble models and found that they can be an attractive alternative when the choice is unclear. We provide R code and recommendations for examining valid nuances in one's data and developing item-level, scale-level, and ensemble predictive models. (PsycInfo Database Record (c) 2025 APA, all rights reserved).","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"1 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145752761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lawrence Houston,Brett H Neely,Timothy G Kundro,Horatio D Traylor
Securing employment support remains elusive for most formerly incarcerated jobseekers, with the majority still unemployed years after their release-nearly five times the national average in the general population (Melhorn et al., 2024). Research indicates that these difficulties may arise from negative stereotypes about formerly incarcerated individuals' moral character and competence, limiting the job-search assistance they receive from others. Integrating theory and research on criminal stigma and impression formation processes, we suggest that disclosing their criminal history with (vs. without) individuating information about educational accomplishments and work experiences during incarceration can help jobseekers gain job-search assistance. We examine our conceptual model in three complementary studies: a preregistered audit experiment with state legislators (n = 4,894) and two experimental vignette studies (n = 491; n = 493). Our results contribute to the theory on the reputational implications of criminal records, impression management, and employment discrimination. Additionally, our findings have implications for policies and practices intended to promote successful reintegration. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
对于大多数曾经入狱的求职者来说，获得就业支持仍然是难以捉摸的，大多数人在获释后几年仍然失业——几乎是全国平均水平的五倍（Melhorn et al., 2024）。研究表明，这些困难可能源于对曾经被监禁的人的道德品质和能力的负面刻板印象，限制了他们从他人那里获得的求职帮助。结合犯罪污名和印象形成过程的理论和研究，我们建议在监禁期间披露犯罪历史（与不披露）个性化的教育成就和工作经历可以帮助求职者获得求职帮助。我们在三个互补的研究中检验了我们的概念模型：与州立法者进行的预注册审计实验（n = 4,894）和两个实验性小插曲研究（n = 491; n = 493）。我们的研究结果对犯罪记录、印象管理和就业歧视的声誉影响理论有所贡献。此外，我们的研究结果对旨在促进成功重返社会的政策和实践具有启示意义。（PsycInfo Database Record (c) 2025 APA，版权所有）。
{"title":"(Re)Entering the workforce after imprisonment: A new perspective on voluntary disclosure of criminal history and job-search assistance.","authors":"Lawrence Houston,Brett H Neely,Timothy G Kundro,Horatio D Traylor","doi":"10.1037/apl0001338","DOIUrl":"https://doi.org/10.1037/apl0001338","url":null,"abstract":"Securing employment support remains elusive for most formerly incarcerated jobseekers, with the majority still unemployed years after their release-nearly five times the national average in the general population (Melhorn et al., 2024). Research indicates that these difficulties may arise from negative stereotypes about formerly incarcerated individuals' moral character and competence, limiting the job-search assistance they receive from others. Integrating theory and research on criminal stigma and impression formation processes, we suggest that disclosing their criminal history with (vs. without) individuating information about educational accomplishments and work experiences during incarceration can help jobseekers gain job-search assistance. We examine our conceptual model in three complementary studies: a preregistered audit experiment with state legislators (n = 4,894) and two experimental vignette studies (n = 491; n = 493). Our results contribute to the theory on the reputational implications of criminal records, impression management, and employment discrimination. Additionally, our findings have implications for policies and practices intended to promote successful reintegration. (PsycInfo Database Record (c) 2025 APA, all rights reserved).","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"145 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145752756","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for Economic Trajectories of Women: The Relationship Between Abortion and Women’s Salary Growth","authors":"","doi":"10.1037/apl0001348.supp","DOIUrl":"https://doi.org/10.1037/apl0001348.supp","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"31 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145718299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for Stability Matters: A Dynamic Process View on Self-Efficacy in Training Transfer","authors":"","doi":"10.1037/apl0001330.supp","DOIUrl":"https://doi.org/10.1037/apl0001330.supp","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"49 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145718300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for When Are Item Nuances Useful for Prediction in Organizations? Comparing the Validity of Item-Level, Scale-Level, and Ensemble Machine Learning Models","authors":"","doi":"10.1037/apl0001339.supp","DOIUrl":"https://doi.org/10.1037/apl0001339.supp","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"9 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145718301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Laura Rees, Chak Fu Lam, Qiying (Sakura) Du, Andrew Yu, Man-Nok Wong, Hui Xie
{"title":"Exploring the duality of voice habit: Testing and extending theory and measurement.","authors":"Laura Rees, Chak Fu Lam, Qiying (Sakura) Du, Andrew Yu, Man-Nok Wong, Hui Xie","doi":"10.1037/apl0001326","DOIUrl":"https://doi.org/10.1037/apl0001326","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"30 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145703882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michael S. Cole, Nikolaos Dimotakis, Jeremy B. Bernerth
{"title":"Expected and experienced daily justice, emotions, and counterproductive work behavior.","authors":"Michael S. Cole, Nikolaos Dimotakis, Jeremy B. Bernerth","doi":"10.1037/apl0001336","DOIUrl":"https://doi.org/10.1037/apl0001336","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"127 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145703885","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lonwabo Makapela, María del Carmen Triana, Aneika L. Simmons, Orlando C. Richard
{"title":"Hair and Its Ramifications (HAIR): A model describing how hair bias shapes Black women’s work experiences when wearing natural hair.","authors":"Lonwabo Makapela, María del Carmen Triana, Aneika L. Simmons, Orlando C. Richard","doi":"10.1037/apl0001321","DOIUrl":"https://doi.org/10.1037/apl0001321","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"5 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145703886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Travis Howell, David T. Welsh, Bradley E. Hendricks
{"title":"When founders falter: A second-in-command attenuates the effect of founder identification on unethical pro-organizational behavior.","authors":"Travis Howell, David T. Welsh, Bradley E. Hendricks","doi":"10.1037/apl0001342","DOIUrl":"https://doi.org/10.1037/apl0001342","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"29 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145703888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jaee Cho, Michael W. Morris, Hayley Blunden, Jie (Kassie) Li, Jingzhou Pan
{"title":"Thinking like a chameleon: How diversity ideologies differentially enable cultural accommodation.","authors":"Jaee Cho, Michael W. Morris, Hayley Blunden, Jie (Kassie) Li, Jingzhou Pan","doi":"10.1037/apl0001340","DOIUrl":"https://doi.org/10.1037/apl0001340","url":null,"abstract":"","PeriodicalId":15135,"journal":{"name":"Journal of Applied Psychology","volume":"3 1","pages":""},"PeriodicalIF":9.9,"publicationDate":"2025-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145703884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：