Denise C Cooper, Marjorie S Campbell, Spencer R Case, Melissa C Fraine, Rebecca A Jones, Ilene F Klein, Tim Hoyt
{"title":"用于评估作战和作战压力的方案和干预措施的结果指标:心理测量学性质的回顾","authors":"Denise C Cooper, Marjorie S Campbell, Spencer R Case, Melissa C Fraine, Rebecca A Jones, Ilene F Klein, Tim Hoyt","doi":"10.1080/08995605.2022.2117537","DOIUrl":null,"url":null,"abstract":"<p><p>The Department of Defense has mandated combat and operational stress control (COSC) efforts for the Services since 1999. Although several COSC-related programs have been implemented, few have undergone evaluation, and no standardized metrics have been established to assess their effectiveness and utility. The purpose of this review was to characterize the content and psychometrics of measures that have been utilized as outcome metrics in evaluations of COSC-related programs and interventions. Systematic literature searches were conducted for publications that: a) evaluated at least one measure from U.S. service members who participated in a program or intervention to prevent or reduce the adverse effects of combat and operational stress; and b) reported U.S. data on the internal consistency, test-retest reliability, convergent validity, and sensitivity/specificity of the identified measures. This process identified 15 measures for which psychometric properties were reviewed for acceptability based on recommended criteria. Identified measures varied from well-validated measures to newer instruments for which more data is needed on one or more of the target psychometric properties. Aside from internal consistency, psychometric data from U.S. military samples were sparse. Results further suggested that some measures might have reduced sensitivity in service members under certain conditions, such as large-scale screening. Additional studies are needed to validate COSC-relevant measures in service members. Future evaluations of programs and interventions for combat and operational stress should select measures that will increase the consistency of the literature, allow comparisons across studies, and ensure alignment with the objectives of identified programs.</p>","PeriodicalId":18696,"journal":{"name":"Military Psychology","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10880499/pdf/","citationCount":"0","resultStr":"{\"title\":\"Outcome metrics utilized in evaluations of programs and interventions for combat and operational stress: A review of psychometric properties.\",\"authors\":\"Denise C Cooper, Marjorie S Campbell, Spencer R Case, Melissa C Fraine, Rebecca A Jones, Ilene F Klein, Tim Hoyt\",\"doi\":\"10.1080/08995605.2022.2117537\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The Department of Defense has mandated combat and operational stress control (COSC) efforts for the Services since 1999. Although several COSC-related programs have been implemented, few have undergone evaluation, and no standardized metrics have been established to assess their effectiveness and utility. The purpose of this review was to characterize the content and psychometrics of measures that have been utilized as outcome metrics in evaluations of COSC-related programs and interventions. Systematic literature searches were conducted for publications that: a) evaluated at least one measure from U.S. service members who participated in a program or intervention to prevent or reduce the adverse effects of combat and operational stress; and b) reported U.S. data on the internal consistency, test-retest reliability, convergent validity, and sensitivity/specificity of the identified measures. This process identified 15 measures for which psychometric properties were reviewed for acceptability based on recommended criteria. Identified measures varied from well-validated measures to newer instruments for which more data is needed on one or more of the target psychometric properties. Aside from internal consistency, psychometric data from U.S. military samples were sparse. Results further suggested that some measures might have reduced sensitivity in service members under certain conditions, such as large-scale screening. Additional studies are needed to validate COSC-relevant measures in service members. Future evaluations of programs and interventions for combat and operational stress should select measures that will increase the consistency of the literature, allow comparisons across studies, and ensure alignment with the objectives of identified programs.</p>\",\"PeriodicalId\":18696,\"journal\":{\"name\":\"Military Psychology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2024-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10880499/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Military Psychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1080/08995605.2022.2117537\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2022/8/29 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"PSYCHOLOGY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Military Psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/08995605.2022.2117537","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/8/29 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
Outcome metrics utilized in evaluations of programs and interventions for combat and operational stress: A review of psychometric properties.
The Department of Defense has mandated combat and operational stress control (COSC) efforts for the Services since 1999. Although several COSC-related programs have been implemented, few have undergone evaluation, and no standardized metrics have been established to assess their effectiveness and utility. The purpose of this review was to characterize the content and psychometrics of measures that have been utilized as outcome metrics in evaluations of COSC-related programs and interventions. Systematic literature searches were conducted for publications that: a) evaluated at least one measure from U.S. service members who participated in a program or intervention to prevent or reduce the adverse effects of combat and operational stress; and b) reported U.S. data on the internal consistency, test-retest reliability, convergent validity, and sensitivity/specificity of the identified measures. This process identified 15 measures for which psychometric properties were reviewed for acceptability based on recommended criteria. Identified measures varied from well-validated measures to newer instruments for which more data is needed on one or more of the target psychometric properties. Aside from internal consistency, psychometric data from U.S. military samples were sparse. Results further suggested that some measures might have reduced sensitivity in service members under certain conditions, such as large-scale screening. Additional studies are needed to validate COSC-relevant measures in service members. Future evaluations of programs and interventions for combat and operational stress should select measures that will increase the consistency of the literature, allow comparisons across studies, and ensure alignment with the objectives of identified programs.
期刊介绍:
Military Psychology is the quarterly journal of Division 19 (Society for Military Psychology) of the American Psychological Association. The journal seeks to facilitate the scientific development of military psychology by encouraging communication between researchers and practitioners. The domain of military psychology is the conduct of research or practice of psychological principles within a military environment. The journal publishes behavioral science research articles having military applications in the areas of clinical and health psychology, training and human factors, manpower and personnel, social and organizational systems, and testing and measurement.