Pub Date : 2023-12-01Epub Date: 2023-07-13DOI: 10.1177/01632787231186621
Tomás Caycho-Rodríguez, José M Tomás, Daniel E Yupanqui-Lorenzo, Pablo D Valencia, Carlos Carbajal-León, Lindsey W Vilca, José Ventura-León, Rubí Paredes-Angeles, Walter L Arias Gallegos, Mario Reyes-Bossio, Mariel Delgado-Campusano, Miguel Gallegos, Claudio Rojas-Jara, Roberto Polanco-Carrasco, Mauricio Cervigni, Pablo Martino, Marlon Elías Lobos-Rivera, Rodrigo Moreta-Herrera, Diego Alejandro Palacios Segura, Antonio Samaniego-Pinho, Andrés Buschiazzo Figares, Diana Ximena Puerta-Cortés, Andrés Camargo, Julio Torales, J Arkangel Monge Blanco, Pedronel González, Vanessa Smith-Castro, Olimpia Petzold-Rodriguez, Ibraín Enrique Corrales-Reyes, Raymundo Calderón, Wendy Yamilet Matute Rivera, Daniela Ferrufino-Borja, Paula Ceballos-Vásquez, Agueda Muñoz-Del-Carpio-Toia, Jorge Palacios, Carmen Burgos-Videla, Ana María Eduviges Florez León, Ibeth Vergara, Diego Vega, Marion K Shulmeyer, Nicol A Barria-Asenjo, Hassell Tatiana Urrutia Rios, Arelly Esther Lira Lira
The present study explored the predictive capacity of fear of COVID-19 on the intention to be vaccinated against COVID-19 and the influence in this relationship of conspiracy beliefs as a possible mediating psychological variable, in 13 Latin American countries. A total of 5779 people recruited through non-probabilistic convenience sampling participated. To collect information, we used the Fear of COVID-19 Scale, Vaccine conspiracy beliefs Scale-COVID-19 and a single item of intention to vaccinate. A full a priori Structural Equation Model was used; whereas, cross-country invariance was performed from increasingly restricted structural models. The results indicated that, fear of COVID-19 positively predicts intention to vaccinate and the presence of conspiracy beliefs about COVID-19 vaccines. The latter negatively predicted intention to vaccinate against COVID-19. Besides, conspiracy beliefs about COVID-19 vaccines had an indirect effect on the relationship between fear of COVID-19 and intention to vaccinate against COVID-19 in the 13 countries assessed. Finally, the cross-national similarities of the mediational model among the 13 participating countries are strongly supported. The study is the first to test a cross-national mediational model across variables in a large number of Latin American countries. However, further studies with other countries in other regions of the world are needed.
{"title":"Relationship Between Fear of COVID-19, Conspiracy Beliefs About Vaccines and Intention to Vaccinate Against COVID-19: A Cross-National Indirect Effect Model in 13 Latin American Countries.","authors":"Tomás Caycho-Rodríguez, José M Tomás, Daniel E Yupanqui-Lorenzo, Pablo D Valencia, Carlos Carbajal-León, Lindsey W Vilca, José Ventura-León, Rubí Paredes-Angeles, Walter L Arias Gallegos, Mario Reyes-Bossio, Mariel Delgado-Campusano, Miguel Gallegos, Claudio Rojas-Jara, Roberto Polanco-Carrasco, Mauricio Cervigni, Pablo Martino, Marlon Elías Lobos-Rivera, Rodrigo Moreta-Herrera, Diego Alejandro Palacios Segura, Antonio Samaniego-Pinho, Andrés Buschiazzo Figares, Diana Ximena Puerta-Cortés, Andrés Camargo, Julio Torales, J Arkangel Monge Blanco, Pedronel González, Vanessa Smith-Castro, Olimpia Petzold-Rodriguez, Ibraín Enrique Corrales-Reyes, Raymundo Calderón, Wendy Yamilet Matute Rivera, Daniela Ferrufino-Borja, Paula Ceballos-Vásquez, Agueda Muñoz-Del-Carpio-Toia, Jorge Palacios, Carmen Burgos-Videla, Ana María Eduviges Florez León, Ibeth Vergara, Diego Vega, Marion K Shulmeyer, Nicol A Barria-Asenjo, Hassell Tatiana Urrutia Rios, Arelly Esther Lira Lira","doi":"10.1177/01632787231186621","DOIUrl":"10.1177/01632787231186621","url":null,"abstract":"<p><p>The present study explored the predictive capacity of fear of COVID-19 on the intention to be vaccinated against COVID-19 and the influence in this relationship of conspiracy beliefs as a possible mediating psychological variable, in 13 Latin American countries. A total of 5779 people recruited through non-probabilistic convenience sampling participated. To collect information, we used the Fear of COVID-19 Scale, Vaccine conspiracy beliefs Scale-COVID-19 and a single item of intention to vaccinate. A full a priori Structural Equation Model was used; whereas, cross-country invariance was performed from increasingly restricted structural models. The results indicated that, fear of COVID-19 positively predicts intention to vaccinate and the presence of conspiracy beliefs about COVID-19 vaccines. The latter negatively predicted intention to vaccinate against COVID-19. Besides, conspiracy beliefs about COVID-19 vaccines had an indirect effect on the relationship between fear of COVID-19 and intention to vaccinate against COVID-19 in the 13 countries assessed. Finally, the cross-national similarities of the mediational model among the 13 participating countries are strongly supported. The study is the first to test a cross-national mediational model across variables in a large number of Latin American countries. However, further studies with other countries in other regions of the world are needed.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"371-383"},"PeriodicalIF":2.2,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10345832/pdf/10.1177_01632787231186621.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9836640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-01Epub Date: 2022-11-14DOI: 10.1177/01632787221139244
Brandon K Attell, Kate Kingery, Tanisa Adimu, John Butts, Paul Howard, Somava Saha, Karen Minyard
Multi-sector partnerships are core in efforts to improve population health but are often not as fully developed or positioned to advance health and equity in their communities as believed to be. Therefore, measuring the collaborations multi-sector partnerships undertake is important to document the inputs, processes, and outcomes that evolve as they work together towards achieving their goals, which ultimately creates a greater sense of shared accountability. In this study we present the development and validation of the Assessment for Advancing Community Transformation (AACT), a new tool designed to measure readiness to advance health and health equity. Development of the AACT included initial item pool creation, external evaluation from five subject matter experts, and pilot testing (including user feedback surveys) among 103 individuals. Validation of the AACT was performed using a series of confirmatory factor analyses on an expanded dataset representing 352 individuals from 49 multi-sector collaboratives across the United States. The results of our study indicate the items in the AACT align to six domains created during the scale development process, and that the tool demonstrates desirable measurement characteristics for use in research, evaluation, and practice.
{"title":"Development and Validation of a Measure to Assess Readiness to Advance Health and Equity: The Assessment for Advancing Community Transformation (AACT).","authors":"Brandon K Attell, Kate Kingery, Tanisa Adimu, John Butts, Paul Howard, Somava Saha, Karen Minyard","doi":"10.1177/01632787221139244","DOIUrl":"10.1177/01632787221139244","url":null,"abstract":"<p><p>Multi-sector partnerships are core in efforts to improve population health but are often not as fully developed or positioned to advance health and equity in their communities as believed to be. Therefore, measuring the collaborations multi-sector partnerships undertake is important to document the inputs, processes, and outcomes that evolve as they work together towards achieving their goals, which ultimately creates a greater sense of shared accountability. In this study we present the development and validation of the Assessment for Advancing Community Transformation (AACT), a new tool designed to measure readiness to advance health and health equity. Development of the AACT included initial item pool creation, external evaluation from five subject matter experts, and pilot testing (including user feedback surveys) among 103 individuals. Validation of the AACT was performed using a series of confirmatory factor analyses on an expanded dataset representing 352 individuals from 49 multi-sector collaboratives across the United States. The results of our study indicate the items in the AACT align to six domains created during the scale development process, and that the tool demonstrates desirable measurement characteristics for use in research, evaluation, and practice.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"309-319"},"PeriodicalIF":2.9,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10637080/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10367172","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-01Epub Date: 2023-04-08DOI: 10.1177/01632787231167942
Judy A Kimberly, Stephen Kogut, John F Stevenson, Jacquelyn Fede, Anthony R Hayward, Meghan E Tenca
The Tracking and Evaluation Core of Rhode Island Advance-CTR conducted an online needs assessment survey at the program's inception in 2016 and again in 2021. Now dealing with well-established support systems provided by the grant, we were particularly interested in how the perceived needs of the research community in Rhode Island might have changed over five years. Specifically, what barriers have been reduced or eliminated and which have persisted or increased? How do those barriers vary by demographic status and what implications do those differences have for the CTR? An online survey was completed by 199 researchers, who reported the extent to which they perceived the lack of access to a range of research supports as a barrier to conducting research at their institution. Overall, researchers indicated statistically significant changes from 2016 to 2021 such that a lack of pilot project funding and proposal development support had decreased as barriers, while space for research, and advice on commercial development, had increased. Statistically significant differences in the salience of particular barriers by some demographic variables were also noted and the results of this study suggest Centers for Clinical and Translational Research can have salutary effects on the research paradigm within their partnering institutions in a relatively short time.
{"title":"Researcher Views of Barriers to Clinical and Translational Research in a Statewide Program.","authors":"Judy A Kimberly, Stephen Kogut, John F Stevenson, Jacquelyn Fede, Anthony R Hayward, Meghan E Tenca","doi":"10.1177/01632787231167942","DOIUrl":"10.1177/01632787231167942","url":null,"abstract":"<p><p>The Tracking and Evaluation Core of Rhode Island Advance-CTR conducted an online needs assessment survey at the program's inception in 2016 and again in 2021. Now dealing with well-established support systems provided by the grant, we were particularly interested in how the perceived needs of the research community in Rhode Island might have changed over five years. Specifically, what barriers have been reduced or eliminated and which have persisted or increased? How do those barriers vary by demographic status and what implications do those differences have for the CTR? An online survey was completed by 199 researchers, who reported the extent to which they perceived the lack of access to a range of research supports as a barrier to conducting research at their institution. Overall, researchers indicated statistically significant changes from 2016 to 2021 such that a lack of <i>pilot project funding</i> and <i>proposal development support</i> had decreased as barriers, while <i>space for research</i>, and <i>advice on commercial development</i>, had increased. Statistically significant differences in the salience of particular barriers by some demographic variables were also noted and the results of this study suggest Centers for Clinical and Translational Research can have salutary effects on the research paradigm within their partnering institutions in a relatively short time.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"344-352"},"PeriodicalIF":2.2,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10560312/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9614768","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-01Epub Date: 2023-08-16DOI: 10.1177/01632787231195077
Sérgio Moreira, Sofia Oliveira, Jorge Vala, Rui Costa-Lopes, Alexandra Marques-Pinto
Job demands and resources have been consistently associated with the burnout syndrome in physicians, however the literature points to a lack of robust measures to assess these job characteristics across various medical specialties. This study aimed to develop a theoretically and empirically grounded physician-specific job demands and resources self-report measure - the Physicians' Job Demands and Resources Scale. Relevant dimensions of physicians' job demands and resources were identified, corresponding measurement items were generated and pre-tested, and the factor structure of the resulting 44 items was tested with a sample of 9,176 Portuguese physicians. The results of EFAs and CFAs with two random split samples provided consistent evidence of a nine-factor structure with 38 of the 44 items. Importantly, the nine-factor structure is consistent with the dimensions identified in the literature. The paper discusses the theoretical and practical impacts of the scale.
{"title":"Psychometric Assessment of the Physicians' Job Demands and Resources Scale.","authors":"Sérgio Moreira, Sofia Oliveira, Jorge Vala, Rui Costa-Lopes, Alexandra Marques-Pinto","doi":"10.1177/01632787231195077","DOIUrl":"10.1177/01632787231195077","url":null,"abstract":"<p><p>Job demands and resources have been consistently associated with the burnout syndrome in physicians, however the literature points to a lack of robust measures to assess these job characteristics across various medical specialties. This study aimed to develop a theoretically and empirically grounded physician-specific job demands and resources self-report measure - the <i>Physicians' Job Demands and Resources Scale</i>. Relevant dimensions of physicians' job demands and resources were identified, corresponding measurement items were generated and pre-tested, and the factor structure of the resulting 44 items was tested with a sample of 9,176 Portuguese physicians. The results of EFAs and CFAs with two random split samples provided consistent evidence of a nine-factor structure with 38 of the 44 items. Importantly, the nine-factor structure is consistent with the dimensions identified in the literature. The paper discusses the theoretical and practical impacts of the scale.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"384-395"},"PeriodicalIF":2.9,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10637071/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10011755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-13DOI: 10.1177/01632787231212462
George W. Joe, Wayne E. K. Lehman, Yang Yang, Kevin Knight
Sample attrition is a confounding issue in the analysis of data collected in follow-up studies. The present study uses a regression procedure that includes a propensity score as a predictor in estimating imputed data. The utility of the procedure was addressed by comparing results from this augmented data with those from the original data. Data were from a randomized controlled study testing the utility of a tablet-based intervention designed to improve decision-making with respect to health risk behaviors. Outcomes included self-reported testing for HIV, STD, and hepatitis. Two samples were used (163 in community facilities and 348 in residential facilities). Seventy-eight in the community sample and 238 in the residential sample completed follow-up surveys. Propensity scores based on a stepwise logistic regression were used to make the calibration sample and the missing data sample as close as possible. Multilevel analysis was performed for each outcome and multiple imputation compared estimated mean differences for the augmented and original analyses. The model imputing missing data was effective for the three outcomes and increased power. Least square mean differences between augmented and original data appeared to be essentially the same for most of the outcomes. This protocol has been registered with https://www.clinicaltrials.gov/(NCT02777086).
{"title":"The Effectiveness of the <i>StaySafe</i> Intervention Using a Paradigm for Predicting Missing Outcome Data","authors":"George W. Joe, Wayne E. K. Lehman, Yang Yang, Kevin Knight","doi":"10.1177/01632787231212462","DOIUrl":"https://doi.org/10.1177/01632787231212462","url":null,"abstract":"Sample attrition is a confounding issue in the analysis of data collected in follow-up studies. The present study uses a regression procedure that includes a propensity score as a predictor in estimating imputed data. The utility of the procedure was addressed by comparing results from this augmented data with those from the original data. Data were from a randomized controlled study testing the utility of a tablet-based intervention designed to improve decision-making with respect to health risk behaviors. Outcomes included self-reported testing for HIV, STD, and hepatitis. Two samples were used (163 in community facilities and 348 in residential facilities). Seventy-eight in the community sample and 238 in the residential sample completed follow-up surveys. Propensity scores based on a stepwise logistic regression were used to make the calibration sample and the missing data sample as close as possible. Multilevel analysis was performed for each outcome and multiple imputation compared estimated mean differences for the augmented and original analyses. The model imputing missing data was effective for the three outcomes and increased power. Least square mean differences between augmented and original data appeared to be essentially the same for most of the outcomes. This protocol has been registered with https://www.clinicaltrials.gov/(NCT02777086).","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"53 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136348896","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/01632787231164377
Nihal Beklemis, Arzu K Harmanci Seren, Brad Gilbreath
Presenteeism occurs when workers are present at work but with diminished work capacity due to illness, stress, or other causes. Recent studies report that nursing is one of the leading professional groups experiencing presenteeism. Although studies of illness-related presenteeism predominate, fewer studies have investigated stress-related presenteeism. Nurses in Turkey are particularly vulnerable to stress-related presenteeism because of the country's low nurse-to-patient ratio. A scale for measuring presenteeism from job stress - the Job-Stress-Related-Presenteeism Scale-has been developed but not validated. This study had two objectives: to adapt the Job-Stress-Related-Presenteeism Scale to Turkish to use in measuring of presenteeism from job stress among nurses; and to assess the scale's validity. We conducted a cross-sectional study to test the content validity, construct validity, reliability, and stability of a Turkish version of the Job-Stress-Related Presenteeism Scale on a sample of 261 nurses. The content validity index of the Job-Stress-Related Presenteeism Scale was .65. Item-total score correlation values varied between .44 and .77. The confirmatory factor analyses confirmed the six-item, one-factor construct. The Cronbach's alpha internal consistency coefficient was .86. Results indicated that our adapted version of the Job-Stress-Related Presenteeism Scale is valid and suitable for use in Turkey.
{"title":"Psychometrics of Job Stress-Related Presenteeism Scale among Turkish Nurses.","authors":"Nihal Beklemis, Arzu K Harmanci Seren, Brad Gilbreath","doi":"10.1177/01632787231164377","DOIUrl":"https://doi.org/10.1177/01632787231164377","url":null,"abstract":"<p><p>Presenteeism occurs when workers are present at work but with diminished work capacity due to illness, stress, or other causes. Recent studies report that nursing is one of the leading professional groups experiencing presenteeism. Although studies of illness-related presenteeism predominate, fewer studies have investigated stress-related presenteeism. Nurses in Turkey are particularly vulnerable to stress-related presenteeism because of the country's low nurse-to-patient ratio. A scale for measuring presenteeism from job stress - the Job-Stress-Related-Presenteeism Scale-has been developed but not validated. This study had two objectives: to adapt the Job-Stress-Related-Presenteeism Scale to Turkish to use in measuring of presenteeism from job stress among nurses; and to assess the scale's validity. We conducted a cross-sectional study to test the content validity, construct validity, reliability, and stability of a Turkish version of the Job-Stress-Related Presenteeism Scale on a sample of 261 nurses. The content validity index of the Job-Stress-Related Presenteeism Scale was .65. Item-total score correlation values varied between .44 and .77. The confirmatory factor analyses confirmed the six-item, one-factor construct. The Cronbach's alpha internal consistency coefficient was .86. Results indicated that our adapted version of the Job-Stress-Related Presenteeism Scale is valid and suitable for use in Turkey.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"46 3","pages":"270-276"},"PeriodicalIF":2.9,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10074546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/01632787231158128
Janae K Heath, Caitlin B Clancy, William Pluta, Gary E Weissman, Ursula Anderson, Jennifer R Kogan, C Jessica Dine, Judy A Shea
Unprofessional faculty behaviors negatively impact the well-being of trainees yet are infrequently reported through established reporting systems. Manual review of narrative faculty evaluations provides an additional avenue for identifying unprofessional behavior but is time- and resource-intensive, and therefore of limited value for identifying and remediating faculty with professionalism concerns. Natural language processing (NLP) techniques may provide a mechanism for streamlining manual review processes to identify faculty professionalism lapses. In this retrospective cohort study of 15,432 narrative evaluations of medical faculty by medical trainees, we identified professionalism lapses using automated analysis of the text of faculty evaluations. We used multiple NLP approaches to develop and validate several classification models, which were evaluated primarily based on the positive predictive value (PPV) and secondarily by their calibration. A NLP-model using sentiment analysis (quantifying subjectivity of the text) in combination with key words (using the ensemble technique) had the best performance overall with a PPV of 49% (CI 38%-59%). These findings highlight how NLP can be used to screen narrative evaluations of faculty to identify unprofessional faculty behaviors. Incorporation of NLP into faculty review workflows enables a more focused manual review of comments, providing a supplemental mechanism to identify faculty professionalism lapses.
{"title":"Natural Language Processing of Learners' Evaluations of Attendings to Identify Professionalism Lapses.","authors":"Janae K Heath, Caitlin B Clancy, William Pluta, Gary E Weissman, Ursula Anderson, Jennifer R Kogan, C Jessica Dine, Judy A Shea","doi":"10.1177/01632787231158128","DOIUrl":"https://doi.org/10.1177/01632787231158128","url":null,"abstract":"<p><p>Unprofessional faculty behaviors negatively impact the well-being of trainees yet are infrequently reported through established reporting systems. Manual review of narrative faculty evaluations provides an additional avenue for identifying unprofessional behavior but is time- and resource-intensive, and therefore of limited value for identifying and remediating faculty with professionalism concerns. Natural language processing (NLP) techniques may provide a mechanism for streamlining manual review processes to identify faculty professionalism lapses. In this retrospective cohort study of 15,432 narrative evaluations of medical faculty by medical trainees, we identified professionalism lapses using automated analysis of the text of faculty evaluations. We used multiple NLP approaches to develop and validate several classification models, which were evaluated primarily based on the positive predictive value (PPV) and secondarily by their calibration. A NLP-model using sentiment analysis (quantifying subjectivity of the text) in combination with key words (using the ensemble technique) had the best performance overall with a PPV of 49% (CI 38%-59%). These findings highlight how NLP can be used to screen narrative evaluations of faculty to identify unprofessional faculty behaviors. Incorporation of NLP into faculty review workflows enables a more focused manual review of comments, providing a supplemental mechanism to identify faculty professionalism lapses.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"46 3","pages":"225-232"},"PeriodicalIF":2.9,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/fd/77/10.1177_01632787231158128.PMC10443919.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10078631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/01632787231164782
Kang Liu, Xiaofang Yu, Yan Cai, Dongbo Tu
Daily hassles have a larger effect on our health and well-being than those major events in daily life. The present study aimed to evaluate the psychometric properties and measurement invariance of the LIVES Daily Hassles Scale (LIVES-DHS) in Chinese samples, which consisted of 815 people at work aged between 20 and 60 years old. The results of both Explanatory Factor Analysis and Confirmatory Factor Analysis showed that the five-factor model solution was better than other solutions, which supported the original structure of LIVES-DHS. The Cronbach's alpha coefficients of the five subdimensions varied between.721 and.818, with the entire scale of.920, and McDonald's values of the five subdimensions varied between.716 and.821, with the entire scale of.936. The results also showed the support for measurement invariance of the five-factor model across different groups, which is the first to offer evidence for configural, metric, scalar and strict invariance of LIVES-DHS across gender, age and educational groups.
{"title":"Psychometric Properties and Measurement Invariance of the LIVES Daily Hassles Scale in Chinese Samples.","authors":"Kang Liu, Xiaofang Yu, Yan Cai, Dongbo Tu","doi":"10.1177/01632787231164782","DOIUrl":"https://doi.org/10.1177/01632787231164782","url":null,"abstract":"<p><p>Daily hassles have a larger effect on our health and well-being than those major events in daily life. The present study aimed to evaluate the psychometric properties and measurement invariance of the LIVES Daily Hassles Scale (LIVES-DHS) in Chinese samples, which consisted of 815 people at work aged between 20 and 60 years old. The results of both Explanatory Factor Analysis and Confirmatory Factor Analysis showed that the five-factor model solution was better than other solutions, which supported the original structure of LIVES-DHS. The Cronbach's alpha coefficients of the five subdimensions varied between.721 and.818, with the entire scale of.920, and McDonald's <math><mrow><mi>ω</mi></mrow></math> values of the five subdimensions varied between.716 and.821, with the entire scale of.936. The results also showed the support for measurement invariance of the five-factor model across different groups, which is the first to offer evidence for configural, metric, scalar and strict invariance of LIVES-DHS across gender, age and educational groups.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"46 3","pages":"277-286"},"PeriodicalIF":2.9,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10177925","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/01632787231188182
Raymond Boon Tar Lim, Kenneth Wee Beng Hoe, Claire Gek Ling Tan, Huili Zheng
This systematic review aims to evaluate the effectiveness of systems-based practice (SBP) curricula from the perspective of health professions students and workers. A total of 8468 citations were sourced from six electronic databases and manual searches conducted independently by two researchers, of which 44 studies were eventually included. A meta-analysis using a random effects model and a meta-synthesis using the thematic synthesis approach were conducted. Most studies targeted medical students, residents, and resident physicians from various clinical specialties. Almost half of all studies focused on didactic or knowledge-based interventions to teach SBP. About a third of all studies measured non-self-evaluated knowledge change, clinical abilities, and clinical outcomes. Both meta-analysis and meta-synthesis results revealed positive outcomes of increased knowledge of SBP, increased recognition of SBP as a core competency in one's profession, and increased application of SBP knowledge in one's profession. Meta-synthesis results also revealed negative outcomes at the institutional and teacher/health professions level. This review highlights the importance of SBP education and supports the effectiveness of SBP curricula. There is a need to address the negative outcomes at the institutional and teacher/health professions level. Moreover, future studies could investigate the integration of self-assessment outcomes with comparison to some external standard.
{"title":"A Systematic Review on the Effectiveness of Systems-Based Practice Curricula in Health Professions Education.","authors":"Raymond Boon Tar Lim, Kenneth Wee Beng Hoe, Claire Gek Ling Tan, Huili Zheng","doi":"10.1177/01632787231188182","DOIUrl":"https://doi.org/10.1177/01632787231188182","url":null,"abstract":"<p><p>This systematic review aims to evaluate the effectiveness of systems-based practice (SBP) curricula from the perspective of health professions students and workers. A total of 8468 citations were sourced from six electronic databases and manual searches conducted independently by two researchers, of which 44 studies were eventually included. A meta-analysis using a random effects model and a meta-synthesis using the thematic synthesis approach were conducted. Most studies targeted medical students, residents, and resident physicians from various clinical specialties. Almost half of all studies focused on didactic or knowledge-based interventions to teach SBP. About a third of all studies measured non-self-evaluated knowledge change, clinical abilities, and clinical outcomes. Both meta-analysis and meta-synthesis results revealed positive outcomes of increased knowledge of SBP, increased recognition of SBP as a core competency in one's profession, and increased application of SBP knowledge in one's profession. Meta-synthesis results also revealed negative outcomes at the institutional and teacher/health professions level. This review highlights the importance of SBP education and supports the effectiveness of SBP curricula. There is a need to address the negative outcomes at the institutional and teacher/health professions level. Moreover, future studies could investigate the integration of self-assessment outcomes with comparison to some external standard.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"46 3","pages":"242-254"},"PeriodicalIF":2.9,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10133807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/01632787221134712
Maria Matarese, Roberta Pendoni, Davide Ausili, Ercole Vellone, Maddalena De Maria
The study tested the construct validity and reliability of the Caregiver Contribution to Self-Care of Chronic Obstructive Pulmonary Disease (COPD) Inventory and the Caregiver Self-Efficacy in Contributing to Self-Care of COPD Scale. The two instruments were developed by modifying the Self-Care of COPD Inventory and Self-Care Self-Efficacy Scale in COPD into caregiver versions. The psychometric properties were tested in a convenience sample of 261 informal caregivers of COPD patients recruited in Italy in two cross-sectional studies. Structural validity was tested by confirmatory factor analysis, construct validity by posing several hypotheses, and internal consistency through factor score determinacy and global reliability index for multidimensional scales. In confirmatory factor analysis, the caregiver contribution to self-care maintenance, monitoring and management scales, composing the Caregiver Contribution to Self-Care of COPD Inventory, presented good fit indices. Global reliability indices ranged 0.75-0.88. The caregiver self-efficacy scale presented a comparative fit index of 0.96 and a global reliability index of 0.82. The caregiver contribution to self-care and the caregiver self-efficacy scales correlated moderately among themselves and with the patient versions of the scales, and scores were higher with caregiver-oriented dyadic care types and female caregivers. Our study provides evidence of the two instruments' construct validity and internal consistency.
{"title":"Validity and Reliability of Caregiver Contribution to Self-Care of Chronic Obstructive Pulmonary Disease Inventory and Caregiver Self-Efficacy in Contributing to Self-Care Scale.","authors":"Maria Matarese, Roberta Pendoni, Davide Ausili, Ercole Vellone, Maddalena De Maria","doi":"10.1177/01632787221134712","DOIUrl":"https://doi.org/10.1177/01632787221134712","url":null,"abstract":"<p><p>The study tested the construct validity and reliability of the Caregiver Contribution to Self-Care of Chronic Obstructive Pulmonary Disease (COPD) Inventory and the Caregiver Self-Efficacy in Contributing to Self-Care of COPD Scale. The two instruments were developed by modifying the Self-Care of COPD Inventory and Self-Care Self-Efficacy Scale in COPD into caregiver versions. The psychometric properties were tested in a convenience sample of 261 informal caregivers of COPD patients recruited in Italy in two cross-sectional studies. Structural validity was tested by confirmatory factor analysis, construct validity by posing several hypotheses, and internal consistency through factor score determinacy and global reliability index for multidimensional scales. In confirmatory factor analysis, the caregiver contribution to self-care maintenance, monitoring and management scales, composing the Caregiver Contribution to Self-Care of COPD Inventory, presented good fit indices. Global reliability indices ranged 0.75-0.88. The caregiver self-efficacy scale presented a comparative fit index of 0.96 and a global reliability index of 0.82. The caregiver contribution to self-care and the caregiver self-efficacy scales correlated moderately among themselves and with the patient versions of the scales, and scores were higher with caregiver-oriented dyadic care types and female caregivers. Our study provides evidence of the two instruments' construct validity and internal consistency.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"46 3","pages":"255-269"},"PeriodicalIF":2.9,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10132192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}