Pub Date : 2024-09-01Epub Date: 2023-10-19DOI: 10.1177/01632787231207018
Giovanni Gioiello, Francesco Zaghini, Valerio Della Bella, Jacopo Fiorini, Alessandro Sili
This systematic review aimed to identify and compare instruments measuring nurses' organizational well-being, summarise the dimensions measured by these instruments, the statistical analysis performed for validity evidence and identify an instrument that comprehensively investigates nurses' organizational well-being. The JBI Manual for Evidence Synthesis and the PRISMA checklist were used as guidelines. The search was conducted on Medline, CINAHL, Cochrane Library and Scopus. Critical appraisal and data extraction were drawn on the COSMIN checklist. Dimensions were conceptually synthesized by the measurement concepts' similarity. Twenty-two articles were retrieved and they included 21 instruments that measured nurses' organizational well-being. The instruments vary by dimension number (range 2-19), items (range 12-118) and concept elicitation. A plurality of methodologies has been used in instrument development and assessments of evidence for validity. Only four instruments reported a concurrent criterion validity or a measurement comparison with an already tested-for-validity instrument. Similar dimensions were leadership and support, relationships and communication, work-family balance, work demands, violence, control and autonomy, satisfaction and motivation, work environment and resources, careers, and organizational policy. This review underlines the core areas of the instruments that measure nursing organizational well-being. It allows administrators and researchers to choose the appropriate instruments for monitoring this multidimensional concept.
{"title":"Measuring Nurses' Organizational Well-Being: A Systematic Review of Available Instruments.","authors":"Giovanni Gioiello, Francesco Zaghini, Valerio Della Bella, Jacopo Fiorini, Alessandro Sili","doi":"10.1177/01632787231207018","DOIUrl":"10.1177/01632787231207018","url":null,"abstract":"<p><p>This systematic review aimed to identify and compare instruments measuring nurses' organizational well-being, summarise the dimensions measured by these instruments, the statistical analysis performed for validity evidence and identify an instrument that comprehensively investigates nurses' organizational well-being. The JBI Manual for Evidence Synthesis and the PRISMA checklist were used as guidelines. The search was conducted on Medline, CINAHL, Cochrane Library and Scopus. Critical appraisal and data extraction were drawn on the COSMIN checklist. Dimensions were conceptually synthesized by the measurement concepts' similarity. Twenty-two articles were retrieved and they included 21 instruments that measured nurses' organizational well-being. The instruments vary by dimension number (range 2-19), items (range 12-118) and concept elicitation. A plurality of methodologies has been used in instrument development and assessments of evidence for validity. Only four instruments reported a concurrent criterion validity or a measurement comparison with an already tested-for-validity instrument. Similar dimensions were leadership and support, relationships and communication, work-family balance, work demands, violence, control and autonomy, satisfaction and motivation, work environment and resources, careers, and organizational policy. This review underlines the core areas of the instruments that measure nursing organizational well-being. It allows administrators and researchers to choose the appropriate instruments for monitoring this multidimensional concept.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"261-278"},"PeriodicalIF":2.2,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49676122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-01Epub Date: 2024-07-18DOI: 10.1177/01632787241264597
Homayoun Pasha Safavi, Mona Bouzari
The primary goal of the present study is to inspect the plausible job-related (i.e., challenge stressors and role blurring) and individual factors (i.e., fatigue and insomnia) that potentially lead to work-related cognitive failures among healthcare staff. Through the judgmental sampling technique, data was collected from healthcare personnel in Iran. The results revealed that challenge stressors in the form of time pressure, job responsibility, and work overload are significantly related to role blurring. Moreover, role blurring increases fatigue and insomnia among medical staff, and both insomnia and fatigue cause workplace cognitive failure. The results also confirm the mediation effect of role blurring in the association between challenge stressors, insomnia, and fatigue. According to the results, insomnia and fatigue similarly mediate the role blurring on workplace cognitive failure association. Theoretical implications, useful suggestions for practitioners, and prospective research avenues are debated in the study.
{"title":"Fading Focus: Addressing the Association Between Challenge Stressors, Role Blurring, Insomnia, Fatigue, and Workplace Cognitive Failure.","authors":"Homayoun Pasha Safavi, Mona Bouzari","doi":"10.1177/01632787241264597","DOIUrl":"10.1177/01632787241264597","url":null,"abstract":"<p><p>The primary goal of the present study is to inspect the plausible job-related (i.e., challenge stressors and role blurring) and individual factors (i.e., fatigue and insomnia) that potentially lead to work-related cognitive failures among healthcare staff. Through the judgmental sampling technique, data was collected from healthcare personnel in Iran. The results revealed that challenge stressors in the form of time pressure, job responsibility, and work overload are significantly related to role blurring. Moreover, role blurring increases fatigue and insomnia among medical staff, and both insomnia and fatigue cause workplace cognitive failure. The results also confirm the mediation effect of role blurring in the association between challenge stressors, insomnia, and fatigue. According to the results, insomnia and fatigue similarly mediate the role blurring on workplace cognitive failure association. Theoretical implications, useful suggestions for practitioners, and prospective research avenues are debated in the study.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"304-318"},"PeriodicalIF":2.2,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141723352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-01Epub Date: 2023-06-28DOI: 10.1177/01632787231185856
Carol Y Ochoa-Dominguez, Ann S Hamilton, Xueyan Zhuang, Wendy J Mack, Joel E Milam
Pediatric Health Related Quality of Life (HRQoL) among childhood cancer survivors (CCS) measures the impact of illness and treatment from the patient's perspective. However, parents often serve as proxies when the child cannot provide information directly. Studies of agreement between parents' proxy assessment and child's self-report have shown discrepancies. Understanding the reasons for discrepancies is under studied. Thus, this study examined the agreement of 160 parent-CCS dyads on the child's domains of HRQoL by mean difference, intra-class correlation coefficients, and Bland-Altman plots. Differences in agreement were assessed by patients' age, ethnicity, and whether or not they lived with their parents. Overall, the Physical Function Score showed good agreement between parents and CCS (ICC = 0.62), while the Social Function Score had fair agreement (ICC = 0.39). CCS were more likely to rate their Social Function Score higher than their parent. The lowest agreement for the Social Function Score was found for 18-20 years old's (ICC = .254) versus younger or older CCS, and among non-Hispanic whites (ICC = 0.301) versus Hispanics. Differences in agreement varied by patient age and ethnicity, suggesting that other factors, including emotional, familial, and cultural factors, may influence parental awareness of CCS HRQoL.
{"title":"Factors Associated With Agreement Between Parent and Childhood Cancer Survivor Reports on Child's Health Related Quality of Life.","authors":"Carol Y Ochoa-Dominguez, Ann S Hamilton, Xueyan Zhuang, Wendy J Mack, Joel E Milam","doi":"10.1177/01632787231185856","DOIUrl":"10.1177/01632787231185856","url":null,"abstract":"<p><p>Pediatric Health Related Quality of Life (HRQoL) among childhood cancer survivors (CCS) measures the impact of illness and treatment from the patient's perspective. However, parents often serve as proxies when the child cannot provide information directly. Studies of agreement between parents' proxy assessment and child's self-report have shown discrepancies. Understanding the reasons for discrepancies is under studied. Thus, this study examined the agreement of 160 parent-CCS dyads on the child's domains of HRQoL by mean difference, intra-class correlation coefficients, and Bland-Altman plots. Differences in agreement were assessed by patients' age, ethnicity, and whether or not they lived with their parents. Overall, the Physical Function Score showed good agreement between parents and CCS (ICC = 0.62), while the Social Function Score had fair agreement (ICC = 0.39). CCS were more likely to rate their Social Function Score higher than their parent. The lowest agreement for the Social Function Score was found for 18-20 years old's (ICC = .254) versus younger or older CCS, and among non-Hispanic whites (ICC = 0.301) versus Hispanics. Differences in agreement varied by patient age and ethnicity, suggesting that other factors, including emotional, familial, and cultural factors, may influence parental awareness of CCS HRQoL.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"328-335"},"PeriodicalIF":2.2,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11351002/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9683825","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-01Epub Date: 2023-07-18DOI: 10.1177/01632787231188458
Simona-Alexandra Ispas, Dragos Iliescu, Lily Ren, Samuel So, Mehlika Toy
Hepatitis B is a condition that directly affects hundreds of millions of people, who may require testing for certain psychological constructs. This systematic review presents the current state with regard to the instruments that are used for the measurement of psychological variables in relation to hepatitis B. We conducted a comprehensive search in bibliographic databases (PubMed, Embase, Scopus, Web of Science, PsycINFO, CINAHL, and the Cochrane Library), and grey literature search. We identified commonly used measures, their psychometric properties and gaps in the research. Our findings from the 38 papers included in the review indicate that while several tests have been developed to cater to hepatitis B patients, most are focused on quality of life, with few targeting other needed directions, such as stigma or attitudes to vaccination. We also show the limits in current measures and discuss potential improvements.
乙型肝炎是一种直接影响数亿人的疾病,他们可能需要对某些心理结构进行测试。我们在文献数据库(PubMed、Embase、Scopus、Web of Science、PsycINFO、CINAHL 和 Cochrane 图书馆)和灰色文献检索中进行了全面搜索。我们确定了常用的测量方法、其心理测量特性和研究空白。我们从收录在综述中的 38 篇论文中得出的结论表明,虽然已经开发了几种针对乙型肝炎患者的测试,但大多数都侧重于生活质量,很少有针对其他需要的方向,如耻辱感或对疫苗接种的态度。我们还显示了当前测量的局限性,并讨论了潜在的改进措施。
{"title":"Psychometric Tests for Hepatitis B - A Systematic Review.","authors":"Simona-Alexandra Ispas, Dragos Iliescu, Lily Ren, Samuel So, Mehlika Toy","doi":"10.1177/01632787231188458","DOIUrl":"10.1177/01632787231188458","url":null,"abstract":"<p><p>Hepatitis B is a condition that directly affects hundreds of millions of people, who may require testing for certain psychological constructs. This systematic review presents the current state with regard to the instruments that are used for the measurement of psychological variables in relation to hepatitis B. We conducted a comprehensive search in bibliographic databases (PubMed, Embase, Scopus, Web of Science, PsycINFO, CINAHL, and the Cochrane Library), and grey literature search. We identified commonly used measures, their psychometric properties and gaps in the research. Our findings from the 38 papers included in the review indicate that while several tests have been developed to cater to hepatitis B patients, most are focused on quality of life, with few targeting other needed directions, such as stigma or attitudes to vaccination. We also show the limits in current measures and discuss potential improvements.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"235-253"},"PeriodicalIF":2.2,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9827935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-01Epub Date: 2023-06-22DOI: 10.1177/01632787231182681
Esma Nur Kolbaşı, Pınar Van Der Veer, Tansu Birinci
Identifying the barriers to physical activity (PA) is important for comprehensive management strategies to decrease physical inactivity. This study aimed to translate and cross-culturally adapt the Self-Perceived Barriers for Physical Activity Scale (SPBPA) into Turkish and investigate its psychometric properties. One-hundred fifty-two young and middle-aged adults (mean age of 33.3 ± 12.66 years) were included. Within a 5-to-15-day period after the first assessment, the participants completed the Turkish version of SPBPA (SPBPA-T) to evaluate test-retest reliability. Cronbach's alpha (α) was used to assess internal consistency. The correlation between the SPBPA-T and Physical Activity Barriers Questionnaire (PABQ) and Short Form-12 (SF-12) was determined to check the validity. The SPBPA-T had a strong internal consistency (α = .83) and test-retest reliability (ICC2,1 = .90). There was a strong correlation between PABQ and SPBPA-T (r = 0.709; p < .0001), indicating strong construct validity. The convergent validity of SPBPA-T was confirmed with the mental component of SF-12 (r = -.228; p < .0001). There was no floor or ceiling effect. The questionnaire had a 1.083 SEM value and its MDC was 3.00 points. The SPBPA-T is semantically and linguistically adequate and has strong internal validity and test-retest reliability to determine the self-perceived barriers to PA among Turkish-speaking young adults.
{"title":"The Validity and Reliability of the Turkish Version of Self-Perceived Barriers for Physical Activity Questionnaire.","authors":"Esma Nur Kolbaşı, Pınar Van Der Veer, Tansu Birinci","doi":"10.1177/01632787231182681","DOIUrl":"10.1177/01632787231182681","url":null,"abstract":"<p><p>Identifying the barriers to physical activity (PA) is important for comprehensive management strategies to decrease physical inactivity. This study aimed to translate and cross-culturally adapt the Self-Perceived Barriers for Physical Activity Scale (SPBPA) into Turkish and investigate its psychometric properties. One-hundred fifty-two young and middle-aged adults (mean age of 33.3 ± 12.66 years) were included. Within a 5-to-15-day period after the first assessment, the participants completed the Turkish version of SPBPA (SPBPA-T) to evaluate test-retest reliability. Cronbach's alpha (α) was used to assess internal consistency. The correlation between the SPBPA-T and Physical Activity Barriers Questionnaire (PABQ) and Short Form-12 (SF-12) was determined to check the validity. The SPBPA-T had a strong internal consistency (α = .83) and test-retest reliability (ICC<sub>2,1</sub> = .90). There was a strong correlation between PABQ and SPBPA-T (r = 0.709; <i>p</i> < .0001), indicating strong construct validity. The convergent validity of SPBPA-T was confirmed with the mental component of SF-12 (r = -.228; <i>p</i> < .0001). There was no floor or ceiling effect. The questionnaire had a 1.083 SEM value and its MDC was 3.00 points. The SPBPA-T is semantically and linguistically adequate and has strong internal validity and test-retest reliability to determine the self-perceived barriers to PA among Turkish-speaking young adults.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"254-260"},"PeriodicalIF":2.2,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9673272","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-01Epub Date: 2023-04-24DOI: 10.1177/01632787231172277
Jian Zhu, Yutao Zhao, Li Huang, Junqiang Ju
The impact of multi-point nursing strategies drawing on a problem-solving clinical framework to examine adverse events associated with thyroid nodule resection was investigated. Patients (n = 98) who underwent thyroid nodule resection were divided into observation and control groups. Patients in the control group received conventional care, and patients in the observation group received a multi-point care strategy under a clinical problem-solving framework. The length of stay (p < .001), hospitalization cost (p < .001), nursing satisfaction scores (p < .001) of the observation group were longer or higher and statistically significant. The incidence of complications in the observation group (8.16%) was lower than that in the control group (22.45%). The incidence of adverse events in the observation group (2.04%) was lower than that in the control group (14.29%), and statistically significant (p < .05). The multi-point nursing strategy using a clinical problem-solving framework provided evidence that it shortened the length of stay, reduce hospitalization costs, improve psychological status, increase nursing satisfaction, and reduce complications and adverse events in patients undergoing thyroid nodule resection.
{"title":"Impact of Multi-point Nursing Strategies Under a Clinical Problem-Solving Framework on Adverse Events Associated With Thyroid Nodule Resection.","authors":"Jian Zhu, Yutao Zhao, Li Huang, Junqiang Ju","doi":"10.1177/01632787231172277","DOIUrl":"10.1177/01632787231172277","url":null,"abstract":"<p><p>The impact of multi-point nursing strategies drawing on a problem-solving clinical framework to examine adverse events associated with thyroid nodule resection was investigated. Patients (<i>n</i> = 98) who underwent thyroid nodule resection were divided into observation and control groups. Patients in the control group received conventional care, and patients in the observation group received a multi-point care strategy under a clinical problem-solving framework. The length of stay (<i>p</i> < .001), hospitalization cost (<i>p</i> < .001), nursing satisfaction scores (<i>p</i> < .001) of the observation group were longer or higher and statistically significant. The incidence of complications in the observation group (8.16%) was lower than that in the control group (22.45%). The incidence of adverse events in the observation group (2.04%) was lower than that in the control group (14.29%), and statistically significant (<i>p</i> < .05). The multi-point nursing strategy using a clinical problem-solving framework provided evidence that it shortened the length of stay, reduce hospitalization costs, improve psychological status, increase nursing satisfaction, and reduce complications and adverse events in patients undergoing thyroid nodule resection.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"279-282"},"PeriodicalIF":2.2,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9390042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-01Epub Date: 2023-11-15DOI: 10.1177/01632787231214531
Samuel Dubin, Eric Kutscher, Ian Nolan, Nathan Levitt, Tiffany E Cook, Richard E Greene
Little is known about how physician learners are assessed following educational interventions about providing gender-affirming care to transgender and gender diverse (TGD) people. The inclusion of learner assessments with educational interventions is essential to understand and measure health professionals' knowledge and skills. We seek to describe how the medical literature has approached the assessment of learners following educational interventions about TGD health. A scoping literature review was done. The guiding research question was "What are the current learner-assessment practices in medical education pedagogy about TGD health?" A total of 270 manuscripts were reviewed. 17 manuscripts were included for data extraction. Miller's pyramid was used to categorize results. 15 used pre- and post-intervention knowledge questionaries to assess learners. Six used simulated patient encounters to assess learners. Most assessments of TGD knowledge and skills among physician learners are pre- and post-surveys. There is sparse literature on higher level assessment following educational interventions that demonstrate learner skills, behaviors, or impact on patient outcomes. Discrete, one-time interventions that are lecture or workshop-based have yet to rigorously assess learners' ability to provide clinical care to TGD patients that is both culturally humble and clinically astute.
{"title":"Assessment of Medical Education on Transgender Health: A Scoping Literature Review.","authors":"Samuel Dubin, Eric Kutscher, Ian Nolan, Nathan Levitt, Tiffany E Cook, Richard E Greene","doi":"10.1177/01632787231214531","DOIUrl":"10.1177/01632787231214531","url":null,"abstract":"<p><p>Little is known about how physician learners are assessed following educational interventions about providing gender-affirming care to transgender and gender diverse (TGD) people. The inclusion of learner assessments with educational interventions is essential to understand and measure health professionals' knowledge and skills. We seek to describe how the medical literature has approached the assessment of learners following educational interventions about TGD health. A scoping literature review was done. The guiding research question was \"What are the current learner-assessment practices in medical education pedagogy about TGD health?\" A total of 270 manuscripts were reviewed. 17 manuscripts were included for data extraction. Miller's pyramid was used to categorize results. 15 used pre- and post-intervention knowledge questionaries to assess learners. Six used simulated patient encounters to assess learners. Most assessments of TGD knowledge and skills among physician learners are pre- and post-surveys. There is sparse literature on higher level assessment following educational interventions that demonstrate learner skills, behaviors, or impact on patient outcomes. Discrete, one-time interventions that are lecture or workshop-based have yet to rigorously assess learners' ability to provide clinical care to TGD patients that is both culturally humble and clinically astute.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"296-303"},"PeriodicalIF":2.2,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"107590677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01DOI: 10.1177/01632787241234882
Jon Agley, Ruth Gassman, Kaitlyn Reho, Jeffrey Roberts, Susan K R Heil, Graciela Castillo, Lilian Golzarri-Arroyo
In healthcare and related fields, there is often a gap between research and practice. Scholars have developed frameworks to support dissemination and implementation of best practices, such as the Interactive Systems Framework for Dissemination and Implementation, which shows how scientific innovations are conveyed to practitioners through tools, training, and technical assistance (TA). Underpinning those aspects of the model are evaluation and continuous quality improvement (CQI). However, a recent meta-analysis suggests that the approaches to and outcomes from CQI in healthcare vary considerably, and that more evaluative work is needed. Therefore, this paper describes an assessment of CQI processes within the Substance Abuse and Mental Health Services Administration's (SAMHSA) Technology Transfer Center (TTC) Network, a large TA/TTC system in the United States comprised of 39 distinct centers. We conducted key informant interviews (n = 71 representing 28 centers in the Network) and three surveys (100% center response rates) focused on CQI, time/effort allocation, and Government Performance and Results Act (GPRA) measures. We used data from each of these study components to provide a robust picture of CQI within a TA/TTC system, identifying Network-specific concepts, concerns about conflation of the GPRA data with CQI, and principles that might be studied more generally.
{"title":"Continuous Quality Improvement in the Substance Abuse and Mental Health Services Administration's Technology Transfer Center Network: A Process Evaluation.","authors":"Jon Agley, Ruth Gassman, Kaitlyn Reho, Jeffrey Roberts, Susan K R Heil, Graciela Castillo, Lilian Golzarri-Arroyo","doi":"10.1177/01632787241234882","DOIUrl":"10.1177/01632787241234882","url":null,"abstract":"<p><p>In healthcare and related fields, there is often a gap between research and practice. Scholars have developed frameworks to support dissemination and implementation of best practices, such as the Interactive Systems Framework for Dissemination and Implementation, which shows how scientific innovations are conveyed to practitioners through tools, training, and technical assistance (TA). Underpinning those aspects of the model are evaluation and continuous quality improvement (CQI). However, a recent meta-analysis suggests that the approaches to and outcomes from CQI in healthcare vary considerably, and that more evaluative work is needed. Therefore, this paper describes an assessment of CQI processes within the Substance Abuse and Mental Health Services Administration's (SAMHSA) Technology Transfer Center (TTC) Network, a large TA/TTC system in the United States comprised of 39 distinct centers. We conducted key informant interviews (<i>n</i> = 71 representing 28 centers in the Network) and three surveys (100% center response rates) focused on CQI, time/effort allocation, and Government Performance and Results Act (GPRA) measures. We used data from each of these study components to provide a robust picture of CQI within a TA/TTC system, identifying Network-specific concepts, concerns about conflation of the GPRA data with CQI, and principles that might be studied more generally.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"47 2","pages":"154-166"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11157976/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141093255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01DOI: 10.1177/01632787241248769
Jochebed G Gayles, Sarah M Chilenski, Nataly Barragán, Brittany Rhoades Cooper, Janet Agnes Welsh, Megan Galinsky
The research-practice gap between evidence-based intervention efficacy and its uptake in real-world contexts remains a central challenge for prevention and implementation science. Providing technical assistance (TA) is considered a crucial support mechanism that can help narrow the gap. However, empirical measurement of TA strategies and their variation is often lacking. The current study unpacks the black box of TA, highlighting different TA strategies, amounts, and their relation to intervention characteristics. First, we qualitatively categorized interactions between TA providers and implementers. Second, we explored how characteristics of implementing organizations and the intervention related to variations in the amount of TA delivered. Using data spanning six years, we analyzed over 10,000 encounters between TA providers and implementers. Content analysis yielded four distinct strategies: Consultation (27.2%), Coordination Logistics (24.5%), Monitoring (16.5%), and Resource Delivery (28.2%). Organizations with prior experience required less monitoring and resource delivery. Additionally, characteristics of the intervention were significantly associated with the amount of consultation, monitoring, coordination logistics, and resource delivery provided. The specific features of the intervention showed significant variation in their relation to TA strategies. These findings provide initial insights into the implications of intervention characteristics in determining how much of which TA strategies are needed to support implementations in real-world settings.
{"title":"Unpacking Technical Assistance (TA) Strategies Within a State-Level Prevention Support System: A Mixed-Method Study in Determining Types and Amount of TA.","authors":"Jochebed G Gayles, Sarah M Chilenski, Nataly Barragán, Brittany Rhoades Cooper, Janet Agnes Welsh, Megan Galinsky","doi":"10.1177/01632787241248769","DOIUrl":"10.1177/01632787241248769","url":null,"abstract":"<p><p>The research-practice gap between evidence-based intervention efficacy and its uptake in real-world contexts remains a central challenge for prevention and implementation science. Providing technical assistance (TA) is considered a crucial support mechanism that can help narrow the gap. However, empirical measurement of TA strategies and their variation is often lacking. The current study unpacks the black box of TA, highlighting different TA strategies, amounts, and their relation to intervention characteristics. First, we qualitatively categorized interactions between TA providers and implementers. Second, we explored how characteristics of implementing organizations and the intervention related to variations in the amount of TA delivered. Using data spanning six years, we analyzed over 10,000 encounters between TA providers and implementers. Content analysis yielded four distinct strategies: Consultation (27.2%), Coordination Logistics (24.5%), Monitoring (16.5%), and Resource Delivery (28.2%). Organizations with prior experience required less monitoring and resource delivery. Additionally, characteristics of the intervention were significantly associated with the amount of consultation, monitoring, coordination logistics, and resource delivery provided. The specific features of the intervention showed significant variation in their relation to TA strategies. These findings provide initial insights into the implications of intervention characteristics in determining how much of which TA strategies are needed to support implementations in real-world settings.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"47 2","pages":"204-218"},"PeriodicalIF":2.2,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11127505/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141093371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01DOI: 10.1177/01632787231225653
Kaitlyn Reho, Jon Agley, Ruth Gassman, Jeffrey Roberts, Susan K R Heil, Jharna Katara
It is important to use evidence-based programs and practices (EBPs) to address major public health issues. However, those who use EBPs in real-world settings often require support in bridging the research-to-practice gap. In the US, one of the largest systems that provides such support is the Substance Abuse and Mental Health Services Administration's (SAMHSA's) Technology Transfer Center (TTC) Network. As part of a large external evaluation of the Network, this study examined how TTCs determine which EBPs to promote and how to promote them. Using semi-structured interviews and pre-testing, we developed a "Determinants of Technology Transfer" survey that was completed by 100% of TTCs in the Network. Because the study period overlapped with the onset of the COVID-19 pandemic, we also conducted a retrospective pre/post-pandemic comparison of determinants. TTCs reported relying on a broad group of factors when selecting EBPs to disseminate and the methods to do so. Stakeholder and target audience input and needs were consistently the most important determinant (both before and during COVID-19), while some other determinants fluctuated around the pandemic (e.g., public health mandates, instructions in the funding opportunity announcements). We discuss implications of the findings for technology transfer and frame the analyses in terms of the Interactive Systems Framework for Dissemination and Implementation.
{"title":"How do the Substance Abuse and Mental Health Services Administration's Technology Transfer Centers Decide What Evidence-Based Practices to Disseminate and Determine How to Do So? A Cross-Sectional Study of a National Network.","authors":"Kaitlyn Reho, Jon Agley, Ruth Gassman, Jeffrey Roberts, Susan K R Heil, Jharna Katara","doi":"10.1177/01632787231225653","DOIUrl":"10.1177/01632787231225653","url":null,"abstract":"<p><p>It is important to use evidence-based programs and practices (EBPs) to address major public health issues. However, those who use EBPs in real-world settings often require support in bridging the research-to-practice gap. In the US, one of the largest systems that provides such support is the Substance Abuse and Mental Health Services Administration's (SAMHSA's) Technology Transfer Center (TTC) Network. As part of a large external evaluation of the Network, this study examined how TTCs determine which EBPs to promote and how to promote them. Using semi-structured interviews and pre-testing, we developed a \"Determinants of Technology Transfer\" survey that was completed by 100% of TTCs in the Network. Because the study period overlapped with the onset of the COVID-19 pandemic, we also conducted a retrospective pre/post-pandemic comparison of determinants. TTCs reported relying on a broad group of factors when selecting EBPs to disseminate and the methods to do so. Stakeholder and target audience input and needs were consistently the most important determinant (both before and during COVID-19), while some other determinants fluctuated around the pandemic (e.g., public health mandates, instructions in the funding opportunity announcements). We discuss implications of the findings for technology transfer and frame the analyses in terms of the Interactive Systems Framework for Dissemination and Implementation.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":"47 2","pages":"167-177"},"PeriodicalIF":2.9,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11157975/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141093363","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}