Seychelle Yohanna, Mackenzie Wilson, Kyla L Naylor, Amit X Garg, Jessica M Sontrop, Istvan Mucsi, Dimitri Belenko, Stephanie N Dixon, Peter G Blake, Rebecca Cooper, Lori Elliott, Esti Heale, Sara Macanovic, Rachel Patzer, Amy D Waterman, Darin Treleaven, Candace Coghlan, Marian Reich, Susan McKenzie, Justin Presseau
{"title":"Process Evaluation Alongside a Cluster-Randomized Trial of a Multicomponent Intervention Designed to Improve Patient Access to Kidney Transplantation.","authors":"Seychelle Yohanna, Mackenzie Wilson, Kyla L Naylor, Amit X Garg, Jessica M Sontrop, Istvan Mucsi, Dimitri Belenko, Stephanie N Dixon, Peter G Blake, Rebecca Cooper, Lori Elliott, Esti Heale, Sara Macanovic, Rachel Patzer, Amy D Waterman, Darin Treleaven, Candace Coghlan, Marian Reich, Susan McKenzie, Justin Presseau","doi":"10.1177/20543581251323959","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>In a cluster-randomized trial, we learned that a novel multicomponent intervention designed to improve access to kidney transplantation did not significantly increase the rate of completed steps toward receiving a kidney transplant. Alongside the trial, we conducted a process evaluation to help interpret our findings.</p><p><strong>Objective: </strong>To determine whether the intervention addressed targeted barriers to transplant and whether the implementation occurred as planned.</p><p><strong>Design: </strong>Mixed-methods process evaluation informed by implementation science theories.</p><p><strong>Setting: </strong>Chronic kidney disease (CKD) programs in Ontario, Canada. These programs, providing care to patients with advanced CKD, participated in the trial from November 1, 2017 to December 31, 2021 (either in the intervention or usual care group).</p><p><strong>Participants: </strong>Health care providers (eg, nurses, managers) at Ontario's 27 CKD programs.</p><p><strong>Methods: </strong>We conducted surveys (n = 114/162 [70.4%]) and semi-structured interviews (n = 17/26 [65.4%]) with providers in CKD programs in Ontario, Canada. In both the intervention-group and control-group surveys, using the Theoretical Domains Framework, we assessed perceived barriers to transplant and how barriers changed throughout the trial period. In the intervention-group surveys and interviews, using the normalization process theory, we assessed the extent to which the intervention was embedded into daily routines. In the intervention-group surveys, and by completing an implementation checklist, we assessed fidelity of implementation.</p><p><strong>Results: </strong>Perceived barriers to transplant did not substantially differ between providers in the intervention and usual care groups, and both groups reported disagreeing or feeling neutral that the targeted barriers impeded transplant access. Intervention-group providers reported that intervention activities were becoming a regular part of their work and that they engaged with its components. However, they also felt the intervention was complex and described needing more resources, a better execution plan, and more buy-in from frontline staff. Fidelity was high for administrative support, quality improvement teams, delivery of educational resources, and patient peer support. The use of performance reports was low.</p><p><strong>Conclusions: </strong>We identified several possible reasons why the intervention was unsuccessful. Improving access to kidney transplantation remains a high priority for health care systems. We will continue to foster a quality improvement culture, and our results will guide future interventions.</p><p><strong>Limitations: </strong>Two of the 13 intervention-group CKD programs did not participate in this evaluation.</p><p><strong>Trial registration: </strong>ClinicalTrials.gov Identifier: NCT03329521.</p>","PeriodicalId":9426,"journal":{"name":"Canadian Journal of Kidney Health and Disease","volume":"12 ","pages":"20543581251323959"},"PeriodicalIF":1.6000,"publicationDate":"2025-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11915279/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Canadian Journal of Kidney Health and Disease","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/20543581251323959","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q3","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: In a cluster-randomized trial, we learned that a novel multicomponent intervention designed to improve access to kidney transplantation did not significantly increase the rate of completed steps toward receiving a kidney transplant. Alongside the trial, we conducted a process evaluation to help interpret our findings.
Objective: To determine whether the intervention addressed targeted barriers to transplant and whether the implementation occurred as planned.
Design: Mixed-methods process evaluation informed by implementation science theories.
Setting: Chronic kidney disease (CKD) programs in Ontario, Canada. These programs, providing care to patients with advanced CKD, participated in the trial from November 1, 2017 to December 31, 2021 (either in the intervention or usual care group).
Participants: Health care providers (eg, nurses, managers) at Ontario's 27 CKD programs.
Methods: We conducted surveys (n = 114/162 [70.4%]) and semi-structured interviews (n = 17/26 [65.4%]) with providers in CKD programs in Ontario, Canada. In both the intervention-group and control-group surveys, using the Theoretical Domains Framework, we assessed perceived barriers to transplant and how barriers changed throughout the trial period. In the intervention-group surveys and interviews, using the normalization process theory, we assessed the extent to which the intervention was embedded into daily routines. In the intervention-group surveys, and by completing an implementation checklist, we assessed fidelity of implementation.
Results: Perceived barriers to transplant did not substantially differ between providers in the intervention and usual care groups, and both groups reported disagreeing or feeling neutral that the targeted barriers impeded transplant access. Intervention-group providers reported that intervention activities were becoming a regular part of their work and that they engaged with its components. However, they also felt the intervention was complex and described needing more resources, a better execution plan, and more buy-in from frontline staff. Fidelity was high for administrative support, quality improvement teams, delivery of educational resources, and patient peer support. The use of performance reports was low.
Conclusions: We identified several possible reasons why the intervention was unsuccessful. Improving access to kidney transplantation remains a high priority for health care systems. We will continue to foster a quality improvement culture, and our results will guide future interventions.
Limitations: Two of the 13 intervention-group CKD programs did not participate in this evaluation.
Seychelle Yohanna, Mackenzie Wilson, K. Naylor, A. Garg, J. Sontrop, D. Belenko, L. Elliott, S. McKenzie, Sara Macanovic, I. Mucsi, R. Patzer, Irina Voronin, I. Lui, P. Blake, A. Waterman, D. Treleaven, J. Presseau
IF 39 1区 医学JAMA Internal MedicinePub Date : 2023-12-01DOI: 10.1001/jamainternmed.2023.5802
Amit X Garg, Seychelle Yohanna, Kyla L Naylor, Susan Q McKenzie, Istvan Mucsi, Stephanie N Dixon, Bin Luo, Jessica M Sontrop, Mary Beaucage, Dmitri Belenko, Candice Coghlan, Rebecca Cooper, Lori Elliott, Leah Getchell, Esti Heale, Vincent Ki, Gihad Nesrallah, Rachel E Patzer, Justin Presseau, Marian Reich, Darin Treleaven, Carol Wang, Amy D Waterman, Jeffrey Zaltzman, Peter G Blake
期刊介绍:
Canadian Journal of Kidney Health and Disease, the official journal of the Canadian Society of Nephrology, is an open access, peer-reviewed online journal that encourages high quality submissions focused on clinical, translational and health services delivery research in the field of chronic kidney disease, dialysis, kidney transplantation and organ donation. Our mandate is to promote and advocate for kidney health as it impacts national and international communities. Basic science, translational studies and clinical studies will be peer reviewed and processed by an Editorial Board comprised of geographically diverse Canadian and international nephrologists, internists and allied health professionals; this Editorial Board is mandated to ensure highest quality publications.