Jennifer Maizel, Stephanie L Filipp, Gaia Zori, Sandhya Yadav, Kishan Avaiya, Lauren Figg, Melanie Hechavarria, Xanadu Roque, Claudia Anez-Zabala, Rayhan Lal, Ananta Addala, Michael J Haller, David M Maahs, Ashby F Walker
{"title":"社区医疗成果干预评估的项目扩展:研究方法范围综述。","authors":"Jennifer Maizel, Stephanie L Filipp, Gaia Zori, Sandhya Yadav, Kishan Avaiya, Lauren Figg, Melanie Hechavarria, Xanadu Roque, Claudia Anez-Zabala, Rayhan Lal, Ananta Addala, Michael J Haller, David M Maahs, Ashby F Walker","doi":"10.1097/CEH.0000000000000572","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Since its inception in 2003, the Project Extension for Community Healthcare Outcomes (ECHO) tele-education model has reached and improved outcomes for patients, providers, and health centers through interventions in >180 countries. Utilization of this model has recently increased due to the COVID-19 pandemic and a higher demand for remote education. However, limited research has examined the methodologies used to evaluate Project ECHO interventions.</p><p><strong>Methods: </strong>We conducted a scoping review to determine the extent and types of research methods used to evaluate outcomes and implementation success of Project ECHO interventions and to identify gaps and opportunities for future investigation. Using Arksey and O'Malley's scoping review framework and the PRISMA-ScR checklist, we reviewed study designs, temporality, analysis methods, data sources, and levels and types of data in 121 articles evaluating Project ECHO interventions.</p><p><strong>Results: </strong>Most interventions addressed substance use disorders (24.8%, n = 30), infectious diseases (24%, n = 29), psychiatric and behavioral health conditions (21.5%, n = 26), and chronic diseases (19%, n = 23). The most frequently reported evaluation methods included cohort studies (86.8%, n = 105), longitudinal designs (74.4%, n = 90), mixed methods analysis (52.1%, n = 63), surveys (61.2%, n = 74), process evaluation measures (98.3%, n = 119), and provider-level outcome measures (84.3%, n = 102). Few evaluations used experimental designs (1.7%, n = 2), randomization (5.8%, n = 7), or comparison groups (14%, n = 17), indicating limited rigor.</p><p><strong>Discussion: </strong>This scoping review demonstrates the need for more rigorous evaluation methods to test the effectiveness of the Project ECHO model at improving outcomes and standardized reporting guidelines to enhance the dissemination of evaluation data from future Project ECHO interventions.</p>","PeriodicalId":50218,"journal":{"name":"Journal of Continuing Education in the Health Professions","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Project Extension for Community Healthcare Outcomes Intervention Evaluations: A Scoping Review of Research Methods.\",\"authors\":\"Jennifer Maizel, Stephanie L Filipp, Gaia Zori, Sandhya Yadav, Kishan Avaiya, Lauren Figg, Melanie Hechavarria, Xanadu Roque, Claudia Anez-Zabala, Rayhan Lal, Ananta Addala, Michael J Haller, David M Maahs, Ashby F Walker\",\"doi\":\"10.1097/CEH.0000000000000572\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>Since its inception in 2003, the Project Extension for Community Healthcare Outcomes (ECHO) tele-education model has reached and improved outcomes for patients, providers, and health centers through interventions in >180 countries. Utilization of this model has recently increased due to the COVID-19 pandemic and a higher demand for remote education. However, limited research has examined the methodologies used to evaluate Project ECHO interventions.</p><p><strong>Methods: </strong>We conducted a scoping review to determine the extent and types of research methods used to evaluate outcomes and implementation success of Project ECHO interventions and to identify gaps and opportunities for future investigation. Using Arksey and O'Malley's scoping review framework and the PRISMA-ScR checklist, we reviewed study designs, temporality, analysis methods, data sources, and levels and types of data in 121 articles evaluating Project ECHO interventions.</p><p><strong>Results: </strong>Most interventions addressed substance use disorders (24.8%, n = 30), infectious diseases (24%, n = 29), psychiatric and behavioral health conditions (21.5%, n = 26), and chronic diseases (19%, n = 23). The most frequently reported evaluation methods included cohort studies (86.8%, n = 105), longitudinal designs (74.4%, n = 90), mixed methods analysis (52.1%, n = 63), surveys (61.2%, n = 74), process evaluation measures (98.3%, n = 119), and provider-level outcome measures (84.3%, n = 102). Few evaluations used experimental designs (1.7%, n = 2), randomization (5.8%, n = 7), or comparison groups (14%, n = 17), indicating limited rigor.</p><p><strong>Discussion: </strong>This scoping review demonstrates the need for more rigorous evaluation methods to test the effectiveness of the Project ECHO model at improving outcomes and standardized reporting guidelines to enhance the dissemination of evaluation data from future Project ECHO interventions.</p>\",\"PeriodicalId\":50218,\"journal\":{\"name\":\"Journal of Continuing Education in the Health Professions\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2024-08-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Continuing Education in the Health Professions\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://doi.org/10.1097/CEH.0000000000000572\",\"RegionNum\":4,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Continuing Education in the Health Professions","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1097/CEH.0000000000000572","RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
Project Extension for Community Healthcare Outcomes Intervention Evaluations: A Scoping Review of Research Methods.
Introduction: Since its inception in 2003, the Project Extension for Community Healthcare Outcomes (ECHO) tele-education model has reached and improved outcomes for patients, providers, and health centers through interventions in >180 countries. Utilization of this model has recently increased due to the COVID-19 pandemic and a higher demand for remote education. However, limited research has examined the methodologies used to evaluate Project ECHO interventions.
Methods: We conducted a scoping review to determine the extent and types of research methods used to evaluate outcomes and implementation success of Project ECHO interventions and to identify gaps and opportunities for future investigation. Using Arksey and O'Malley's scoping review framework and the PRISMA-ScR checklist, we reviewed study designs, temporality, analysis methods, data sources, and levels and types of data in 121 articles evaluating Project ECHO interventions.
Results: Most interventions addressed substance use disorders (24.8%, n = 30), infectious diseases (24%, n = 29), psychiatric and behavioral health conditions (21.5%, n = 26), and chronic diseases (19%, n = 23). The most frequently reported evaluation methods included cohort studies (86.8%, n = 105), longitudinal designs (74.4%, n = 90), mixed methods analysis (52.1%, n = 63), surveys (61.2%, n = 74), process evaluation measures (98.3%, n = 119), and provider-level outcome measures (84.3%, n = 102). Few evaluations used experimental designs (1.7%, n = 2), randomization (5.8%, n = 7), or comparison groups (14%, n = 17), indicating limited rigor.
Discussion: This scoping review demonstrates the need for more rigorous evaluation methods to test the effectiveness of the Project ECHO model at improving outcomes and standardized reporting guidelines to enhance the dissemination of evaluation data from future Project ECHO interventions.
期刊介绍:
The Journal of Continuing Education is a quarterly journal publishing articles relevant to theory, practice, and policy development for continuing education in the health sciences. The journal presents original research and essays on subjects involving the lifelong learning of professionals, with a focus on continuous quality improvement, competency assessment, and knowledge translation. It provides thoughtful advice to those who develop, conduct, and evaluate continuing education programs.