{"title":"改进过程评估中的情境测量:开发和使用情境跟踪工具。","authors":"Joanna Busza, Fortunate Machingura, Cedomir Vuckovic","doi":"10.1186/s13063-024-08623-7","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Process evaluations are increasingly integrated into randomised controlled trials (RCTs) of complex interventions to document their delivery and interactions with local systems and dynamics, helping understand observed health outcomes. Yet process evaluations often struggle to assess relevant contextual determinants, leaving much of the important role of \"context\" in shaping an intervention's mechanisms opaque in many studies. A lack of easily adapted data collection methods to help define and operationalise indicators of context likely contributes to this.</p><p><strong>Methods: </strong>We present a method to help structure measures of context in process evaluations and describe its use in two very different settings. The \"Context Tracker\" is an innovative tool for use within trials and quasi-experiments to more systematically capture and understand key dimensions of context. It was developed in Zimbabwe as part of a cluster randomised controlled trial and then adapted for a quasi-experimental evaluation in the UK. Both studies provided harm reduction and health services for marginalised and hard-to-reach populations.</p><p><strong>Results: </strong>We developed the Context Tracker to be both standardised (i.e. formatted and applied in the same way across study sites) and flexible enough to allow unique features to be explored in greater detail. Drawing on the Context and Implementation of Complex Interventions (CICI) and Risk Environments frameworks, we mapped 5 domains across micro, meso and macro levels in a simple table and used existing evidence and experience to predict factors likely to affect delivery of and participation in intervention components. We tracked these over time across study sites using routine programme statistics, observation and qualitative methods. The Context Tracker enables identification and comparison of facilitators and barriers to implementation, variations in engagement with interventions, and how mechanisms of action are (or are not) triggered in different settings.</p><p><strong>Conclusions: </strong>The Context Tracker is one example of how evidence-based contextual determinants can be used to guide data collection and analysis within process evaluations. It is relevant in low- and high-income settings and applicable to both qualitative and quantitative analyses. While perhaps most useful to process evaluations of complex interventions targeting marginalised communities, the broader approach would benefit a more general research audience.</p>","PeriodicalId":23333,"journal":{"name":"Trials","volume":"25 1","pages":"777"},"PeriodicalIF":2.0000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11571973/pdf/","citationCount":"0","resultStr":"{\"title\":\"Improving measures of context in process evaluations: development and use of the Context Tracker tool.\",\"authors\":\"Joanna Busza, Fortunate Machingura, Cedomir Vuckovic\",\"doi\":\"10.1186/s13063-024-08623-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Process evaluations are increasingly integrated into randomised controlled trials (RCTs) of complex interventions to document their delivery and interactions with local systems and dynamics, helping understand observed health outcomes. Yet process evaluations often struggle to assess relevant contextual determinants, leaving much of the important role of \\\"context\\\" in shaping an intervention's mechanisms opaque in many studies. A lack of easily adapted data collection methods to help define and operationalise indicators of context likely contributes to this.</p><p><strong>Methods: </strong>We present a method to help structure measures of context in process evaluations and describe its use in two very different settings. The \\\"Context Tracker\\\" is an innovative tool for use within trials and quasi-experiments to more systematically capture and understand key dimensions of context. It was developed in Zimbabwe as part of a cluster randomised controlled trial and then adapted for a quasi-experimental evaluation in the UK. Both studies provided harm reduction and health services for marginalised and hard-to-reach populations.</p><p><strong>Results: </strong>We developed the Context Tracker to be both standardised (i.e. formatted and applied in the same way across study sites) and flexible enough to allow unique features to be explored in greater detail. Drawing on the Context and Implementation of Complex Interventions (CICI) and Risk Environments frameworks, we mapped 5 domains across micro, meso and macro levels in a simple table and used existing evidence and experience to predict factors likely to affect delivery of and participation in intervention components. We tracked these over time across study sites using routine programme statistics, observation and qualitative methods. The Context Tracker enables identification and comparison of facilitators and barriers to implementation, variations in engagement with interventions, and how mechanisms of action are (or are not) triggered in different settings.</p><p><strong>Conclusions: </strong>The Context Tracker is one example of how evidence-based contextual determinants can be used to guide data collection and analysis within process evaluations. It is relevant in low- and high-income settings and applicable to both qualitative and quantitative analyses. While perhaps most useful to process evaluations of complex interventions targeting marginalised communities, the broader approach would benefit a more general research audience.</p>\",\"PeriodicalId\":23333,\"journal\":{\"name\":\"Trials\",\"volume\":\"25 1\",\"pages\":\"777\"},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2024-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11571973/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Trials\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s13063-024-08623-7\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MEDICINE, RESEARCH & EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Trials","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s13063-024-08623-7","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
Improving measures of context in process evaluations: development and use of the Context Tracker tool.
Background: Process evaluations are increasingly integrated into randomised controlled trials (RCTs) of complex interventions to document their delivery and interactions with local systems and dynamics, helping understand observed health outcomes. Yet process evaluations often struggle to assess relevant contextual determinants, leaving much of the important role of "context" in shaping an intervention's mechanisms opaque in many studies. A lack of easily adapted data collection methods to help define and operationalise indicators of context likely contributes to this.
Methods: We present a method to help structure measures of context in process evaluations and describe its use in two very different settings. The "Context Tracker" is an innovative tool for use within trials and quasi-experiments to more systematically capture and understand key dimensions of context. It was developed in Zimbabwe as part of a cluster randomised controlled trial and then adapted for a quasi-experimental evaluation in the UK. Both studies provided harm reduction and health services for marginalised and hard-to-reach populations.
Results: We developed the Context Tracker to be both standardised (i.e. formatted and applied in the same way across study sites) and flexible enough to allow unique features to be explored in greater detail. Drawing on the Context and Implementation of Complex Interventions (CICI) and Risk Environments frameworks, we mapped 5 domains across micro, meso and macro levels in a simple table and used existing evidence and experience to predict factors likely to affect delivery of and participation in intervention components. We tracked these over time across study sites using routine programme statistics, observation and qualitative methods. The Context Tracker enables identification and comparison of facilitators and barriers to implementation, variations in engagement with interventions, and how mechanisms of action are (or are not) triggered in different settings.
Conclusions: The Context Tracker is one example of how evidence-based contextual determinants can be used to guide data collection and analysis within process evaluations. It is relevant in low- and high-income settings and applicable to both qualitative and quantitative analyses. While perhaps most useful to process evaluations of complex interventions targeting marginalised communities, the broader approach would benefit a more general research audience.
期刊介绍:
Trials is an open access, peer-reviewed, online journal that will encompass all aspects of the performance and findings of randomized controlled trials. Trials will experiment with, and then refine, innovative approaches to improving communication about trials. We are keen to move beyond publishing traditional trial results articles (although these will be included). We believe this represents an exciting opportunity to advance the science and reporting of trials. Prior to 2006, Trials was published as Current Controlled Trials in Cardiovascular Medicine (CCTCVM). All published CCTCVM articles are available via the Trials website and citations to CCTCVM article URLs will continue to be supported.