The effects of computerised decision support systems on nursing and allied health professional performance and patient outcomes: a systematic review and user contextualisation.
Carl Thompson, Teumzghi Mebrahtu, Sarah Skyrme, Karen Bloor, Deidre Andre, Anne Maree Keenan, Alison Ledward, Huiqin Yang, Rebecca Randell
{"title":"The effects of computerised decision support systems on nursing and allied health professional performance and patient outcomes: a systematic review and user contextualisation.","authors":"Carl Thompson, Teumzghi Mebrahtu, Sarah Skyrme, Karen Bloor, Deidre Andre, Anne Maree Keenan, Alison Ledward, Huiqin Yang, Rebecca Randell","doi":"10.3310/GRNM5147","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Computerised decision support systems (CDSS) are widely used by nurses and allied health professionals but their effect on clinical performance and patient outcomes is uncertain.</p><p><strong>Objectives: </strong>Evaluate the effects of clinical decision support systems use on nurses', midwives' and allied health professionals' performance and patient outcomes and sense-check the results with developers and users.</p><p><strong>Eligibility criteria: </strong>Comparative studies (randomised controlled trials (RCTs), non-randomised trials, controlled before-and-after (CBA) studies, interrupted time series (ITS) and repeated measures studies comparing) of CDSS versus usual care from nurses, midwives or other allied health professionals.</p><p><strong>Information sources: </strong>Nineteen bibliographic databases searched October 2019 and February 2021.</p><p><strong>Risk of bias: </strong>Assessed using structured risk of bias guidelines; almost all included studies were at high risk of bias.</p><p><strong>Synthesis of results: </strong>Heterogeneity between interventions and outcomes necessitated narrative synthesis and grouping by: similarity in focus or CDSS-type, targeted health professionals, patient group, outcomes reported and study design.</p><p><strong>Included studies: </strong>Of 36,106 initial records, 262 studies were assessed for eligibility, with 35 included: 28 RCTs (80%), 3 CBA studies (8.6%), 3 ITS (8.6%) and 1 non-randomised trial, a total of 1318 health professionals and 67,595 patient participants. Few studies were multi-site and most focused on decision-making by nurses (71%) or paramedics (5.7%). Standalone, computer-based CDSS featured in 88.7% of the studies; only 8.6% of the studies involved 'smart' mobile or handheld technology. Care processes - including adherence to guidance - were positively influenced in 47% of the measures adopted. For example, nurses' adherence to hand disinfection guidance, insulin dosing, on-time blood sampling, and documenting care were improved if they used CDSS. Patient care outcomes were statistically - if not always clinically - significantly improved in 40.7% of indicators. For example, lower numbers of falls and pressure ulcers, better glycaemic control, screening of malnutrition and obesity, and accurate triaging were features of professionals using CDSS compared to those who were not.</p><p><strong>Evidence limitations: </strong>Allied health professionals (AHPs) were underrepresented compared to nurses; systems, studies and outcomes were heterogeneous, preventing statistical aggregation; very wide confidence intervals around effects meant clinical significance was questionable; decision and implementation theory that would have helped interpret effects - including null effects - was largely absent; economic data were scant and diverse, preventing estimation of overall cost-effectiveness.</p><p><strong>Interpretation: </strong>CDSS can positively influence selected aspects of nurses', midwives' and AHPs' performance and care outcomes. Comparative research is generally of low quality and outcomes wide ranging and heterogeneous. After more than a decade of synthesised research into CDSS in healthcare professions other than medicine, the effect on processes and outcomes remains uncertain. Higher-quality, theoretically informed, evaluative research that addresses the economics of CDSS development and implementation is still required.</p><p><strong>Future work: </strong>Developing nursing CDSS and primary research evaluation.</p><p><strong>Funding: </strong>This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme and will be published in Health and Social Care Delivery Research; 2023. See the NIHR Journals Library website for further project information.</p><p><strong>Registration: </strong>PROSPERO [number: CRD42019147773].</p>","PeriodicalId":73204,"journal":{"name":"Health and social care delivery research","volume":" ","pages":"1-85"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health and social care delivery research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3310/GRNM5147","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Computerised decision support systems (CDSS) are widely used by nurses and allied health professionals but their effect on clinical performance and patient outcomes is uncertain.
Objectives: Evaluate the effects of clinical decision support systems use on nurses', midwives' and allied health professionals' performance and patient outcomes and sense-check the results with developers and users.
Eligibility criteria: Comparative studies (randomised controlled trials (RCTs), non-randomised trials, controlled before-and-after (CBA) studies, interrupted time series (ITS) and repeated measures studies comparing) of CDSS versus usual care from nurses, midwives or other allied health professionals.
Information sources: Nineteen bibliographic databases searched October 2019 and February 2021.
Risk of bias: Assessed using structured risk of bias guidelines; almost all included studies were at high risk of bias.
Synthesis of results: Heterogeneity between interventions and outcomes necessitated narrative synthesis and grouping by: similarity in focus or CDSS-type, targeted health professionals, patient group, outcomes reported and study design.
Included studies: Of 36,106 initial records, 262 studies were assessed for eligibility, with 35 included: 28 RCTs (80%), 3 CBA studies (8.6%), 3 ITS (8.6%) and 1 non-randomised trial, a total of 1318 health professionals and 67,595 patient participants. Few studies were multi-site and most focused on decision-making by nurses (71%) or paramedics (5.7%). Standalone, computer-based CDSS featured in 88.7% of the studies; only 8.6% of the studies involved 'smart' mobile or handheld technology. Care processes - including adherence to guidance - were positively influenced in 47% of the measures adopted. For example, nurses' adherence to hand disinfection guidance, insulin dosing, on-time blood sampling, and documenting care were improved if they used CDSS. Patient care outcomes were statistically - if not always clinically - significantly improved in 40.7% of indicators. For example, lower numbers of falls and pressure ulcers, better glycaemic control, screening of malnutrition and obesity, and accurate triaging were features of professionals using CDSS compared to those who were not.
Evidence limitations: Allied health professionals (AHPs) were underrepresented compared to nurses; systems, studies and outcomes were heterogeneous, preventing statistical aggregation; very wide confidence intervals around effects meant clinical significance was questionable; decision and implementation theory that would have helped interpret effects - including null effects - was largely absent; economic data were scant and diverse, preventing estimation of overall cost-effectiveness.
Interpretation: CDSS can positively influence selected aspects of nurses', midwives' and AHPs' performance and care outcomes. Comparative research is generally of low quality and outcomes wide ranging and heterogeneous. After more than a decade of synthesised research into CDSS in healthcare professions other than medicine, the effect on processes and outcomes remains uncertain. Higher-quality, theoretically informed, evaluative research that addresses the economics of CDSS development and implementation is still required.
Future work: Developing nursing CDSS and primary research evaluation.
Funding: This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme and will be published in Health and Social Care Delivery Research; 2023. See the NIHR Journals Library website for further project information.