Predicting High-Flow Nasal Cannula Oxygen Therapy Failure in Patients With Acute Hypoxaemic Respiratory Failure Using Machine Learning: Model Development and External Validation.
Hongtao Cheng, Zichen Wang, Mei Feng, Yonglan Tang, Xiaoyu Zheng, Xiaoshen Zhang, Jun Lyu
{"title":"Predicting High-Flow Nasal Cannula Oxygen Therapy Failure in Patients With Acute Hypoxaemic Respiratory Failure Using Machine Learning: Model Development and External Validation.","authors":"Hongtao Cheng, Zichen Wang, Mei Feng, Yonglan Tang, Xiaoyu Zheng, Xiaoshen Zhang, Jun Lyu","doi":"10.1111/jocn.17518","DOIUrl":null,"url":null,"abstract":"<p><strong>Aims and objectives: </strong>To develop and validate a prediction model for high-flow nasal cannula (HFNC) failure in patients with acute hypoxaemic respiratory failure (AHRF).</p><p><strong>Background: </strong>AHRF accounts for a major proportion of intensive care unit (ICU) admissions and is associated with high mortality. HFNC is a non-invasive respiratory support technique that can improve patient oxygenation. However, HFNC failure, defined as the need for escalation to invasive mechanical ventilation, can lead to delayed intubation, prolonged mechanical ventilation and increased risk of mortality. Timely and accurate prediction of HFNC failure has important clinical implications. Machine learning (ML) can improve clinical prediction.</p><p><strong>Design: </strong>Multicentre observational study.</p><p><strong>Methods: </strong>This study analysed 581 patients from an academic medical centre in Boston and 180 patients from Guangzhou, China treated with HFNC for AHRF. The Boston dataset was randomly divided into a training set (90%, n = 522) and an internal validation set (10%, n = 59), and the model was externally validated using the Guangzhou dataset (n = 180). A random forest (RF)-based feature selection method was used to identify predictive factors. Nine machine learning algorithms were selected to build the predictive model. The area under the receiver operating characteristic curve (AUC) and performance evaluation parameters were used to evaluate the models.</p><p><strong>Results: </strong>The final model included 38 features selected using the RF method, with additional input from clinical specialists. Models based on ensemble learning outperformed other models (internal validation AUC: 0.83; external validation AUC: 0.75). Important predictors of HFNC failure include Glasgow Coma Scale scores and Sequential Organ Failure Assessment scores, albumin levels measured during HFNC treatment, ROX index at ICU admission and sepsis.</p><p><strong>Conclusions: </strong>This study developed an interpretable ML model that accurately predicts the risk of HFNC failure in patients with AHRF.</p><p><strong>Relevance to clinical practice: </strong>Clinicians and nurses can use ML models for early risk assessment and decision support in AHRF patients receiving HFNC.</p><p><strong>Reporting method: </strong>TRIPOD checklist for prediction model studies was followed in this study.</p><p><strong>Patient or public contribution: </strong>Patients were involved in the sample of the study.</p>","PeriodicalId":50236,"journal":{"name":"Journal of Clinical Nursing","volume":" ","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Clinical Nursing","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/jocn.17518","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NURSING","Score":null,"Total":0}
引用次数: 0
Abstract
Aims and objectives: To develop and validate a prediction model for high-flow nasal cannula (HFNC) failure in patients with acute hypoxaemic respiratory failure (AHRF).
Background: AHRF accounts for a major proportion of intensive care unit (ICU) admissions and is associated with high mortality. HFNC is a non-invasive respiratory support technique that can improve patient oxygenation. However, HFNC failure, defined as the need for escalation to invasive mechanical ventilation, can lead to delayed intubation, prolonged mechanical ventilation and increased risk of mortality. Timely and accurate prediction of HFNC failure has important clinical implications. Machine learning (ML) can improve clinical prediction.
Design: Multicentre observational study.
Methods: This study analysed 581 patients from an academic medical centre in Boston and 180 patients from Guangzhou, China treated with HFNC for AHRF. The Boston dataset was randomly divided into a training set (90%, n = 522) and an internal validation set (10%, n = 59), and the model was externally validated using the Guangzhou dataset (n = 180). A random forest (RF)-based feature selection method was used to identify predictive factors. Nine machine learning algorithms were selected to build the predictive model. The area under the receiver operating characteristic curve (AUC) and performance evaluation parameters were used to evaluate the models.
Results: The final model included 38 features selected using the RF method, with additional input from clinical specialists. Models based on ensemble learning outperformed other models (internal validation AUC: 0.83; external validation AUC: 0.75). Important predictors of HFNC failure include Glasgow Coma Scale scores and Sequential Organ Failure Assessment scores, albumin levels measured during HFNC treatment, ROX index at ICU admission and sepsis.
Conclusions: This study developed an interpretable ML model that accurately predicts the risk of HFNC failure in patients with AHRF.
Relevance to clinical practice: Clinicians and nurses can use ML models for early risk assessment and decision support in AHRF patients receiving HFNC.
Reporting method: TRIPOD checklist for prediction model studies was followed in this study.
Patient or public contribution: Patients were involved in the sample of the study.
期刊介绍:
The Journal of Clinical Nursing (JCN) is an international, peer reviewed, scientific journal that seeks to promote the development and exchange of knowledge that is directly relevant to all spheres of nursing practice. The primary aim is to promote a high standard of clinically related scholarship which advances and supports the practice and discipline of nursing. The Journal also aims to promote the international exchange of ideas and experience that draws from the different cultures in which practice takes place. Further, JCN seeks to enrich insight into clinical need and the implications for nursing intervention and models of service delivery. Emphasis is placed on promoting critical debate on the art and science of nursing practice.
JCN is essential reading for anyone involved in nursing practice, whether clinicians, researchers, educators, managers, policy makers, or students. The development of clinical practice and the changing patterns of inter-professional working are also central to JCN''s scope of interest. Contributions are welcomed from other health professionals on issues that have a direct impact on nursing practice.
We publish high quality papers from across the methodological spectrum that make an important and novel contribution to the field of clinical nursing (regardless of where care is provided), and which demonstrate clinical application and international relevance.