{"title":"利用胎儿心率和机器学习识别高风险早产妊娠","authors":"Gabriel Davis Jones, William Cooke, Manu Vatish","doi":"10.1101/2024.02.26.24303280","DOIUrl":null,"url":null,"abstract":"Introduction: Fetal heart rate (FHR) monitoring is one of the commonest and most affordable tests performed during pregnancy worldwide. It is critical for evaluating the health status of the baby, providing real-time insights into the physiology of the fetus. While the relationship between patterns in these signals and adverse pregnancy outcomes is well-established, human identification of these complex patterns remains sub-optimal, with experts often failing to recognise babies at high-risk of outcomes such as asphyxia, growth restriction and stillbirth. These outcomes are especially relevant in low- and middle-income countries where an estimated 98% of perinatal deaths occur. Pre-term birth complications are also the leading cause of death in children <5 years of age, 75% of which can be prevented. While advances have been made in developing low-cost digital solutions for antenatal fetal monitoring, there is still substantial progress to be made in developing tools for the identification of high-risk, adverse outcome pre-term pregnancies using these FHR systems. In this study, we have developed the first machine learning algorithm for the identification of high-risk preterm pregnancies with associated adverse outcomes using fetal heart rate monitoring. Methods: We sourced antepartum fetal heart rate traces from high-risk, pre-term pregnancies that were assigned at least one of ten adverse conditions. These were matched with normal pregnancies delivered at term. Using an automated, clinically-validated algorithm, seven distinct fetal heart rate patterns were extracted from each trace, subsequently filtered for outliers and normalized. The data were split into 80% for model development and 20% for validation. Six machine learning algorithms were trained using k-fold cross-validation to identify each trace as either normal or high-risk preterm. The best-performing algorithm was further evaluated using the validation dataset based on metrics including the AUC, sensitivity, and specificity at three distinct classification thresholds. Additional assessments included decision curve analysis and gestational age-specific and outcome-specific performance evaluations. Results: We analysed antepartum fetal heart rate recordings from 4,867 high-risk, pre-term pregnancies with adverse outcomes and 4,014 normal pregnancies. Feature extraction and preprocessing revealed significant differences between the groups (p<0.001). The random forest classifier was the most effective model, achieving an AUC of 0.88 (95% CI 0.87-0.88). When evaluating specific adverse outcomes, the median AUC was 0.85 (IQR 0.81-0.89) and the model consistently exceeded an AUC of 0.80 across all gestational ages. The model's robustness was confirmed on the validation dataset with an AUC of 0.88 (95% CI 0.86-0.90) and a Brier score of 0.14. Decision curve analysis showed the model surpassed both the treat-none and treat-all strategies over most probability thresholds (0.11-1.0). Performance metrics when using the Youden index were as follows: sensitivity 76.2% (95% CI 72.6-80.5%), specificity 87.5% (95% CI 83.3-91.0), F1 score 81.7 (95% CI 79.6-83.9), and Cohen's kappa 62.8 (95% CI 59.6-66.4), indicating high discriminative ability between pregnancy outcomes. Conclusions: Our study successfully demonstrated machine learning algorithms are capable of identifying high-risk preterm pregnancies with associated adverse outcomes through fetal heart rate monitoring. These findings demonstrate the potential of machine learning in enhancing the accuracy and effectiveness of antenatal fetal monitoring, particularly for high-risk cases where timely intervention is crucial. This algorithm could substantially improve pregnancy outcome prediction and consequently, maternal and neonatal care, especially in low- to middle-income countries where the burden of adverse outcomes is high.","PeriodicalId":501409,"journal":{"name":"medRxiv - Obstetrics and Gynecology","volume":"77 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Identifying high-risk pre-term pregnancies using the fetal heart rate and machine learning\",\"authors\":\"Gabriel Davis Jones, William Cooke, Manu Vatish\",\"doi\":\"10.1101/2024.02.26.24303280\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Introduction: Fetal heart rate (FHR) monitoring is one of the commonest and most affordable tests performed during pregnancy worldwide. It is critical for evaluating the health status of the baby, providing real-time insights into the physiology of the fetus. While the relationship between patterns in these signals and adverse pregnancy outcomes is well-established, human identification of these complex patterns remains sub-optimal, with experts often failing to recognise babies at high-risk of outcomes such as asphyxia, growth restriction and stillbirth. These outcomes are especially relevant in low- and middle-income countries where an estimated 98% of perinatal deaths occur. Pre-term birth complications are also the leading cause of death in children <5 years of age, 75% of which can be prevented. While advances have been made in developing low-cost digital solutions for antenatal fetal monitoring, there is still substantial progress to be made in developing tools for the identification of high-risk, adverse outcome pre-term pregnancies using these FHR systems. In this study, we have developed the first machine learning algorithm for the identification of high-risk preterm pregnancies with associated adverse outcomes using fetal heart rate monitoring. Methods: We sourced antepartum fetal heart rate traces from high-risk, pre-term pregnancies that were assigned at least one of ten adverse conditions. These were matched with normal pregnancies delivered at term. Using an automated, clinically-validated algorithm, seven distinct fetal heart rate patterns were extracted from each trace, subsequently filtered for outliers and normalized. The data were split into 80% for model development and 20% for validation. Six machine learning algorithms were trained using k-fold cross-validation to identify each trace as either normal or high-risk preterm. The best-performing algorithm was further evaluated using the validation dataset based on metrics including the AUC, sensitivity, and specificity at three distinct classification thresholds. Additional assessments included decision curve analysis and gestational age-specific and outcome-specific performance evaluations. Results: We analysed antepartum fetal heart rate recordings from 4,867 high-risk, pre-term pregnancies with adverse outcomes and 4,014 normal pregnancies. Feature extraction and preprocessing revealed significant differences between the groups (p<0.001). The random forest classifier was the most effective model, achieving an AUC of 0.88 (95% CI 0.87-0.88). When evaluating specific adverse outcomes, the median AUC was 0.85 (IQR 0.81-0.89) and the model consistently exceeded an AUC of 0.80 across all gestational ages. The model's robustness was confirmed on the validation dataset with an AUC of 0.88 (95% CI 0.86-0.90) and a Brier score of 0.14. Decision curve analysis showed the model surpassed both the treat-none and treat-all strategies over most probability thresholds (0.11-1.0). Performance metrics when using the Youden index were as follows: sensitivity 76.2% (95% CI 72.6-80.5%), specificity 87.5% (95% CI 83.3-91.0), F1 score 81.7 (95% CI 79.6-83.9), and Cohen's kappa 62.8 (95% CI 59.6-66.4), indicating high discriminative ability between pregnancy outcomes. Conclusions: Our study successfully demonstrated machine learning algorithms are capable of identifying high-risk preterm pregnancies with associated adverse outcomes through fetal heart rate monitoring. These findings demonstrate the potential of machine learning in enhancing the accuracy and effectiveness of antenatal fetal monitoring, particularly for high-risk cases where timely intervention is crucial. This algorithm could substantially improve pregnancy outcome prediction and consequently, maternal and neonatal care, especially in low- to middle-income countries where the burden of adverse outcomes is high.\",\"PeriodicalId\":501409,\"journal\":{\"name\":\"medRxiv - Obstetrics and Gynecology\",\"volume\":\"77 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-02-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"medRxiv - Obstetrics and Gynecology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1101/2024.02.26.24303280\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Obstetrics and Gynecology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.02.26.24303280","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
简介胎儿心率(FHR)监测是全球最常见、最经济实惠的孕期检查之一。它对评估胎儿的健康状况至关重要,能实时了解胎儿的生理状况。虽然这些信号的模式与不良妊娠结局之间的关系已得到证实,但人类对这些复杂模式的识别能力仍未达到最佳水平,专家们往往无法识别窒息、生长受限和死胎等高风险胎儿。这些结果与中低收入国家的关系尤为密切,估计有 98% 的围产期死亡发生在这些国家。早产并发症也是导致 5 岁儿童死亡的主要原因,其中 75% 是可以预防的。虽然在开发用于产前胎儿监护的低成本数字解决方案方面取得了进展,但在开发使用这些 FHR 系统识别高风险、不良结局早产妊娠的工具方面仍有待取得重大进展。在本研究中,我们开发了首个机器学习算法,利用胎儿心率监测识别高风险早产及相关不良结局。研究方法我们从高危早产孕妇的产前胎心率追踪中获取了至少十种不良情况中的一种。这些孕妇与足月分娩的正常孕妇进行了比对。使用经临床验证的自动算法,从每个跟踪数据中提取出七种不同的胎儿心率模式,随后过滤异常值并进行归一化处理。数据分为 80% 用于模型开发,20% 用于验证。使用 k 倍交叉验证对六种机器学习算法进行了训练,以将每个迹线识别为正常或高风险早产。根据三个不同分类阈值下的 AUC、灵敏度和特异性等指标,使用验证数据集对表现最佳的算法进行了进一步评估。其他评估包括决策曲线分析以及特定孕龄和特定结果的性能评估。结果:我们分析了产前胎儿心率记录,这些记录来自 4867 例有不良预后的高危早产妊娠和 4014 例正常妊娠。特征提取和预处理显示两组之间存在显著差异(p<0.001)。随机森林分类器是最有效的模型,AUC 为 0.88(95% CI 0.87-0.88)。在评估特定不良结局时,AUC 的中位数为 0.85(IQR 0.81-0.89),该模型在所有妊娠年龄段的 AUC 均超过了 0.80。该模型的稳健性在验证数据集上得到了证实,AUC 为 0.88 (95% CI 0.86-0.90),Brier 得分为 0.14。决策曲线分析表明,在大多数概率阈值(0.11-1.0)上,该模型都超过了 "不治疗 "和 "全部治疗 "策略。使用 Youden 指数的性能指标如下:灵敏度 76.2% (95% CI 72.6-80.5%)、特异度 87.5% (95% CI 83.3-91.0)、F1 分数 81.7 (95% CI 79.6-83.9)、Cohen's kappa 62.8 (95% CI 59.6-66.4),表明妊娠结局之间具有很高的鉴别能力。结论我们的研究成功地证明了机器学习算法能够通过胎儿心率监测识别高风险早产妊娠及相关不良妊娠结局。这些研究结果证明了机器学习在提高产前胎儿监护的准确性和有效性方面的潜力,尤其是对于及时干预至关重要的高风险病例。这种算法可以大大改善妊娠结局预测,从而改善孕产妇和新生儿护理,尤其是在不良结局负担较重的中低收入国家。
Identifying high-risk pre-term pregnancies using the fetal heart rate and machine learning
Introduction: Fetal heart rate (FHR) monitoring is one of the commonest and most affordable tests performed during pregnancy worldwide. It is critical for evaluating the health status of the baby, providing real-time insights into the physiology of the fetus. While the relationship between patterns in these signals and adverse pregnancy outcomes is well-established, human identification of these complex patterns remains sub-optimal, with experts often failing to recognise babies at high-risk of outcomes such as asphyxia, growth restriction and stillbirth. These outcomes are especially relevant in low- and middle-income countries where an estimated 98% of perinatal deaths occur. Pre-term birth complications are also the leading cause of death in children <5 years of age, 75% of which can be prevented. While advances have been made in developing low-cost digital solutions for antenatal fetal monitoring, there is still substantial progress to be made in developing tools for the identification of high-risk, adverse outcome pre-term pregnancies using these FHR systems. In this study, we have developed the first machine learning algorithm for the identification of high-risk preterm pregnancies with associated adverse outcomes using fetal heart rate monitoring. Methods: We sourced antepartum fetal heart rate traces from high-risk, pre-term pregnancies that were assigned at least one of ten adverse conditions. These were matched with normal pregnancies delivered at term. Using an automated, clinically-validated algorithm, seven distinct fetal heart rate patterns were extracted from each trace, subsequently filtered for outliers and normalized. The data were split into 80% for model development and 20% for validation. Six machine learning algorithms were trained using k-fold cross-validation to identify each trace as either normal or high-risk preterm. The best-performing algorithm was further evaluated using the validation dataset based on metrics including the AUC, sensitivity, and specificity at three distinct classification thresholds. Additional assessments included decision curve analysis and gestational age-specific and outcome-specific performance evaluations. Results: We analysed antepartum fetal heart rate recordings from 4,867 high-risk, pre-term pregnancies with adverse outcomes and 4,014 normal pregnancies. Feature extraction and preprocessing revealed significant differences between the groups (p<0.001). The random forest classifier was the most effective model, achieving an AUC of 0.88 (95% CI 0.87-0.88). When evaluating specific adverse outcomes, the median AUC was 0.85 (IQR 0.81-0.89) and the model consistently exceeded an AUC of 0.80 across all gestational ages. The model's robustness was confirmed on the validation dataset with an AUC of 0.88 (95% CI 0.86-0.90) and a Brier score of 0.14. Decision curve analysis showed the model surpassed both the treat-none and treat-all strategies over most probability thresholds (0.11-1.0). Performance metrics when using the Youden index were as follows: sensitivity 76.2% (95% CI 72.6-80.5%), specificity 87.5% (95% CI 83.3-91.0), F1 score 81.7 (95% CI 79.6-83.9), and Cohen's kappa 62.8 (95% CI 59.6-66.4), indicating high discriminative ability between pregnancy outcomes. Conclusions: Our study successfully demonstrated machine learning algorithms are capable of identifying high-risk preterm pregnancies with associated adverse outcomes through fetal heart rate monitoring. These findings demonstrate the potential of machine learning in enhancing the accuracy and effectiveness of antenatal fetal monitoring, particularly for high-risk cases where timely intervention is crucial. This algorithm could substantially improve pregnancy outcome prediction and consequently, maternal and neonatal care, especially in low- to middle-income countries where the burden of adverse outcomes is high.