Mingyang Zhang , Xiangzhou Zhang , Mingyang Dai , Lijuan Wu , Kang Liu , Hongnian Wang , Weiqi Chen , Mei Liu , Yong Hu
{"title":"开发和验证用于知识协调的多因果调查和发现框架(MINDMerge):利用电子病历发现急性肾损伤风险因素的案例研究。","authors":"Mingyang Zhang , Xiangzhou Zhang , Mingyang Dai , Lijuan Wu , Kang Liu , Hongnian Wang , Weiqi Chen , Mei Liu , Yong Hu","doi":"10.1016/j.ijmedinf.2024.105588","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><p>Accurate diagnoses and personalized treatments in medicine rely on identifying causality. However, existing causal discovery algorithms often yield inconsistent results due to distinct learning mechanisms. To address this challenge, we introduce MINDMerge, a multi-causal investigation and discovery framework designed to synthesize causal graphs from various algorithms.</p></div><div><h3>Methods</h3><p>MINDMerge integrates five causal models to reconcile inconsistencies arising from different algorithms. Employing credibility weighting and a novel cycle-breaking mechanism in causal networks, we initially developed and tested MINDMerge using three synthetic networks. Subsequently, we validated its effectiveness in discovering risk factors and predicting acute kidney injury (AKI) using two electronic medical records (EMR) datasets, eICU Collaborative Research Database and MIMIC-III Database. Causal reasoning was employed to analyze the relationships between risk factors and AKI. The identified causal risk factors of AKI were used in building a prediction model, and the prediction model was evaluated using the area under the receiver operating characteristics curve (AUC) and recall.</p></div><div><h3>Results</h3><p>Synthetic data experiments demonstrated that our model outperformed significantly in capturing ground-truth network structure compared to other causal models. Application of MINDMerge on real-world data revealed direct connections of pulmonary disease, hypertension, diabetes, x-ray assessment, and BUN with AKI. With the identified variables, AKI risk can be inferred at the individual level based on established BNs and prior information. Compared against existing benchmark models, MINDMerge maintained a higher AUC for AKI prediction in both internal (AUC: 0.832) and external network validations (AUC: 0.861).</p></div><div><h3>Conclusion</h3><p>MINDMerge can identify causal risk factors of AKI, serving as a valuable diagnostic tool for clinical decision-making and facilitating effective intervention.</p></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"191 ","pages":"Article 105588"},"PeriodicalIF":3.7000,"publicationDate":"2024-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development and validation of a Multi-Causal investigation and discovery framework for knowledge harmonization (MINDMerge): A case study with acute kidney injury risk factor discovery using electronic medical records\",\"authors\":\"Mingyang Zhang , Xiangzhou Zhang , Mingyang Dai , Lijuan Wu , Kang Liu , Hongnian Wang , Weiqi Chen , Mei Liu , Yong Hu\",\"doi\":\"10.1016/j.ijmedinf.2024.105588\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objective</h3><p>Accurate diagnoses and personalized treatments in medicine rely on identifying causality. However, existing causal discovery algorithms often yield inconsistent results due to distinct learning mechanisms. To address this challenge, we introduce MINDMerge, a multi-causal investigation and discovery framework designed to synthesize causal graphs from various algorithms.</p></div><div><h3>Methods</h3><p>MINDMerge integrates five causal models to reconcile inconsistencies arising from different algorithms. Employing credibility weighting and a novel cycle-breaking mechanism in causal networks, we initially developed and tested MINDMerge using three synthetic networks. Subsequently, we validated its effectiveness in discovering risk factors and predicting acute kidney injury (AKI) using two electronic medical records (EMR) datasets, eICU Collaborative Research Database and MIMIC-III Database. Causal reasoning was employed to analyze the relationships between risk factors and AKI. The identified causal risk factors of AKI were used in building a prediction model, and the prediction model was evaluated using the area under the receiver operating characteristics curve (AUC) and recall.</p></div><div><h3>Results</h3><p>Synthetic data experiments demonstrated that our model outperformed significantly in capturing ground-truth network structure compared to other causal models. Application of MINDMerge on real-world data revealed direct connections of pulmonary disease, hypertension, diabetes, x-ray assessment, and BUN with AKI. With the identified variables, AKI risk can be inferred at the individual level based on established BNs and prior information. Compared against existing benchmark models, MINDMerge maintained a higher AUC for AKI prediction in both internal (AUC: 0.832) and external network validations (AUC: 0.861).</p></div><div><h3>Conclusion</h3><p>MINDMerge can identify causal risk factors of AKI, serving as a valuable diagnostic tool for clinical decision-making and facilitating effective intervention.</p></div>\",\"PeriodicalId\":54950,\"journal\":{\"name\":\"International Journal of Medical Informatics\",\"volume\":\"191 \",\"pages\":\"Article 105588\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-08-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Medical Informatics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S138650562400251X\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S138650562400251X","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
目的:医学中的精确诊断和个性化治疗依赖于因果关系的识别。然而,由于不同的学习机制,现有的因果发现算法往往产生不一致的结果。为了应对这一挑战,我们引入了 MINDMerge,这是一个多因果调查和发现框架,旨在综合各种算法的因果图:MINDMerge整合了五个因果模型,以调和不同算法产生的不一致性。通过在因果网络中采用可信度加权和新颖的循环打破机制,我们利用三个合成网络初步开发并测试了 MINDMerge。随后,我们利用两个电子病历(EMR)数据集,即 eICU 合作研究数据库和 MIMIC-III 数据库,验证了 MINDMerge 在发现风险因素和预测急性肾损伤(AKI)方面的有效性。利用因果推理分析了风险因素与 AKI 之间的关系。确定的 AKI 因果风险因素被用于建立预测模型,并使用接收者操作特征曲线下面积(AUC)和召回率对预测模型进行评估:合成数据实验表明,与其他因果模型相比,我们的模型在捕捉地面实况网络结构方面表现出色。在真实世界数据中应用 MINDMerge 发现了肺部疾病、高血压、糖尿病、X 光评估和血尿素氮与 AKI 的直接联系。有了确定的变量,就可以根据已建立的 BN 和先验信息推断出个体水平的 AKI 风险。与现有的基准模型相比,MINDMerge 在内部(AUC:0.832)和外部网络验证(AUC:0.861)中都保持了较高的 AKI 预测 AUC:结论:MINDMerge 可识别 AKI 的成因风险因素,是临床决策的重要诊断工具,有助于采取有效的干预措施。
Development and validation of a Multi-Causal investigation and discovery framework for knowledge harmonization (MINDMerge): A case study with acute kidney injury risk factor discovery using electronic medical records
Objective
Accurate diagnoses and personalized treatments in medicine rely on identifying causality. However, existing causal discovery algorithms often yield inconsistent results due to distinct learning mechanisms. To address this challenge, we introduce MINDMerge, a multi-causal investigation and discovery framework designed to synthesize causal graphs from various algorithms.
Methods
MINDMerge integrates five causal models to reconcile inconsistencies arising from different algorithms. Employing credibility weighting and a novel cycle-breaking mechanism in causal networks, we initially developed and tested MINDMerge using three synthetic networks. Subsequently, we validated its effectiveness in discovering risk factors and predicting acute kidney injury (AKI) using two electronic medical records (EMR) datasets, eICU Collaborative Research Database and MIMIC-III Database. Causal reasoning was employed to analyze the relationships between risk factors and AKI. The identified causal risk factors of AKI were used in building a prediction model, and the prediction model was evaluated using the area under the receiver operating characteristics curve (AUC) and recall.
Results
Synthetic data experiments demonstrated that our model outperformed significantly in capturing ground-truth network structure compared to other causal models. Application of MINDMerge on real-world data revealed direct connections of pulmonary disease, hypertension, diabetes, x-ray assessment, and BUN with AKI. With the identified variables, AKI risk can be inferred at the individual level based on established BNs and prior information. Compared against existing benchmark models, MINDMerge maintained a higher AUC for AKI prediction in both internal (AUC: 0.832) and external network validations (AUC: 0.861).
Conclusion
MINDMerge can identify causal risk factors of AKI, serving as a valuable diagnostic tool for clinical decision-making and facilitating effective intervention.
期刊介绍:
International Journal of Medical Informatics provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics. The Journal emphasizes the evaluation of systems in healthcare settings.
The scope of journal covers:
Information systems, including national or international registration systems, hospital information systems, departmental and/or physician''s office systems, document handling systems, electronic medical record systems, standardization, systems integration etc.;
Computer-aided medical decision support systems using heuristic, algorithmic and/or statistical methods as exemplified in decision theory, protocol development, artificial intelligence, etc.
Educational computer based programs pertaining to medical informatics or medicine in general;
Organizational, economic, social, clinical impact, ethical and cost-benefit aspects of IT applications in health care.