Multimodal heterogeneous graph fusion for automated obstructive sleep apnea-hypopnea syndrome diagnosis

IF 5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Complex & Intelligent Systems Pub Date : 2024-11-18 DOI:10.1007/s40747-024-01648-0
Haoyu Wang, Xihe Qiu, Bin Li, Xiaoyu Tan, Jingjing Huang
{"title":"Multimodal heterogeneous graph fusion for automated obstructive sleep apnea-hypopnea syndrome diagnosis","authors":"Haoyu Wang, Xihe Qiu, Bin Li, Xiaoyu Tan, Jingjing Huang","doi":"10.1007/s40747-024-01648-0","DOIUrl":null,"url":null,"abstract":"<p>Polysomnography is the diagnostic gold standard for obstructive sleep apnea-hypopnea syndrome (OSAHS), requiring medical professionals to analyze apnea-hypopnea events from multidimensional data throughout the sleep cycle. This complex process is susceptible to variability based on the clinician’s experience, leading to potential inaccuracies. Existing automatic diagnosis methods often overlook multimodal physiological signals and medical prior knowledge, leading to limited diagnostic capabilities. This study presents a novel <b>hetero</b>geneous <b>g</b>raph <b>c</b>onvolutional <b>f</b>usion <b>net</b>work (<b>HeteroGCFNet</b>) leveraging multimodal physiological signals and domain knowledge for automated OSAHS diagnosis. This framework constructs two types of graph representations: physical space graphs, which map the spatial layout of sensors on the human body, and process knowledge graphs which detail the physiological relationships among breathing patterns, oxygen saturation, and vital signals. The framework leverages heterogeneous graph convolutional neural networks to extract both localized and global features from these graphs. Additionally, a multi-head fusion module combines these features into a unified representation for effective classification, enhancing focus on relevant signal characteristics and cross-modal interactions. This study evaluated the proposed framework on a large-scale OSAHS dataset, combined from publicly available sources and data provided by a collaborative university hospital. It demonstrated superior diagnostic performance compared to conventional machine learning models and existing deep learning approaches, effectively integrating domain knowledge with data-driven learning to produce explainable representations and robust generalization capabilities, which can potentially be utilized for clinical use. Code is available at https://github.com/AmbitYuki/HeteroGCFNet.</p>","PeriodicalId":10524,"journal":{"name":"Complex & Intelligent Systems","volume":"17 1","pages":""},"PeriodicalIF":5.0000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Complex & Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s40747-024-01648-0","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Polysomnography is the diagnostic gold standard for obstructive sleep apnea-hypopnea syndrome (OSAHS), requiring medical professionals to analyze apnea-hypopnea events from multidimensional data throughout the sleep cycle. This complex process is susceptible to variability based on the clinician’s experience, leading to potential inaccuracies. Existing automatic diagnosis methods often overlook multimodal physiological signals and medical prior knowledge, leading to limited diagnostic capabilities. This study presents a novel heterogeneous graph convolutional fusion network (HeteroGCFNet) leveraging multimodal physiological signals and domain knowledge for automated OSAHS diagnosis. This framework constructs two types of graph representations: physical space graphs, which map the spatial layout of sensors on the human body, and process knowledge graphs which detail the physiological relationships among breathing patterns, oxygen saturation, and vital signals. The framework leverages heterogeneous graph convolutional neural networks to extract both localized and global features from these graphs. Additionally, a multi-head fusion module combines these features into a unified representation for effective classification, enhancing focus on relevant signal characteristics and cross-modal interactions. This study evaluated the proposed framework on a large-scale OSAHS dataset, combined from publicly available sources and data provided by a collaborative university hospital. It demonstrated superior diagnostic performance compared to conventional machine learning models and existing deep learning approaches, effectively integrating domain knowledge with data-driven learning to produce explainable representations and robust generalization capabilities, which can potentially be utilized for clinical use. Code is available at https://github.com/AmbitYuki/HeteroGCFNet.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于阻塞性睡眠呼吸暂停-低通气综合征自动诊断的多模态异构图融合技术
多导睡眠图是诊断阻塞性睡眠呼吸暂停-低通气综合征(OSAHS)的金标准,要求医疗专业人员从整个睡眠周期的多维数据中分析呼吸暂停-低通气事件。这一复杂的过程很容易因临床医生的经验而产生变化,从而导致潜在的不准确性。现有的自动诊断方法往往忽略了多模态生理信号和医学先验知识,导致诊断能力有限。本研究提出了一种新型异构图卷积融合网络(HeteroGCFNet),利用多模态生理信号和领域知识进行 OSAHS 自动诊断。该框架构建了两类图表示:物理空间图(映射人体传感器的空间布局)和过程知识图(详细描述呼吸模式、血氧饱和度和生命信号之间的生理关系)。该框架利用异构图卷积神经网络从这些图中提取局部和全局特征。此外,多头融合模块将这些特征组合成统一的表示形式,以进行有效分类,并加强对相关信号特征和跨模态交互的关注。本研究在大规模 OSAHS 数据集上对所提出的框架进行了评估,该数据集由公开来源和一家合作大学医院提供的数据组合而成。与传统的机器学习模型和现有的深度学习方法相比,它表现出了卓越的诊断性能,有效地整合了领域知识和数据驱动学习,产生了可解释的表征和强大的泛化能力,有望用于临床。代码见 https://github.com/AmbitYuki/HeteroGCFNet。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Complex & Intelligent Systems
Complex & Intelligent Systems COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-
CiteScore
9.60
自引率
10.30%
发文量
297
期刊介绍: Complex & Intelligent Systems aims to provide a forum for presenting and discussing novel approaches, tools and techniques meant for attaining a cross-fertilization between the broad fields of complex systems, computational simulation, and intelligent analytics and visualization. The transdisciplinary research that the journal focuses on will expand the boundaries of our understanding by investigating the principles and processes that underlie many of the most profound problems facing society today.
期刊最新文献
Towards fairness-aware multi-objective optimization Low-frequency spectral graph convolution networks with one-hop connections information for personalized tag recommendation A decentralized feedback-based consensus model considering the consistency maintenance and readability of probabilistic linguistic preference relations for large-scale group decision-making A dynamic preference recommendation model based on spatiotemporal knowledge graphs Pri-DDQN: learning adaptive traffic signal control strategy through a hybrid agent
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1