首页 > 最新文献

Computer methods and programs in biomedicine最新文献

英文 中文
Multi-modal networks for real-time monitoring of intracranial acoustic field during transcranial focused ultrasound therapy 用于实时监测经颅聚焦超声治疗过程中颅内声场的多模态网络。
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-15 DOI: 10.1016/j.cmpb.2024.108458
Minjee Seo , Minwoo Shin , Gunwoo Noh , Seung-Schik Yoo , Kyungho Yoon

Background and objective:

Transcranial focused ultrasound (tFUS) is an emerging non-invasive therapeutic technology that offers new brain stimulation modality. Precise localization of the acoustic focus to the desired brain target throughout the procedure is needed to ensure the safety and effectiveness of the treatment, but acoustic distortion caused by the skull poses a challenge. Although computational methods can provide the estimated location and shape of the focus, the computation has not reached sufficient speed for real-time inference, which is demanded in real-world clinical situations. Leveraging the advantages of deep learning, we propose multi-modal networks capable of generating intracranial pressure map in real-time.

Methods:

The dataset consisted of free-field pressure maps, intracranial pressure maps, medical images, and transducer placements was obtained from 11 human subjects. The free-field and intracranial pressure maps were computed using the k-space method. We developed network models based on convolutional neural networks and the Swin Transformer, featuring a multi-modal encoder and a decoder.

Results:

Evaluations on foreseen data achieved high focal volume conformity of approximately 93% for both computed tomography (CT) and magnetic resonance (MR) data. For unforeseen data, the networks achieved the focal volume conformity of 88% for CT and 82% for MR. The inference time of the proposed networks was under 0.02 s, indicating the feasibility for real-time simulation.

Conclusions:

The results indicate that our networks can effectively and precisely perform real-time simulation of the intracranial pressure map during tFUS applications. Our work will enhance the safety and accuracy of treatments, representing significant progress for low-intensity focused ultrasound (LIFU) therapies.
背景和目的:经颅聚焦超声(tFUS)是一种新兴的非侵入性治疗技术,提供了新的脑刺激模式。为了确保治疗的安全性和有效性,需要在整个治疗过程中将声波焦点精确定位到所需的脑部目标,但头骨造成的声波失真是一项挑战。虽然计算方法可以提供病灶的估计位置和形状,但计算速度还不足以满足实时推断的要求,而这正是真实世界临床情况所需要的。利用深度学习的优势,我们提出了能够实时生成颅内压力图的多模态网络:数据集由自由声场压力图、颅内压力图、医学影像和传感器位置组成,数据来自 11 名人体受试者。自由声场和颅内压图采用 k 空间法计算。我们开发了基于卷积神经网络和 Swin Transformer 的网络模型,其中包括一个多模式编码器和一个解码器:结果:对可预见数据的评估结果显示,计算机断层扫描(CT)和磁共振(MR)数据的病灶体积一致性高达 93%。对于未预见的数据,网络在 CT 和 MR 上的病灶体积符合率分别为 88% 和 82%。提出的网络推理时间小于 0.02 秒,表明了实时模拟的可行性:结果表明,我们的网络可以在 tFUS 应用过程中有效、精确地对颅内压图进行实时模拟。我们的工作将提高治疗的安全性和准确性,是低强度聚焦超声疗法(LIFU)的重大进展。
{"title":"Multi-modal networks for real-time monitoring of intracranial acoustic field during transcranial focused ultrasound therapy","authors":"Minjee Seo ,&nbsp;Minwoo Shin ,&nbsp;Gunwoo Noh ,&nbsp;Seung-Schik Yoo ,&nbsp;Kyungho Yoon","doi":"10.1016/j.cmpb.2024.108458","DOIUrl":"10.1016/j.cmpb.2024.108458","url":null,"abstract":"<div><h3>Background and objective:</h3><div>Transcranial focused ultrasound (tFUS) is an emerging non-invasive therapeutic technology that offers new brain stimulation modality. Precise localization of the acoustic focus to the desired brain target throughout the procedure is needed to ensure the safety and effectiveness of the treatment, but acoustic distortion caused by the skull poses a challenge. Although computational methods can provide the estimated location and shape of the focus, the computation has not reached sufficient speed for real-time inference, which is demanded in real-world clinical situations. Leveraging the advantages of deep learning, we propose multi-modal networks capable of generating intracranial pressure map in real-time.</div></div><div><h3>Methods:</h3><div>The dataset consisted of free-field pressure maps, intracranial pressure maps, medical images, and transducer placements was obtained from 11 human subjects. The free-field and intracranial pressure maps were computed using the <em>k</em>-space method. We developed network models based on convolutional neural networks and the Swin Transformer, featuring a multi-modal encoder and a decoder.</div></div><div><h3>Results:</h3><div>Evaluations on foreseen data achieved high focal volume conformity of approximately 93% for both computed tomography (CT) and magnetic resonance (MR) data. For unforeseen data, the networks achieved the focal volume conformity of 88% for CT and 82% for MR. The inference time of the proposed networks was under 0.02 s, indicating the feasibility for real-time simulation.</div></div><div><h3>Conclusions:</h3><div>The results indicate that our networks can effectively and precisely perform real-time simulation of the intracranial pressure map during tFUS applications. Our work will enhance the safety and accuracy of treatments, representing significant progress for low-intensity focused ultrasound (LIFU) therapies.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108458"},"PeriodicalIF":4.9,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142496560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Concurrent photothermal therapy and nuclear magnetic resonance imaging with plasmonic–magnetic nanoparticles: A numerical study 利用等离子体磁性纳米粒子同时进行光热治疗和核磁共振成像:数值研究。
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-11 DOI: 10.1016/j.cmpb.2024.108453
C. Rousseau , Q.L. Vuong , Y. Gossuin , B. Maes , G. Rosolen

Background and Objective

: Theranostics is the combination of the diagnostic and therapeutic phases. Here we focus on simultaneous use of photothermal therapy and magnetic resonance imaging, employing a contrast-photothermal agent that converts incident light into heat and affects the transverse relaxation time, a key magnetic resonance imaging parameter. Our work considers a gold–magnetite nanoshell platform to gauge the feasibility of magnetic resonance imaging monitoring of the heating associated with phototherapy, by studying the modification of the transverse relaxation rate induced by laser illumination of a solution containing these hybrid nanoparticles.

Methods:

We simulate a system composed of an aqueous solution with hybrid nanoshells under continuous laser irradiation, enabling the evaluation of spatial variations of the transverse relaxation rate within the sample. We work with the hybrid nanoshell platform comprising a metal/gold shell for thermoplasmonic effects and a magnetite core for magnetic resonance imaging contrast enhancement. The optical properties of the nanoshells are first obtained through simulations using the finite element method. Next, the heating generated by the laser illumination is calculated by numerical integration. Finally, the transverse relaxation rate is obtained through the application of an analytical model. Additionally, we conduct an optimization of the nanoshell geometry to fulfill requirements of both magnetic resonance imaging and phototherapy techniques.

Results:

Our findings demonstrate a narrow range of nanoshell sizes exhibiting both a plasmonic absorption peak in the human biological window and a high response to laser illumination of the transverse relaxation rate. Furthermore, the illumination can induce up to a 30% modification in transverse relaxation rate compared to the non-illuminated scenario in this range of nanoshell sizes.

Conclusions:

In this work we establish the numerical understanding of the interplay between phototherapy and nuclear magnetic resonance imaging when employed concurrently. This allows magnetic resonance imaging monitoring of the heating associated with phototherapy.
背景和目的:治疗学是诊断和治疗阶段的结合。在此,我们将重点放在同时使用光热疗法和磁共振成像上,采用一种对比光热剂,它能将入射光转化为热量,并影响横向弛豫时间,而横向弛豫时间是磁共振成像的一个关键参数。我们的研究考虑了金磁铁矿纳米壳平台,通过研究激光照射含有这些混合纳米粒子的溶液所引起的横向弛豫速率的变化,来衡量磁共振成像监测与光疗相关的加热的可行性:我们模拟了一个由水溶液和混合纳米壳组成的系统在连续激光照射下的情况,从而能够评估样品内横向弛豫速率的空间变化。我们使用的混合纳米壳平台由用于热声效应的金属/金壳和用于增强磁共振成像对比度的磁铁矿核组成。我们首先使用有限元法模拟纳米壳的光学特性。然后,通过数值积分计算激光照射产生的热量。最后,通过应用分析模型获得横向弛豫速率。此外,我们还对纳米壳的几何形状进行了优化,以满足磁共振成像和光疗技术的要求:结果:我们的研究结果表明,纳米壳的尺寸范围很窄,既能在人体生物窗口显示出等离子吸收峰,又能对激光照射的横向弛豫率做出很高的响应。此外,在这一纳米壳尺寸范围内,与未照射的情况相比,照射可使横向弛豫率改变多达 30%:在这项工作中,我们从数值上理解了光疗与核磁共振成像同时使用时的相互作用。这使得磁共振成像可以监测与光疗相关的加热。
{"title":"Concurrent photothermal therapy and nuclear magnetic resonance imaging with plasmonic–magnetic nanoparticles: A numerical study","authors":"C. Rousseau ,&nbsp;Q.L. Vuong ,&nbsp;Y. Gossuin ,&nbsp;B. Maes ,&nbsp;G. Rosolen","doi":"10.1016/j.cmpb.2024.108453","DOIUrl":"10.1016/j.cmpb.2024.108453","url":null,"abstract":"<div><h3>Background and Objective</h3><div>: Theranostics is the combination of the diagnostic and therapeutic phases. Here we focus on simultaneous use of photothermal therapy and magnetic resonance imaging, employing a contrast-photothermal agent that converts incident light into heat and affects the transverse relaxation time, a key magnetic resonance imaging parameter. Our work considers a gold–magnetite nanoshell platform to gauge the feasibility of magnetic resonance imaging monitoring of the heating associated with phototherapy, by studying the modification of the transverse relaxation rate induced by laser illumination of a solution containing these hybrid nanoparticles.</div></div><div><h3>Methods:</h3><div>We simulate a system composed of an aqueous solution with hybrid nanoshells under continuous laser irradiation, enabling the evaluation of spatial variations of the transverse relaxation rate within the sample. We work with the hybrid nanoshell platform comprising a metal/gold shell for thermoplasmonic effects and a magnetite core for magnetic resonance imaging contrast enhancement. The optical properties of the nanoshells are first obtained through simulations using the finite element method. Next, the heating generated by the laser illumination is calculated by numerical integration. Finally, the transverse relaxation rate is obtained through the application of an analytical model. Additionally, we conduct an optimization of the nanoshell geometry to fulfill requirements of both magnetic resonance imaging and phototherapy techniques.</div></div><div><h3>Results:</h3><div>Our findings demonstrate a narrow range of nanoshell sizes exhibiting both a plasmonic absorption peak in the human biological window and a high response to laser illumination of the transverse relaxation rate. Furthermore, the illumination can induce up to a 30% modification in transverse relaxation rate compared to the non-illuminated scenario in this range of nanoshell sizes.</div></div><div><h3>Conclusions:</h3><div>In this work we establish the numerical understanding of the interplay between phototherapy and nuclear magnetic resonance imaging when employed concurrently. This allows magnetic resonance imaging monitoring of the heating associated with phototherapy.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108453"},"PeriodicalIF":4.9,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142459887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Early prediction of sudden cardiac death using multimodal fusion of ECG Features extracted from Hilbert–Huang and wavelet transforms with explainable vision transformer and CNN models 利用从希尔伯特-黄变换和小波变换中提取的心电图特征与可解释视觉变换器和 CNN 模型的多模态融合,对心脏性猝死进行早期预测。
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-11 DOI: 10.1016/j.cmpb.2024.108455
Hardik Telangore , Victor Azad , Manish Sharma , Ankit Bhurane , Ru San Tan , U. Rajendra Acharya

Background and Objective:

Sudden cardiac death (SCD) is a critical health issue characterized by the sudden failure of heart function, often caused by ventricular fibrillation (VF). Early prediction of SCD is crucial to enable timely interventions. However, current methods predict SCD only a few minutes before its onset, limiting intervention time. This study aims to develop a deep learning-based model for the early prediction of SCD using electrocardiography (ECG) signals.

Methods:

A multimodal explainable deep learning-based model is developed to analyze ECG signals at discrete intervals ranging from 5 to 30 min before SCD onset. The raw ECG signals, 2D scalograms generated through wavelet transform and 2D Hilbert spectrum generated through Hilbert–Huang transform (HHT) of ECG signals were applied to multiple deep learning algorithms. For raw ECG, a combination of 1D-convolutional neural networks (1D-CNN) and long short-term memory networks were employed for feature extraction and temporal pattern recognition. Besides, to extract and analyze features from scalograms and Hilbert spectra, Vision Transformer (ViT) and 2D-CNN have been used.

Results:

The developed model achieved high performance, with accuracy, precision, recall and F1-score of 98.81%, 98.83%, 98.81%, and 98.81% respectively to predict SCD onset 30 min in advance. Further, the proposed model can accurately classify SCD patients and normal controls with 100% accuracy. Thus, the proposed method outperforms the existing state-of-the-art methods.

Conclusions:

The developed model is capable of capturing diverse patterns on ECG signals recorded at multiple discrete time intervals (at 5-minute increments from 5 min to 30 min) prior to SCD onset that could discriminate for SCD. The proposed model significantly improves early SCD prediction, providing a valuable tool for continuous ECG monitoring in high-risk patients.
背景和目的:心脏性猝死(SCD)是一个严重的健康问题,其特点是心脏功能突然衰竭,通常由心室颤动(VF)引起。早期预测 SCD 对及时干预至关重要。然而,目前的方法只能在 SCD 发生前几分钟进行预测,从而限制了干预时间。本研究旨在开发一种基于深度学习的模型,利用心电图(ECG)信号对 SCD 进行早期预测:方法:开发了一种基于多模态可解释深度学习的模型,用于分析 SCD 发病前 5 至 30 分钟不连续时间间隔的心电信号。将原始心电信号、通过小波变换生成的二维扫描图以及通过心电信号的希尔伯特-黄变换(HHT)生成的二维希尔伯特频谱应用于多种深度学习算法。对于原始心电图,采用一维卷积神经网络(1D-CNN)和长短期记忆网络相结合的方法进行特征提取和时间模式识别。此外,为了从扫描图和希尔伯特频谱中提取和分析特征,还使用了视觉变换器(ViT)和二维神经网络:所开发的模型在提前 30 分钟预测 SCD 发病方面取得了较高的性能,准确率、精确率、召回率和 F1 分数分别为 98.81%、98.83%、98.81% 和 98.81%。此外,所提出的模型还能准确地对 SCD 患者和正常对照组进行分类,准确率达到 100%。因此,所提出的方法优于现有的最先进方法:所开发的模型能够捕捉到 SCD 发病前多个离散时间间隔(从 5 分钟到 30 分钟,以 5 分钟为增量)记录的心电信号上的各种模式,从而对 SCD 进行鉴别。所提出的模型大大提高了早期 SCD 的预测能力,为高危患者的连续心电图监测提供了宝贵的工具。
{"title":"Early prediction of sudden cardiac death using multimodal fusion of ECG Features extracted from Hilbert–Huang and wavelet transforms with explainable vision transformer and CNN models","authors":"Hardik Telangore ,&nbsp;Victor Azad ,&nbsp;Manish Sharma ,&nbsp;Ankit Bhurane ,&nbsp;Ru San Tan ,&nbsp;U. Rajendra Acharya","doi":"10.1016/j.cmpb.2024.108455","DOIUrl":"10.1016/j.cmpb.2024.108455","url":null,"abstract":"<div><h3>Background and Objective:</h3><div>Sudden cardiac death (SCD) is a critical health issue characterized by the sudden failure of heart function, often caused by ventricular fibrillation (VF). Early prediction of SCD is crucial to enable timely interventions. However, current methods predict SCD only a few minutes before its onset, limiting intervention time. This study aims to develop a deep learning-based model for the early prediction of SCD using electrocardiography (ECG) signals.</div></div><div><h3>Methods:</h3><div>A multimodal explainable deep learning-based model is developed to analyze ECG signals at discrete intervals ranging from 5 to 30 min before SCD onset. The raw ECG signals, 2D scalograms generated through wavelet transform and 2D Hilbert spectrum generated through Hilbert–Huang transform (HHT) of ECG signals were applied to multiple deep learning algorithms. For raw ECG, a combination of 1D-convolutional neural networks (1D-CNN) and long short-term memory networks were employed for feature extraction and temporal pattern recognition. Besides, to extract and analyze features from scalograms and Hilbert spectra, Vision Transformer (ViT) and 2D-CNN have been used.</div></div><div><h3>Results:</h3><div>The developed model achieved high performance, with accuracy, precision, recall and F1-score of 98.81%, 98.83%, 98.81%, and 98.81% respectively to predict SCD onset 30 min in advance. Further, the proposed model can accurately classify SCD patients and normal controls with 100% accuracy. Thus, the proposed method outperforms the existing state-of-the-art methods.</div></div><div><h3>Conclusions:</h3><div>The developed model is capable of capturing diverse patterns on ECG signals recorded at multiple discrete time intervals (at 5-minute increments from 5 min to 30 min) prior to SCD onset that could discriminate for SCD. The proposed model significantly improves early SCD prediction, providing a valuable tool for continuous ECG monitoring in high-risk patients.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108455"},"PeriodicalIF":4.9,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142496558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Direct MultiSearch optimization of TPMS scaffolds for bone tissue engineering 直接多搜索优化用于骨组织工程的 TPMS 支架
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-11 DOI: 10.1016/j.cmpb.2024.108461
T.H.V. Pires , J.F.A. Madeira , A.P.G. Castro , P.R. Fernandes

Background

Scaffolds designed for tissue engineering must consider multiple parameters, namely the permeability of the design and the wall shear stress experienced by the cells on the scaffold surface. However, these parameters are not independent from each other, with changes that improve wall shear stress, negatively impacting permeability and vice versa. This study introduces a novel multi-objective optimization framework using Direct MultiSearch (DMS) to design triply periodic minimal surface (TPMS) scaffolds for bone tissue engineering.

Method

The optimization algorithm focused on maximizing the permeability of the scaffolds and obtaining a desired value of average wall shear stress (which ranges between the values that promote osteogenic differentiation of 0.1 mPa and 10 mPa). Multiple fluid inlet velocities and target wall shear stress were analyzed. The DMS method successfully generated Pareto fronts for each configuration, enabling the selection of optimized scaffolds based on specific structural requirements.

Results

The findings reveal that increasing the target wall shear stress results in a greater number of non-dominated points on the Pareto front, highlighting a more robust optimization process. Additionally, it was also demonstrated that the tested Schwartz diamond scaffolds had a better permeability-wall shear stress relation when compared to Schoen gyroid geometries.

Conclusions

Direct MultiSearch was proven as an effective tool to aid in the design of tissue engineering scaffolds. This adaptable optimization framework has potential applications beyond bone tissue engineering, including cartilage tissue differentiation.
背景设计用于组织工程的支架必须考虑多个参数,即设计的渗透性和支架表面细胞所承受的壁剪应力。然而,这些参数并不是相互独立的,改变这些参数会提高壁剪应力,对渗透性产生负面影响,反之亦然。本研究利用直接多搜索(DMS)引入了一种新型多目标优化框架,用于设计骨组织工程中的三重周期性最小表面(TPMS)支架。方法优化算法的重点是最大化支架的渗透性,并获得所需的平均壁剪应力值(介于促进成骨分化的 0.1 mPa 和 10 mPa 之间)。对多种流体入口速度和目标壁面剪切应力进行了分析。结果研究结果表明,增加目标壁剪切应力会导致帕累托前沿出现更多的非优势点,从而突出了更稳健的优化过程。此外,研究还表明,与 Schoen gyroid 几何结构相比,测试的 Schwartz 钻石支架具有更好的渗透性-壁剪应力关系。这种适应性强的优化框架具有潜在的应用前景,不仅适用于骨组织工程,还适用于软骨组织分化。
{"title":"Direct MultiSearch optimization of TPMS scaffolds for bone tissue engineering","authors":"T.H.V. Pires ,&nbsp;J.F.A. Madeira ,&nbsp;A.P.G. Castro ,&nbsp;P.R. Fernandes","doi":"10.1016/j.cmpb.2024.108461","DOIUrl":"10.1016/j.cmpb.2024.108461","url":null,"abstract":"<div><h3>Background</h3><div>Scaffolds designed for tissue engineering must consider multiple parameters, namely the permeability of the design and the wall shear stress experienced by the cells on the scaffold surface. However, these parameters are not independent from each other, with changes that improve wall shear stress, negatively impacting permeability and vice versa. This study introduces a novel multi-objective optimization framework using Direct MultiSearch (DMS) to design triply periodic minimal surface (TPMS) scaffolds for bone tissue engineering.</div></div><div><h3>Method</h3><div>The optimization algorithm focused on maximizing the permeability of the scaffolds and obtaining a desired value of average wall shear stress (which ranges between the values that promote osteogenic differentiation of 0.1 mPa and 10 mPa). Multiple fluid inlet velocities and target wall shear stress were analyzed. The DMS method successfully generated Pareto fronts for each configuration, enabling the selection of optimized scaffolds based on specific structural requirements.</div></div><div><h3>Results</h3><div>The findings reveal that increasing the target wall shear stress results in a greater number of non-dominated points on the Pareto front, highlighting a more robust optimization process. Additionally, it was also demonstrated that the tested Schwartz diamond scaffolds had a better permeability-wall shear stress relation when compared to Schoen gyroid geometries.</div></div><div><h3>Conclusions</h3><div>Direct MultiSearch was proven as an effective tool to aid in the design of tissue engineering scaffolds. This adaptable optimization framework has potential applications beyond bone tissue engineering, including cartilage tissue differentiation.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108461"},"PeriodicalIF":4.9,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142441512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing the impact of ultrasound image standardization in deep learning-based segmentation of carotid plaque types 评估超声图像标准化对基于深度学习的颈动脉斑块类型分割的影响。
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-10 DOI: 10.1016/j.cmpb.2024.108460
Georgia D. Liapi , Christos P. Loizou , Constantinos S. Pattichis , Marios S. Pattichis , Andrew N. Nicolaides , Maura Griffin , Efthyvoulos Kyriacou
<div><h3>Background and objective</h3><div>Carotid B-mode ultrasound (CBUS) imaging is often used to detect and assess atherosclerotic plaques. Doctors often need to segment plaques in the CBUS images to further examine them. Multiple studies have proposed two-dimensional CBUS plaque segmentation deep learning (DL)-based solutions, achieving promising results. In most of these studies, image standardization is not reported, while not all plaque types are represented. However, prior multiple studies have highlighted the importance of data standardization in computerized CBUS plaque classification or segmentation solutions. In this study, we propose and separately evaluate three progressive preprocessing schemes, to discover the most optimal to standardize CBUS images for DL-based carotid plaque segmentation, while we also assess the effect of each preprocessing in the segmentation performance per echodensity-based plaque type (I, II, III, IV and V).</div></div><div><h3>Methods</h3><div>We included three CBUS image datasets (276 CBUS images, from three medical centres), with which we produced 3 data folds (with the best possible equal inclusion of images from all centers per fold), to perform 3-fold cross validation-based training and evaluation of the pre-released Channel-wise Feature Pyramid Network for Medicine (CFPNet-M) model, in carotid plaque type segmentation. We included the three data folds in their original version (O), generating also three preprocessed versions of them, namely, the resolution-normalized (R), the resolution- and intensity-normalized (RN), and the resolution- and intensity-normalized combined with despeckling (RND) versions. The samples were cropped to the plaque level, and the intersection over union (IoU) and the Dice Similarity Coefficient (DSC), along with other metrics, were used to measure the model's performance. In each training round, 12 % of the images in the 2 training folds was used for internal validation (last fold was used in evaluation). Two experienced ultrasonographers manually delineated plaques in the dataset, to provide us with ground truths, while the plaque types (I to V) were extracted according to the Gray-Weale and Geroulakos classification system. We measured the mean±standard deviation of DSC within and across the three evaluated folds, per preprocessing scheme and per plaque type.</div></div><div><h3>Results</h3><div>CFPNet-M segmented the plaques in the CBUS images in all the data preprocessing versions, yielding progressively improved performances (mean DSC at 81.9 ± 9.1 %, 83.6 ± 9.0 %, 84.1 ± 8.3 %, and 84.4 ± 8.1 % for the O, R, RN and RND 3-fold cross validation processes, respectively), irrespective of the plaque type. Interestingly, CFPNet_M yielded improved performances, for all plaque types (I, II, III, IV and V), when trained and tested with the RND data versus the O version, achieving an 80.6 ± 11 % versus 77.6 ± 17 % DSC for type I, an 84.3 ± 8 % versus 81.2 ± 9 % DSC for type II
背景和目的:颈动脉 B 型超声(CBUS)成像通常用于检测和评估动脉粥样硬化斑块。医生通常需要对 CBUS 图像中的斑块进行分割,以便进一步检查。多项研究提出了基于深度学习(DL)的二维 CBUS 斑块分割解决方案,并取得了可喜的成果。在大多数这些研究中,都没有报告图像标准化的情况,也没有代表所有斑块类型。然而,之前的多项研究都强调了数据标准化在计算机化 CBUS 斑块分类或分割解决方案中的重要性。在本研究中,我们提出并分别评估了三种渐进式预处理方案,以发现最佳的CBUS图像标准化方案,用于基于DL的颈动脉斑块分割,同时我们还评估了每种预处理对基于回声密度的斑块类型(I、II、III、IV和V)分割性能的影响:我们纳入了三个 CBUS 图像数据集(来自三个医疗中心的 276 幅 CBUS 图像),并利用这些数据集生成了 3 个数据折叠(每个折叠尽可能平等地包含来自所有中心的图像),以便在颈动脉斑块类型分割中对预先发布的医学通道特征金字塔网络(CFPNet-M)模型进行基于 3 倍交叉验证的训练和评估。我们在原始版本(O)中包含了三个数据折叠,并生成了三个预处理版本,即分辨率归一化版本(R)、分辨率和强度归一化版本(RN)以及分辨率和强度归一化结合去斑版本(RND)。样本被裁剪到斑块水平,并使用交集大于联合(IoU)和骰子相似系数(DSC)以及其他指标来衡量模型的性能。在每一轮训练中,2 个训练折叠中的 12% 图像用于内部验证(最后一个折叠用于评估)。两名经验丰富的超声波技师手动划分数据集中的斑块,为我们提供基本事实,而斑块类型(I 至 V)则根据 Gray-Weale 和 Geroulakos 分类系统提取。我们测量了每个预处理方案和每种斑块类型在三个评估折叠内和折叠间的 DSC 平均值(± 标准偏差):无论斑块类型如何,CFPNet-M 在所有数据预处理版本中都对 CBUS 图像中的斑块进行了分割,性能逐步提高(O、R、RN 和 RND 3 倍交叉验证过程的平均 DSC 分别为 81.9 ± 9.1 %、83.6 ± 9.0 %、84.1 ± 8.3 % 和 84.4 ± 8.1 %)。有趣的是,对于所有斑块类型(I、II、III、IV 和 V),使用 RND 数据进行训练和测试时,CFPNet_M 的性能都比 O 版本有所提高,I 型的 DSC 为 80.6 ± 11 % 对 77.6 ± 17 %,II 型的 DSC 为 84.3 ± 8 % 对 81.2 ± 9 %,III 型的 DSC 为 84.9 ± 7 % 对 82.6 ± 7 %,IV 型的 DSC 为 84.3 ± 8 % 对 81.2 ± 9 %。从 O 型到 RND CBUS 图像,斑块 I 型的 DSC 增幅最大(3.86%),其次是 II 型和 V 型:在这项研究中,我们研究了 CBUS 标准化对基于 DL 的颈动脉斑块类型分割的影响,结果表明,在模型训练和测试之前,图像分辨率和强度的归一化,以及斑点噪声的去除,确实提高了 DL 模型在所有斑块类型中的性能。根据这项研究的结果,CBUS 图像在用于基于 DL 的分割任务时应标准化,同时应考虑所有斑块类型,因为在现有的大量相关研究中,均匀回声斑块或带有声影的严重钙化斑块的代表性明显不足。
{"title":"Assessing the impact of ultrasound image standardization in deep learning-based segmentation of carotid plaque types","authors":"Georgia D. Liapi ,&nbsp;Christos P. Loizou ,&nbsp;Constantinos S. Pattichis ,&nbsp;Marios S. Pattichis ,&nbsp;Andrew N. Nicolaides ,&nbsp;Maura Griffin ,&nbsp;Efthyvoulos Kyriacou","doi":"10.1016/j.cmpb.2024.108460","DOIUrl":"10.1016/j.cmpb.2024.108460","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Background and objective&lt;/h3&gt;&lt;div&gt;Carotid B-mode ultrasound (CBUS) imaging is often used to detect and assess atherosclerotic plaques. Doctors often need to segment plaques in the CBUS images to further examine them. Multiple studies have proposed two-dimensional CBUS plaque segmentation deep learning (DL)-based solutions, achieving promising results. In most of these studies, image standardization is not reported, while not all plaque types are represented. However, prior multiple studies have highlighted the importance of data standardization in computerized CBUS plaque classification or segmentation solutions. In this study, we propose and separately evaluate three progressive preprocessing schemes, to discover the most optimal to standardize CBUS images for DL-based carotid plaque segmentation, while we also assess the effect of each preprocessing in the segmentation performance per echodensity-based plaque type (I, II, III, IV and V).&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Methods&lt;/h3&gt;&lt;div&gt;We included three CBUS image datasets (276 CBUS images, from three medical centres), with which we produced 3 data folds (with the best possible equal inclusion of images from all centers per fold), to perform 3-fold cross validation-based training and evaluation of the pre-released Channel-wise Feature Pyramid Network for Medicine (CFPNet-M) model, in carotid plaque type segmentation. We included the three data folds in their original version (O), generating also three preprocessed versions of them, namely, the resolution-normalized (R), the resolution- and intensity-normalized (RN), and the resolution- and intensity-normalized combined with despeckling (RND) versions. The samples were cropped to the plaque level, and the intersection over union (IoU) and the Dice Similarity Coefficient (DSC), along with other metrics, were used to measure the model's performance. In each training round, 12 % of the images in the 2 training folds was used for internal validation (last fold was used in evaluation). Two experienced ultrasonographers manually delineated plaques in the dataset, to provide us with ground truths, while the plaque types (I to V) were extracted according to the Gray-Weale and Geroulakos classification system. We measured the mean±standard deviation of DSC within and across the three evaluated folds, per preprocessing scheme and per plaque type.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;CFPNet-M segmented the plaques in the CBUS images in all the data preprocessing versions, yielding progressively improved performances (mean DSC at 81.9 ± 9.1 %, 83.6 ± 9.0 %, 84.1 ± 8.3 %, and 84.4 ± 8.1 % for the O, R, RN and RND 3-fold cross validation processes, respectively), irrespective of the plaque type. Interestingly, CFPNet_M yielded improved performances, for all plaque types (I, II, III, IV and V), when trained and tested with the RND data versus the O version, achieving an 80.6 ± 11 % versus 77.6 ± 17 % DSC for type I, an 84.3 ± 8 % versus 81.2 ± 9 % DSC for type II","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108460"},"PeriodicalIF":4.9,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142459886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effective property method for efficient modeling of non-uniform tissue support in fluid–structure interaction simulation of blood flows 在血流流体-结构相互作用模拟中有效模拟非均匀组织支撑的有效属性方法
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-10 DOI: 10.1016/j.cmpb.2024.108457
Peishuo Wu, Chi Zhu

Background and Objective:

Incorporating tissue support in fluid–structure interaction analysis of cardiovascular flows is crucial for accurately representing physiological constraints, achieving realistic vessel wall motion, and minimizing artificial oscillations. The generalized Robin boundary condition, which models tissue support with a spring-damper-type force, uses elastic and damping parameters to represent the viscoelastic behavior of perivascular tissues. Using spatially distributed parameters for tissue support, rather than uniform ones, is more realistic and aligns with the varying properties of vessel walls. However, considering the spatial distribution of both can increase the complexity of preprocessing and numerical implementation. In this work, we develop an effective property method for efficient modeling of non-uniform tissue support and quantifying the contribution of tissue support to the mechanical behaviors of vessel walls.

Methods:

Based on the theory of linear viscoelasticity, we derive the mathematical formulas for the effective property method, integrating the parameters of generalized Robin boundary condition into vessel wall properties. The pulse wave velocity incorporating the influence of tissue support is also analyzed. Furthermore, we modify the coupled momentum method, originally formulated for elastic problems, to account for the viscoelastic properties of the vessel wall.

Results:

The method is verified with three-dimensional fluid–structure interaction simulations, achieving a maximum relative error of less than 2.2% for flow rate and less than 0.7% for pressure. This method shows that tissue support parameters can be integrated into vessel wall properties, resulting in increased apparent wall stiffness and viscosity, and further changing pressure, flow rate, and wave propagation.

Conclusion:

In this study, we develop an effective property method for quantitatively assessing the impact of tissue support and for efficiently modeling non-uniform tissue support. Moreover, this method offers further insights into clinically measured pulse wave velocity, demonstrating that it reflects the combined influence of both vessel wall properties and tissue support.
背景与目的:在心血管流动的流固耦合分析中加入组织支撑对于准确表达生理约束、实现逼真的血管壁运动以及最大限度地减少人为振荡至关重要。广义罗宾边界条件用弹簧-阻尼型力模拟组织支撑,使用弹性和阻尼参数来表示血管周围组织的粘弹性行为。使用空间分布参数而非均匀参数来表示组织支撑,更符合实际情况,并与血管壁的不同特性相一致。然而,考虑两者的空间分布会增加预处理和数值计算的复杂性。方法:基于线性粘弹性理论,我们推导出有效属性方法的数学公式,将广义罗宾边界条件的参数整合到血管壁属性中。我们还分析了受组织支撑影响的脉搏波速度。此外,我们修改了最初为弹性问题制定的耦合动量法,以考虑血管壁的粘弹性特性。结果:该方法通过三维流体与结构相互作用模拟进行了验证,流速的最大相对误差小于 2.2%,压力的最大相对误差小于 0.7%。结论:在这项研究中,我们开发了一种有效的属性方法,用于定量评估组织支撑的影响,并对非均匀组织支撑进行有效建模。此外,该方法还为临床测量的脉搏波速度提供了进一步的见解,证明脉搏波速度反映了血管壁特性和组织支持的综合影响。
{"title":"Effective property method for efficient modeling of non-uniform tissue support in fluid–structure interaction simulation of blood flows","authors":"Peishuo Wu,&nbsp;Chi Zhu","doi":"10.1016/j.cmpb.2024.108457","DOIUrl":"10.1016/j.cmpb.2024.108457","url":null,"abstract":"<div><h3>Background and Objective:</h3><div>Incorporating tissue support in fluid–structure interaction analysis of cardiovascular flows is crucial for accurately representing physiological constraints, achieving realistic vessel wall motion, and minimizing artificial oscillations. The generalized Robin boundary condition, which models tissue support with a spring-damper-type force, uses elastic and damping parameters to represent the viscoelastic behavior of perivascular tissues. Using spatially distributed parameters for tissue support, rather than uniform ones, is more realistic and aligns with the varying properties of vessel walls. However, considering the spatial distribution of both can increase the complexity of preprocessing and numerical implementation. In this work, we develop an effective property method for efficient modeling of non-uniform tissue support and quantifying the contribution of tissue support to the mechanical behaviors of vessel walls.</div></div><div><h3>Methods:</h3><div>Based on the theory of linear viscoelasticity, we derive the mathematical formulas for the effective property method, integrating the parameters of generalized Robin boundary condition into vessel wall properties. The pulse wave velocity incorporating the influence of tissue support is also analyzed. Furthermore, we modify the coupled momentum method, originally formulated for elastic problems, to account for the viscoelastic properties of the vessel wall.</div></div><div><h3>Results:</h3><div>The method is verified with three-dimensional fluid–structure interaction simulations, achieving a maximum relative error of less than 2.2% for flow rate and less than 0.7% for pressure. This method shows that tissue support parameters can be integrated into vessel wall properties, resulting in increased apparent wall stiffness and viscosity, and further changing pressure, flow rate, and wave propagation.</div></div><div><h3>Conclusion:</h3><div>In this study, we develop an effective property method for quantitatively assessing the impact of tissue support and for efficiently modeling non-uniform tissue support. Moreover, this method offers further insights into clinically measured pulse wave velocity, demonstrating that it reflects the combined influence of both vessel wall properties and tissue support.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108457"},"PeriodicalIF":4.9,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142434144","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Smart monitoring solution for dengue infection control: A digital twin-inspired approach 登革热感染控制的智能监测解决方案:受数字孪生启发的方法。
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-10 DOI: 10.1016/j.cmpb.2024.108459
Ankush Manocha , Munish Bhatia , Gulshan Kumar

Background and Objective:

In the realm of smart healthcare, precise monitoring and prediction services are crucial for mitigating the impact of infectious diseases. This study introduces an innovative digital twin technology-inspired monitoring architecture that employs a similarity-based hybrid modeling scheme to significantly enhance accuracy in the smart healthcare domain. The research also delves into the potential of IoT technology in delivering advanced technological healthcare solutions, with a specific focus on the rapid expansion of dengue fever.

Methods:

The proposed digital twin-inspired healthcare system is designed to proactively combat the spread of dengue virus by enabling ubiquitous monitoring and forecasting of individuals’ susceptibility to dengue infection. The system utilizes digital twin technology to observe the status of healthcare and generate likely predictions about the vulnerability to the virus by employing k-means Clustering and Artificial Neural Networks.

Results:

The proposed system has been validated and its effectiveness has been demonstrated through experimental evaluation using carefully defined methods. The results of the experimental assessment confirm that the system performs optimally in terms of Temporal Delay (14.15 s), Classification Accuracy (92.86%), Sensitivity (92.43%), Specificity (91.52%), F-measure (90.86%), and Prediction Effectiveness. Moreover, by integrating a hybrid model that corrects errors in physics-based predictions employing a model for error correction driven by data, this approach has demonstrated a noteworthy 48% reduction in prediction errors, particularly in health monitoring scenarios.

Conclusions:

The digital twin-inspired healthcare system proposed in this study can assist healthcare providers in assessing the health vulnerability of the dengue virus, thereby reducing the likelihood of long-term or catastrophic health consequences. The integration of a hybrid modeling approach and the utilization of IoT technology has shown promising results in enhancing the accuracy and effectiveness of smart health monitoring and prediction services.
背景与目标:在智能医疗领域,精确的监测和预测服务对于减轻传染病的影响至关重要。本研究介绍了一种受数字孪生技术启发的创新监测架构,该架构采用基于相似性的混合建模方案,可显著提高智能医疗保健领域的准确性。研究还深入探讨了物联网技术在提供先进技术医疗解决方案方面的潜力,并特别关注登革热的迅速蔓延:受数字孪生启发而提出的医疗保健系统旨在通过实现对个人登革热感染易感性的无处不在的监测和预测,积极防治登革热病毒的传播。该系统利用数字孪生技术观察医疗保健状况,并通过使用 k-means 聚类和人工神经网络生成对病毒易感性的可能预测:通过使用精心定义的方法进行实验评估,验证了拟议系统的有效性。实验评估结果证实,该系统在时间延迟(14.15 秒)、分类准确率(92.86%)、灵敏度(92.43%)、特异性(91.52%)、F-measure(90.86%)和预测效果等方面均表现最佳。此外,通过整合一个混合模型,利用数据驱动的纠错模型纠正基于物理的预测中的错误,该方法显著减少了48%的预测错误,尤其是在健康监测场景中:本研究提出的受数字孪生启发的医疗保健系统可以帮助医疗保健提供者评估登革热病毒的健康脆弱性,从而降低长期或灾难性健康后果的可能性。将混合建模方法与物联网技术相结合,在提高智能健康监测和预测服务的准确性和有效性方面取得了可喜的成果。
{"title":"Smart monitoring solution for dengue infection control: A digital twin-inspired approach","authors":"Ankush Manocha ,&nbsp;Munish Bhatia ,&nbsp;Gulshan Kumar","doi":"10.1016/j.cmpb.2024.108459","DOIUrl":"10.1016/j.cmpb.2024.108459","url":null,"abstract":"<div><h3>Background and Objective:</h3><div>In the realm of smart healthcare, precise monitoring and prediction services are crucial for mitigating the impact of infectious diseases. This study introduces an innovative digital twin technology-inspired monitoring architecture that employs a similarity-based hybrid modeling scheme to significantly enhance accuracy in the smart healthcare domain. The research also delves into the potential of IoT technology in delivering advanced technological healthcare solutions, with a specific focus on the rapid expansion of dengue fever.</div></div><div><h3>Methods:</h3><div>The proposed digital twin-inspired healthcare system is designed to proactively combat the spread of dengue virus by enabling ubiquitous monitoring and forecasting of individuals’ susceptibility to dengue infection. The system utilizes digital twin technology to observe the status of healthcare and generate likely predictions about the vulnerability to the virus by employing k-means Clustering and Artificial Neural Networks.</div></div><div><h3>Results:</h3><div>The proposed system has been validated and its effectiveness has been demonstrated through experimental evaluation using carefully defined methods. The results of the experimental assessment confirm that the system performs optimally in terms of Temporal Delay (14.15 s), Classification Accuracy (92.86%), Sensitivity (92.43%), Specificity (91.52%), F-measure (90.86%), and Prediction Effectiveness. Moreover, by integrating a hybrid model that corrects errors in physics-based predictions employing a model for error correction driven by data, this approach has demonstrated a noteworthy 48% reduction in prediction errors, particularly in health monitoring scenarios.</div></div><div><h3>Conclusions:</h3><div>The digital twin-inspired healthcare system proposed in this study can assist healthcare providers in assessing the health vulnerability of the dengue virus, thereby reducing the likelihood of long-term or catastrophic health consequences. The integration of a hybrid modeling approach and the utilization of IoT technology has shown promising results in enhancing the accuracy and effectiveness of smart health monitoring and prediction services.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108459"},"PeriodicalIF":4.9,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142459888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
2D/3D registration based on biplanar X-ray and CT images for surgical navigation 基于双平面 X 光和 CT 图像的 2D/3D 配准,用于手术导航
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-09 DOI: 10.1016/j.cmpb.2024.108444
Demin Yang, Haochen Shi, Bolun Zeng, Xiaojun Chen

Background and Objectives:

Image-based 2D/3D registration is a crucial technology for fluoroscopy-guided surgical interventions. However, traditional registration methods relying on a single X-ray image into surgical navigation systems. This study proposes a novel 2D/3D registration approach utilizing biplanar X-ray images combined with computed tomography (CT) to significantly reduce registration and navigation errors. The method is successfully implemented in a surgical navigation system, enhancing its precision and reliability.

Methods:

First, we simultaneously register the frontal and lateral X-ray images with the CT image, enabling mutual complementation and more precise localization. Additionally, we introduce a novel similarity measure for image comparison, providing a more robust cost function for the optimization algorithm. Furthermore, a multi-resolution strategy is employed to enhance registration efficiency. Lastly, we propose a more accurate coordinate transformation method, based on projection and 3D reconstruction, to improve the precision of surgical navigation systems.Results: We conducted registration and navigation experiments using pelvic, spinal, and femur phantoms. The navigation results demonstrated that the feature registration errors (FREs) in the three experiments were 0.505±0.063 mm, 0.515±0.055 mm, and 0.577±0.056 mm, respectively. Compared to the point-to-point (PTP) registration method based on anatomical landmarks, our method reduced registration errors by 31.3%, 23.9%, and 26.3%, respectively.

Conclusion:

The results demonstrate that our method significantly reduces registration and navigation errors, highlighting its potential for application across various anatomical sites. Our code is available at: https://github.com/SJTUdemon/2D-3D-Registration
背景和目的:基于图像的二维/三维配准是荧光屏引导手术干预的关键技术。然而,传统的配准方法依赖于手术导航系统中的单一 X 射线图像。本研究提出了一种新型 2D/3D 配准方法,利用双平面 X 光图像与计算机断层扫描(CT)相结合,显著减少配准和导航误差。方法:首先,我们将正面和侧面的 X 光图像与 CT 图像同时配准,从而实现互补和更精确的定位。此外,我们还引入了一种用于图像对比的新型相似度测量方法,为优化算法提供了更稳健的成本函数。此外,我们还采用了多分辨率策略来提高配准效率。最后,我们提出了一种基于投影和三维重建的更精确坐标转换方法,以提高手术导航系统的精度:我们使用骨盆、脊柱和股骨模型进行了配准和导航实验。导航结果表明,三次实验中的特征配准误差(FREs)分别为 0.505±0.063 mm、0.515±0.055 mm 和 0.577±0.056 mm。与基于解剖地标的点对点(PTP)配准方法相比,我们的方法分别减少了 31.3%、23.9% 和 26.3% 的配准误差。我们的代码可在以下网址获取: https://github.com/SJTUdemon/2D-3D-Registration
{"title":"2D/3D registration based on biplanar X-ray and CT images for surgical navigation","authors":"Demin Yang,&nbsp;Haochen Shi,&nbsp;Bolun Zeng,&nbsp;Xiaojun Chen","doi":"10.1016/j.cmpb.2024.108444","DOIUrl":"10.1016/j.cmpb.2024.108444","url":null,"abstract":"<div><h3>Background and Objectives:</h3><div>Image-based 2D/3D registration is a crucial technology for fluoroscopy-guided surgical interventions. However, traditional registration methods relying on a single X-ray image into surgical navigation systems. This study proposes a novel 2D/3D registration approach utilizing biplanar X-ray images combined with computed tomography (CT) to significantly reduce registration and navigation errors. The method is successfully implemented in a surgical navigation system, enhancing its precision and reliability.</div></div><div><h3>Methods:</h3><div>First, we simultaneously register the frontal and lateral X-ray images with the CT image, enabling mutual complementation and more precise localization. Additionally, we introduce a novel similarity measure for image comparison, providing a more robust cost function for the optimization algorithm. Furthermore, a multi-resolution strategy is employed to enhance registration efficiency. Lastly, we propose a more accurate coordinate transformation method, based on projection and 3D reconstruction, to improve the precision of surgical navigation systems.<em>Results:</em> We conducted registration and navigation experiments using pelvic, spinal, and femur phantoms. The navigation results demonstrated that the feature registration errors (FREs) in the three experiments were 0.505±0.063 mm, 0.515±0.055 mm, and 0.577±0.056 mm, respectively. Compared to the point-to-point (PTP) registration method based on anatomical landmarks, our method reduced registration errors by 31.3%, 23.9%, and 26.3%, respectively.</div></div><div><h3>Conclusion:</h3><div>The results demonstrate that our method significantly reduces registration and navigation errors, highlighting its potential for application across various anatomical sites. Our code is available at: <span><span>https://github.com/SJTUdemon/2D-3D-Registration</span><svg><path></path></svg></span></div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108444"},"PeriodicalIF":4.9,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bootstrap each lead’s latent: A novel method for self-supervised learning of multilead electrocardiograms 引导每个导联的潜变量:多导联心电图自我监督学习的新方法
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-09 DOI: 10.1016/j.cmpb.2024.108452
Wenhan Liu , Shurong Pan , Zhoutong Li , Sheng Chang , Qijun Huang , Nan Jiang

Background and Objective:

Electrocardiogram (ECG) is one of the most important diagnostic tools for cardiovascular diseases (CVDs). Recent studies show that deep learning models can be trained using labeled ECGs to achieve automatic detection of CVDs, assisting cardiologists in diagnosis. However, the deep learning models heavily rely on labels in training, while manual labeling is costly and time-consuming. This paper proposes a new self-supervised learning (SSL) method for multilead ECGs: bootstrap each lead’s latent (BELL) to reduce the reliance and boost model performance in various tasks, especially when training data are insufficient.

Method:

BELL is a variant of the well-known bootstrap your own latent (BYOL). The BELL aims to learn prior knowledge from unlabeled ECGs by pretraining, benefitting downstream tasks. It leverages the characteristics of multilead ECGs. First, BELL uses the multiple-branch skeleton, which is more effective in processing multilead ECGs. Moreover, it proposes intra-lead and inter-lead mean square error (MSE) to guide pretraining, and their fusion can result in better performances. Additionally, BELL inherits the main advantage of the BYOL: No negative pair is used in pretraining, making it more efficient.

Results:

In most cases, BELL surpasses previous works in the experiments. More importantly, the pretraining improves model performances by 0.69% 8.89% in downstream tasks when only 10% of training data are available. Furthermore, BELL shows excellent adaptability to uncurated ECG data from a real-world hospital. Only slight performance degradation occurs (<1% in most cases) when using these data.

Conclusion:

The results suggest that the BELL can alleviate the reliance on manual ECG labels from cardiologists, a critical bottleneck of the current deep learning-based models. In this way, the BELL can also help deep learning extend its application on automatic ECG analysis, reducing the cardiologists’ burden in real-world diagnosis.
背景和目的:心电图(ECG)是心血管疾病(CVDs)最重要的诊断工具之一。最近的研究表明,深度学习模型可以使用带标签的心电图进行训练,从而实现心血管疾病的自动检测,协助心脏病专家进行诊断。然而,深度学习模型在训练中严重依赖于标签,而人工标注成本高且耗时。本文针对多导联心电图提出了一种新的自我监督学习(SSL)方法:引导每个导联的潜变量(BELL),以减少各种任务中的依赖并提高模型性能,尤其是在训练数据不足的情况下:BELL 是著名的自举潜迹法(BYOL)的一种变体。BELL旨在通过预训练从未标明的心电图中学习先验知识,从而使下游任务受益。它利用了多导联心电图的特点。首先,BELL 使用多分支骨架,这在处理多导联心电图时更为有效。此外,它还提出了导联内和导联间均方误差(MSE)来指导预训练,两者的融合能带来更好的性能。此外,BELL 还继承了 BYOL 的主要优点:预训练中不使用负对,因此效率更高:在大多数情况下,BELL 在实验中都超越了之前的研究成果。更重要的是,在下游任务中,当只有 10% 的训练数据可用时,预训练将模型性能提高了 0.69% ∼ 8.89%。此外,BELL 对来自真实世界医院的未经整理的心电图数据显示出极佳的适应性。只出现了轻微的性能下降(结论:BELL 可用于医院心电图数据:结果表明,BELL 可以减轻对心脏病专家手动心电图标签的依赖,而这正是当前基于深度学习的模型的一个关键瓶颈。这样,BELL 还能帮助深度学习扩展其在自动心电图分析方面的应用,减轻心脏病专家在实际诊断中的负担。
{"title":"Bootstrap each lead’s latent: A novel method for self-supervised learning of multilead electrocardiograms","authors":"Wenhan Liu ,&nbsp;Shurong Pan ,&nbsp;Zhoutong Li ,&nbsp;Sheng Chang ,&nbsp;Qijun Huang ,&nbsp;Nan Jiang","doi":"10.1016/j.cmpb.2024.108452","DOIUrl":"10.1016/j.cmpb.2024.108452","url":null,"abstract":"<div><h3>Background and Objective:</h3><div>Electrocardiogram (ECG) is one of the most important diagnostic tools for cardiovascular diseases (CVDs). Recent studies show that deep learning models can be trained using labeled ECGs to achieve automatic detection of CVDs, assisting cardiologists in diagnosis. However, the deep learning models heavily rely on labels in training, while manual labeling is costly and time-consuming. This paper proposes a new self-supervised learning (SSL) method for multilead ECGs: bootstrap each lead’s latent (BELL) to reduce the reliance and boost model performance in various tasks, especially when training data are insufficient.</div></div><div><h3>Method:</h3><div>BELL is a variant of the well-known bootstrap your own latent (BYOL). The BELL aims to learn prior knowledge from unlabeled ECGs by pretraining, benefitting downstream tasks. It leverages the characteristics of multilead ECGs. First, BELL uses the multiple-branch skeleton, which is more effective in processing multilead ECGs. Moreover, it proposes intra-lead and inter-lead mean square error (MSE) to guide pretraining, and their fusion can result in better performances. Additionally, BELL inherits the main advantage of the BYOL: No negative pair is used in pretraining, making it more efficient.</div></div><div><h3>Results:</h3><div>In most cases, BELL surpasses previous works in the experiments. More importantly, the pretraining improves model performances by 0.69% <span><math><mo>∼</mo></math></span> 8.89% in downstream tasks when only 10% of training data are available. Furthermore, BELL shows excellent adaptability to uncurated ECG data from a real-world hospital. Only slight performance degradation occurs (<span><math><mo>&lt;</mo></math></span>1% in most cases) when using these data.</div></div><div><h3>Conclusion:</h3><div>The results suggest that the BELL can alleviate the reliance on manual ECG labels from cardiologists, a critical bottleneck of the current deep learning-based models. In this way, the BELL can also help deep learning extend its application on automatic ECG analysis, reducing the cardiologists’ burden in real-world diagnosis.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108452"},"PeriodicalIF":4.9,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142406219","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MG-Net: A fetal brain tissue segmentation method based on multiscale feature fusion and graph convolution attention mechanisms MG-Net:基于多尺度特征融合和图卷积注意机制的胎儿脑组织分割方法
IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Pub Date : 2024-10-05 DOI: 10.1016/j.cmpb.2024.108451
Keying Qi , Chenchen Yan , Donghao Niu , Bing Zhang , Dong Liang , Xiaojing Long

Background and Objective:

Fetal brain tissue segmentation provides foundational support for comprehensively understanding the neurodevelopment of normal and congenital disease-affected fetuses. Manual labeling is very time-consuming, and automated segmentation methods can greatly improve the efficiency of doctors. At the same time, fetal brain tissue undergoes various changes throughout the pregnancy, leading to a continuous change in tissue contrast, which greatly increases the difficulty of training segmentation methods. This study aims to develop an automated segmentation model that can efficiently and accurately segment fetal brain tissue, improving the workflow for medical professionals.

Methods:

We propose a novel deep learning-based segmentation model that incorporates three innovative components: Firstly, a new Dual Dilated Attention Block (DDAB) is proposed in the encoder part to enhance the feature extraction of local spatial and structural contextual information. Secondly, a Multi-scale Deformable Transformer (MSDT) is integrated into the bottleneck to improve the feature extraction of global information on local spatial and structural contextual information. Thirdly, we use a novel block based on Graph Convolution Attention (GCAB) in the decoder, which effectively enhances the features at the decoder.The code is available at https://github.com/unicoco7/MG-Net/.

Results:

We trained and tested on the FeTA 2021 and FeTA 2022 datasets, and evaluated using seven popular metrics, including Dice, IoU, MAE, BoundaryF, PRE, SEN, and SPE. Compared to the current state-of-the-art 3D segmentation models such as nnFormer, SwinUNETR, and 3DUX-net, our proposed method has surpassed all of them in metrics like Dice, IoU, and MAE. Specifically, on the FeTA 2021 dataset, our model achieved a Dice of 0.8666, an IoU of 0.7646, and an MAE of 0.0027; on the FeTA 2022 dataset, it achieved a Dice of 0.8552, an IoU of 0.7470, and an MAE of 0.0005.

Conclusion:

In this paper, we propose a model for three-dimensional fetal brain tissue segmentation based on multi-scale feature fusion and graph convolution attention mechanism, and conduct experimental evaluation on the FeTA 2021 and FeTA 2022 datasets. Understanding the boundaries of fetal brain tissue is crucial for doctors’ diagnosis, so the proposed model is expected to improve the speed and accuracy of doctors’ diagnoses.
背景与目的:胎儿脑组织分割为全面了解正常胎儿和先天性疾病胎儿的神经发育提供了基础支持。人工标记非常耗时,而自动分割方法可大大提高医生的工作效率。同时,胎儿脑组织在整个孕期会发生各种变化,导致组织对比度不断变化,这大大增加了训练分割方法的难度。本研究旨在开发一种能高效、准确分割胎儿脑组织的自动分割模型,改善医疗专业人员的工作流程。方法:我们提出了一种基于深度学习的新型分割模型,该模型包含三个创新组件:首先,在编码器部分提出了一种新的双稀释注意力块(DDAB),以加强对局部空间和结构上下文信息的特征提取。其次,在瓶颈部分集成了多尺度可变形变换器(MSDT),以改进对局部空间和结构上下文信息的全局信息特征提取。第三,我们在解码器中使用了基于图形卷积注意力(GCAB)的新型区块,有效增强了解码器的特征。代码可在 https://github.com/unicoco7/MG-Net/.Results:We 上获取,在 FeTA 2021 和 FeTA 2022 数据集上进行了训练和测试,并使用七种流行指标进行了评估,包括 Dice、IoU、MAE、BoundaryF、PRE、SEN 和 SPE。与目前最先进的三维分割模型(如 nnFormer、SwinUNETR 和 3DUX-net 等)相比,我们提出的方法在 Dice、IoU 和 MAE 等指标上都超过了它们。具体来说,在 FeTA 2021 数据集上,我们的模型取得了 0.8666 的 Dice 值、0.7646 的 IoU 值和 0.0027 的 MAE 值;在 FeTA 2022 数据集上,我们的模型取得了 0.8552 的 Dice 值、0.7470 的 IoU 值和 0.0005 的 MAE 值。结论:本文提出了一种基于多尺度特征融合和图卷积注意机制的三维胎儿脑组织分割模型,并在 FeTA 2021 和 FeTA 2022 数据集上进行了实验评估。理解胎儿脑组织的边界对医生的诊断至关重要,因此所提出的模型有望提高医生诊断的速度和准确性。
{"title":"MG-Net: A fetal brain tissue segmentation method based on multiscale feature fusion and graph convolution attention mechanisms","authors":"Keying Qi ,&nbsp;Chenchen Yan ,&nbsp;Donghao Niu ,&nbsp;Bing Zhang ,&nbsp;Dong Liang ,&nbsp;Xiaojing Long","doi":"10.1016/j.cmpb.2024.108451","DOIUrl":"10.1016/j.cmpb.2024.108451","url":null,"abstract":"<div><h3>Background and Objective:</h3><div>Fetal brain tissue segmentation provides foundational support for comprehensively understanding the neurodevelopment of normal and congenital disease-affected fetuses. Manual labeling is very time-consuming, and automated segmentation methods can greatly improve the efficiency of doctors. At the same time, fetal brain tissue undergoes various changes throughout the pregnancy, leading to a continuous change in tissue contrast, which greatly increases the difficulty of training segmentation methods. This study aims to develop an automated segmentation model that can efficiently and accurately segment fetal brain tissue, improving the workflow for medical professionals.</div></div><div><h3>Methods:</h3><div>We propose a novel deep learning-based segmentation model that incorporates three innovative components: Firstly, a new Dual Dilated Attention Block (DDAB) is proposed in the encoder part to enhance the feature extraction of local spatial and structural contextual information. Secondly, a Multi-scale Deformable Transformer (MSDT) is integrated into the bottleneck to improve the feature extraction of global information on local spatial and structural contextual information. Thirdly, we use a novel block based on Graph Convolution Attention (GCAB) in the decoder, which effectively enhances the features at the decoder.The code is available at <span><span>https://github.com/unicoco7/MG-Net/</span><svg><path></path></svg></span>.</div></div><div><h3>Results:</h3><div>We trained and tested on the FeTA 2021 and FeTA 2022 datasets, and evaluated using seven popular metrics, including Dice, IoU, MAE, BoundaryF, PRE, SEN, and SPE. Compared to the current state-of-the-art 3D segmentation models such as nnFormer, SwinUNETR, and 3DUX-net, our proposed method has surpassed all of them in metrics like Dice, IoU, and MAE. Specifically, on the FeTA 2021 dataset, our model achieved a Dice of 0.8666, an IoU of 0.7646, and an MAE of 0.0027; on the FeTA 2022 dataset, it achieved a Dice of 0.8552, an IoU of 0.7470, and an MAE of 0.0005.</div></div><div><h3>Conclusion:</h3><div>In this paper, we propose a model for three-dimensional fetal brain tissue segmentation based on multi-scale feature fusion and graph convolution attention mechanism, and conduct experimental evaluation on the FeTA 2021 and FeTA 2022 datasets. Understanding the boundaries of fetal brain tissue is crucial for doctors’ diagnosis, so the proposed model is expected to improve the speed and accuracy of doctors’ diagnoses.</div></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"257 ","pages":"Article 108451"},"PeriodicalIF":4.9,"publicationDate":"2024-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142421047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Computer methods and programs in biomedicine
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1