GMmorph: dynamic spatial matching registration model for 3D medical image based on gated Mamba.

IF 3.3 3区 医学 Q2 ENGINEERING, BIOMEDICAL Physics in medicine and biology Pub Date : 2025-01-29 DOI:10.1088/1361-6560/adaacd
Hao Lin, Yonghong Song, Qi Zhang
{"title":"GMmorph: dynamic spatial matching registration model for 3D medical image based on gated Mamba.","authors":"Hao Lin, Yonghong Song, Qi Zhang","doi":"10.1088/1361-6560/adaacd","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective.</i>Deformable registration aims to achieve nonlinear alignment of image space by estimating a dense displacement field. It is commonly used as a preprocessing step in clinical and image analysis applications, such as surgical planning, diagnostic assistance, and surgical navigation. We aim to overcome these challenges: Deep learning-based registration methods often struggle with complex displacements and lack effective interaction between global and local feature information. They also neglect the spatial position matching process, leading to insufficient registration accuracy and reduced robustness when handling abnormal tissues.<i>Approach.</i>We propose a dual-branch interactive registration model architecture from the perspective of spatial matching. Implicit regularization is achieved through a consistency loss, enabling the network to balance high accuracy with a low folding rate. We introduced the dynamic matching module between the two branches of the registration, which generates learnable offsets based on all the tokens across the entire resolution range of the base branch features. Using trilinear interpolation, the model adjusts its feature expression range according to the learned offsets, capturing highly flexible positional differences. To facilitate the spatial matching process, we designed the gated mamba layer to globally model pixel-level features by associating all voxel information, while the detail enhancement module, which is based on channel and spatial attention, enhances the richness of local feature details.<i>Main results.</i>Our study explores the model's performance in single-modal and multi-modal image registration, including normal brain, brain tumor, and lung images. We propose unsupervised and semi-supervised registration modes and conduct extensive validation experiments. The results demonstrate that the model achieves state-of-the-art performance across multiple datasets.<i>Significance.</i>By introducing a novel perspective of position matching, the model achieves precise registration of various types of medical data, offering significant clinical value in medical applications.</p>","PeriodicalId":20185,"journal":{"name":"Physics in medicine and biology","volume":" ","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2025-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physics in medicine and biology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6560/adaacd","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Objective.Deformable registration aims to achieve nonlinear alignment of image space by estimating a dense displacement field. It is commonly used as a preprocessing step in clinical and image analysis applications, such as surgical planning, diagnostic assistance, and surgical navigation. We aim to overcome these challenges: Deep learning-based registration methods often struggle with complex displacements and lack effective interaction between global and local feature information. They also neglect the spatial position matching process, leading to insufficient registration accuracy and reduced robustness when handling abnormal tissues.Approach.We propose a dual-branch interactive registration model architecture from the perspective of spatial matching. Implicit regularization is achieved through a consistency loss, enabling the network to balance high accuracy with a low folding rate. We introduced the dynamic matching module between the two branches of the registration, which generates learnable offsets based on all the tokens across the entire resolution range of the base branch features. Using trilinear interpolation, the model adjusts its feature expression range according to the learned offsets, capturing highly flexible positional differences. To facilitate the spatial matching process, we designed the gated mamba layer to globally model pixel-level features by associating all voxel information, while the detail enhancement module, which is based on channel and spatial attention, enhances the richness of local feature details.Main results.Our study explores the model's performance in single-modal and multi-modal image registration, including normal brain, brain tumor, and lung images. We propose unsupervised and semi-supervised registration modes and conduct extensive validation experiments. The results demonstrate that the model achieves state-of-the-art performance across multiple datasets.Significance.By introducing a novel perspective of position matching, the model achieves precise registration of various types of medical data, offering significant clinical value in medical applications.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
GMmorph:基于门控曼巴的三维医学图像动态空间匹配配准模型。
目的:形变配准是通过估计密集的位移场来实现图像空间的非线性对齐。它通常用作临床和图像分析应用中的预处理步骤,例如手术计划,诊断辅助和手术导航。我们的目标是克服这些挑战:基于深度学习的配准方法通常难以处理复杂的位移,并且缺乏全局和局部特征信息之间的有效交互。它们忽略了空间位置匹配过程,导致在处理异常组织时配准精度不足,鲁棒性降低。 ;方法:我们从空间匹配的角度提出了一种双分支交互配准模型架构。隐式正则化是通过一致性损失实现的,使网络能够平衡高准确率和低折叠率。我们在注册的两个分支之间引入了动态匹配模块(DMM),它在整个基本分支特征的分辨率范围内基于所有令牌生成可学习的偏移量。利用三线性插值,模型根据学习到的偏移量调整特征表达范围,捕捉高度灵活的位置差异。为了方便空间匹配过程,我们设计了门控曼巴层(Gated Mamba Layer, GML),通过关联所有体素信息对像素级特征进行全局建模,而基于通道和空间关注的细节增强模块(Detail Enhancement Module, DEM)增强了局部特征细节的丰富度。 ;主要结果:我们研究了该模型在单模态和多模态图像配准中的性能,包括正常大脑、脑肿瘤和肺部图像。我们提出了无监督和半监督注册模式,并进行了大量的验证实验。结果表明,该模型在多个数据集上实现了最先进的性能。意义:通过引入新的位置匹配视角,该模型实现了各种类型医疗数据的精确配准,在医疗应用中具有重要的临床价值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Physics in medicine and biology
Physics in medicine and biology 医学-工程:生物医学
CiteScore
6.50
自引率
14.30%
发文量
409
审稿时长
2 months
期刊介绍: The development and application of theoretical, computational and experimental physics to medicine, physiology and biology. Topics covered are: therapy physics (including ionizing and non-ionizing radiation); biomedical imaging (e.g. x-ray, magnetic resonance, ultrasound, optical and nuclear imaging); image-guided interventions; image reconstruction and analysis (including kinetic modelling); artificial intelligence in biomedical physics and analysis; nanoparticles in imaging and therapy; radiobiology; radiation protection and patient dose monitoring; radiation dosimetry
期刊最新文献
Initial results of the Hyperion IIDPET insert for simultaneous PET-MRI applied to atherosclerotic plaque imaging in New-Zealand white rabbits. A multiplexing method based on multidimensional readout method. Diffusion transformer model with compact prior for low-dose PET reconstruction. A dual-domain network with division residual connection and feature fusion for CBCT scatter correction. A ConvLSTM-based model for predicting thermal damage during laser interstitial thermal therapy.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1