Coordinate Translator for Learning Deformable Medical Image Registration.

Yihao Liu, Lianrui Zuo, Shuo Han, Yuan Xue, Jerry L Prince, Aaron Carass
{"title":"Coordinate Translator for Learning Deformable Medical Image Registration.","authors":"Yihao Liu,&nbsp;Lianrui Zuo,&nbsp;Shuo Han,&nbsp;Yuan Xue,&nbsp;Jerry L Prince,&nbsp;Aaron Carass","doi":"10.1007/978-3-031-18814-5_10","DOIUrl":null,"url":null,"abstract":"<p><p>The majority of deep learning (DL) based deformable image registration methods use convolutional neural networks (CNNs) to estimate displacement fields from pairs of moving and fixed images. This, however, requires the convolutional kernels in the CNN to not only extract intensity features from the inputs but also understand image coordinate systems. We argue that the latter task is challenging for traditional CNNs, limiting their performance in registration tasks. To tackle this problem, we first introduce Coordinate Translator, a differentiable module that identifies matched features between the fixed and moving image and outputs their coordinate correspondences without the need for training. It unloads the burden of understanding image coordinate systems for CNNs, allowing them to focus on feature extraction. We then propose a novel deformable registration network, im2grid, that uses multiple Coordinate Translator's with the hierarchical features extracted from a CNN encoder and outputs a deformation field in a coarse-to-fine fashion. We compared im2grid with the state-of-the-art DL and non-DL methods for unsupervised 3D magnetic resonance image registration. Our experiments show that im2grid outperforms these methods both qualitatively and quantitatively.</p>","PeriodicalId":74231,"journal":{"name":"Multiscale multimodal medical imaging : Third International Workshop, MMMI 2022, held in conjunction with MICCAI 2022, Singapore, September 22, 2022, proceedings","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9878358/pdf/nihms-1864533.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Multiscale multimodal medical imaging : Third International Workshop, MMMI 2022, held in conjunction with MICCAI 2022, Singapore, September 22, 2022, proceedings","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-18814-5_10","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The majority of deep learning (DL) based deformable image registration methods use convolutional neural networks (CNNs) to estimate displacement fields from pairs of moving and fixed images. This, however, requires the convolutional kernels in the CNN to not only extract intensity features from the inputs but also understand image coordinate systems. We argue that the latter task is challenging for traditional CNNs, limiting their performance in registration tasks. To tackle this problem, we first introduce Coordinate Translator, a differentiable module that identifies matched features between the fixed and moving image and outputs their coordinate correspondences without the need for training. It unloads the burden of understanding image coordinate systems for CNNs, allowing them to focus on feature extraction. We then propose a novel deformable registration network, im2grid, that uses multiple Coordinate Translator's with the hierarchical features extracted from a CNN encoder and outputs a deformation field in a coarse-to-fine fashion. We compared im2grid with the state-of-the-art DL and non-DL methods for unsupervised 3D magnetic resonance image registration. Our experiments show that im2grid outperforms these methods both qualitatively and quantitatively.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
坐标翻译学习变形医学图像配准。
大多数基于深度学习(DL)的可变形图像配准方法使用卷积神经网络(cnn)来估计运动和固定图像对的位移场。然而,这要求CNN中的卷积核不仅要从输入中提取强度特征,还要理解图像坐标系。我们认为后一项任务对传统cnn来说是一个挑战,限制了它们在注册任务中的表现。为了解决这个问题,我们首先引入了坐标转换器,这是一个可微模块,可以识别固定图像和运动图像之间的匹配特征,并在不需要训练的情况下输出它们的坐标对应。它为cnn减轻了理解图像坐标系统的负担,使他们能够专注于特征提取。然后,我们提出了一种新的可变形配准网络im2grid,它使用多个坐标转换器和从CNN编码器提取的分层特征,并以粗到细的方式输出变形场。我们将im2grid与最先进的深度学习和非深度学习方法进行了比较,用于无监督的3D磁共振图像配准。我们的实验表明,im2grid在定性和定量上都优于这些方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Detection of Fake Job Advertisements using Machine Learning algorithms Effective Approach for Early Detection of Diabetes by Logistic Regression through Risk Prediction Verification System for Handwritten Signatures with Modular Neural Networks Economic and competitive potential of lignin-based thermoplastics using a multicriteria decision-making method Development of reinforced paper and mitigation of the challenges of raw material availability by utilizing Areca nut leaf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1