ConvexAdam: Self-Configuring Dual-Optimisation-Based 3D Multitask Medical Image Registration.

Hanna Siebert, Christoph Grossbrohmer, Lasse Hansen, Mattias P Heinrich
{"title":"ConvexAdam: Self-Configuring Dual-Optimisation-Based 3D Multitask Medical Image Registration.","authors":"Hanna Siebert, Christoph Grossbrohmer, Lasse Hansen, Mattias P Heinrich","doi":"10.1109/TMI.2024.3462248","DOIUrl":null,"url":null,"abstract":"<p><p>Registration of medical image data requires methods that can align anatomical structures precisely while applying smooth and plausible transformations. Ideally, these methods should furthermore operate quickly and apply to a wide variety of tasks. Deep learning-based image registration methods usually entail an elaborate learning procedure with the need for extensive training data. However, they often struggle with versatility when aiming to apply the same approach across various anatomical regions and different imaging modalities. In this work, we present a method that extracts semantic or hand-crafted image features and uses a coupled convex optimisation followed by Adam-based instance optimisation for multitask medical image registration. We make use of pre-trained semantic feature extraction models for the individual datasets and combine them with our fast dual optimisation procedure for deformation field computation. Furthermore, we propose a very fast automatic hyperparameter selection procedure that explores many settings and ranks them on validation data to provide a self-configuring image registration framework. With our approach, we can align image data for various tasks with little learning. We conduct experiments on all available Learn2Reg challenge datasets and obtain results that are to be positioned in the upper ranks of the challenge leaderboards. github.com/multimodallearning/convexAdam.</p>","PeriodicalId":94033,"journal":{"name":"IEEE transactions on medical imaging","volume":"PP ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical imaging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/TMI.2024.3462248","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Registration of medical image data requires methods that can align anatomical structures precisely while applying smooth and plausible transformations. Ideally, these methods should furthermore operate quickly and apply to a wide variety of tasks. Deep learning-based image registration methods usually entail an elaborate learning procedure with the need for extensive training data. However, they often struggle with versatility when aiming to apply the same approach across various anatomical regions and different imaging modalities. In this work, we present a method that extracts semantic or hand-crafted image features and uses a coupled convex optimisation followed by Adam-based instance optimisation for multitask medical image registration. We make use of pre-trained semantic feature extraction models for the individual datasets and combine them with our fast dual optimisation procedure for deformation field computation. Furthermore, we propose a very fast automatic hyperparameter selection procedure that explores many settings and ranks them on validation data to provide a self-configuring image registration framework. With our approach, we can align image data for various tasks with little learning. We conduct experiments on all available Learn2Reg challenge datasets and obtain results that are to be positioned in the upper ranks of the challenge leaderboards. github.com/multimodallearning/convexAdam.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
ConvexAdam:基于自配置双优化的三维多任务医学图像配准。
医学图像数据的配准需要能精确对准解剖结构的方法,同时应用平滑、合理的变换。理想情况下,这些方法应能快速运行,并适用于各种任务。基于深度学习的图像配准方法通常需要复杂的学习过程,并需要大量的训练数据。然而,当要在不同的解剖区域和不同的成像模式中应用同一种方法时,这些方法往往难以实现通用性。在这项工作中,我们提出了一种提取语义或手工制作图像特征的方法,并将耦合凸优化和基于亚当的实例优化用于多任务医学图像配准。我们利用为各个数据集预先训练好的语义特征提取模型,并将其与我们的快速双重优化程序相结合,进行变形场计算。此外,我们还提出了一种非常快速的自动超参数选择程序,该程序可探索多种设置,并根据验证数据对其进行排序,从而提供一个可自行配置的图像配准框架。利用我们的方法,我们只需很少的学习就能为各种任务配准图像数据。我们在所有可用的 Learn2Reg 挑战数据集上进行了实验,并取得了在挑战排行榜上名列前茅的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Building a Synthetic Vascular Model: Evaluation in an Intracranial Aneurysms Detection Scenario. FAMF-Net: Feature Alignment Mutual Attention Fusion with Region Awareness for Breast Cancer Diagnosis via Imbalanced Data. Table of Contents Corrections to “Contrastive Graph Pooling for Explainable Classification of Brain Networks” Multi-Center Fetal Brain Tissue Annotation (FeTA) Challenge 2022 Results.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1