利用多项式特征合成对医学图像进行通用拓扑细化分割

Liu Li, Hanchun Wang, Matthew Baugh, Qiang Ma, Weitong Zhang, Cheng Ouyang, Daniel Rueckert, Bernhard Kainz
{"title":"利用多项式特征合成对医学图像进行通用拓扑细化分割","authors":"Liu Li, Hanchun Wang, Matthew Baugh, Qiang Ma, Weitong Zhang, Cheng Ouyang, Daniel Rueckert, Bernhard Kainz","doi":"arxiv-2409.09796","DOIUrl":null,"url":null,"abstract":"Although existing medical image segmentation methods provide impressive\npixel-wise accuracy, they often neglect topological correctness, making their\nsegmentations unusable for many downstream tasks. One option is to retrain such\nmodels whilst including a topology-driven loss component. However, this is\ncomputationally expensive and often impractical. A better solution would be to\nhave a versatile plug-and-play topology refinement method that is compatible\nwith any domain-specific segmentation pipeline. Directly training a\npost-processing model to mitigate topological errors often fails as such models\ntend to be biased towards the topological errors of a target segmentation\nnetwork. The diversity of these errors is confined to the information provided\nby a labelled training set, which is especially problematic for small datasets.\nOur method solves this problem by training a model-agnostic topology refinement\nnetwork with synthetic segmentations that cover a wide variety of topological\nerrors. Inspired by the Stone-Weierstrass theorem, we synthesize\ntopology-perturbation masks with randomly sampled coefficients of orthogonal\npolynomial bases, which ensures a complete and unbiased representation.\nPractically, we verified the efficiency and effectiveness of our methods as\nbeing compatible with multiple families of polynomial bases, and show evidence\nthat our universal plug-and-play topology refinement network outperforms both\nexisting topology-driven learning-based and post-processing methods. We also\nshow that combining our method with learning-based models provides an\neffortless add-on, which can further improve the performance of existing\napproaches.","PeriodicalId":501289,"journal":{"name":"arXiv - EE - Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Universal Topology Refinement for Medical Image Segmentation with Polynomial Feature Synthesis\",\"authors\":\"Liu Li, Hanchun Wang, Matthew Baugh, Qiang Ma, Weitong Zhang, Cheng Ouyang, Daniel Rueckert, Bernhard Kainz\",\"doi\":\"arxiv-2409.09796\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Although existing medical image segmentation methods provide impressive\\npixel-wise accuracy, they often neglect topological correctness, making their\\nsegmentations unusable for many downstream tasks. One option is to retrain such\\nmodels whilst including a topology-driven loss component. However, this is\\ncomputationally expensive and often impractical. A better solution would be to\\nhave a versatile plug-and-play topology refinement method that is compatible\\nwith any domain-specific segmentation pipeline. Directly training a\\npost-processing model to mitigate topological errors often fails as such models\\ntend to be biased towards the topological errors of a target segmentation\\nnetwork. The diversity of these errors is confined to the information provided\\nby a labelled training set, which is especially problematic for small datasets.\\nOur method solves this problem by training a model-agnostic topology refinement\\nnetwork with synthetic segmentations that cover a wide variety of topological\\nerrors. Inspired by the Stone-Weierstrass theorem, we synthesize\\ntopology-perturbation masks with randomly sampled coefficients of orthogonal\\npolynomial bases, which ensures a complete and unbiased representation.\\nPractically, we verified the efficiency and effectiveness of our methods as\\nbeing compatible with multiple families of polynomial bases, and show evidence\\nthat our universal plug-and-play topology refinement network outperforms both\\nexisting topology-driven learning-based and post-processing methods. We also\\nshow that combining our method with learning-based models provides an\\neffortless add-on, which can further improve the performance of existing\\napproaches.\",\"PeriodicalId\":501289,\"journal\":{\"name\":\"arXiv - EE - Image and Video Processing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - EE - Image and Video Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.09796\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Image and Video Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09796","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

尽管现有的医学图像分割方法在像素精度上令人印象深刻,但它们往往忽视拓扑的正确性,导致其分割结果无法用于许多下游任务。一种方法是重新训练此类模型,同时加入拓扑驱动的损失成分。然而,这样做的计算成本很高,而且往往不切实际。更好的解决方案是采用一种通用的即插即用拓扑细化方法,这种方法可以与任何特定领域的分割管道兼容。直接训练拓扑处理模型来减少拓扑误差往往会失败,因为这种模型往往偏向于目标分割网络的拓扑误差。我们的方法通过使用涵盖各种拓扑错误的合成分割来训练一个与模型无关的拓扑细化网络,从而解决了这个问题。在 Stone-Weierstrass 定理的启发下,我们用随机采样的正交多项式基的系数合成拓扑扰动掩码,从而确保了完整且无偏的表示。在实践中,我们验证了我们的方法与多个多项式基系列兼容的效率和有效性,并证明我们的通用即插即用拓扑细化网络优于现有的基于拓扑驱动学习的方法和后处理方法。我们还展示了将我们的方法与基于学习的模型相结合的简便附加方法,它能进一步提高现有方法的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Universal Topology Refinement for Medical Image Segmentation with Polynomial Feature Synthesis
Although existing medical image segmentation methods provide impressive pixel-wise accuracy, they often neglect topological correctness, making their segmentations unusable for many downstream tasks. One option is to retrain such models whilst including a topology-driven loss component. However, this is computationally expensive and often impractical. A better solution would be to have a versatile plug-and-play topology refinement method that is compatible with any domain-specific segmentation pipeline. Directly training a post-processing model to mitigate topological errors often fails as such models tend to be biased towards the topological errors of a target segmentation network. The diversity of these errors is confined to the information provided by a labelled training set, which is especially problematic for small datasets. Our method solves this problem by training a model-agnostic topology refinement network with synthetic segmentations that cover a wide variety of topological errors. Inspired by the Stone-Weierstrass theorem, we synthesize topology-perturbation masks with randomly sampled coefficients of orthogonal polynomial bases, which ensures a complete and unbiased representation. Practically, we verified the efficiency and effectiveness of our methods as being compatible with multiple families of polynomial bases, and show evidence that our universal plug-and-play topology refinement network outperforms both existing topology-driven learning-based and post-processing methods. We also show that combining our method with learning-based models provides an effortless add-on, which can further improve the performance of existing approaches.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
multiPI-TransBTS: A Multi-Path Learning Framework for Brain Tumor Image Segmentation Based on Multi-Physical Information Autopet III challenge: Incorporating anatomical knowledge into nnUNet for lesion segmentation in PET/CT Denoising diffusion models for high-resolution microscopy image restoration Tumor aware recurrent inter-patient deformable image registration of computed tomography scans with lung cancer Cross-Organ and Cross-Scanner Adenocarcinoma Segmentation using Rein to Fine-tune Vision Foundation Models
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1