基于无监督深度学习的高分辨率肾脏MRI回顾性运动校正图像翻译方法

Shahrzad Moinian , Nyoman D. Kurniawan , Shekhar S. Chandra , Viktor Vegh , David C. Reutens
{"title":"基于无监督深度学习的高分辨率肾脏MRI回顾性运动校正图像翻译方法","authors":"Shahrzad Moinian ,&nbsp;Nyoman D. Kurniawan ,&nbsp;Shekhar S. Chandra ,&nbsp;Viktor Vegh ,&nbsp;David C. Reutens","doi":"10.1016/j.ibmed.2023.100108","DOIUrl":null,"url":null,"abstract":"<div><p>A primary challenge for <em>in vivo</em> kidney magnetic resonance imaging (MRI) is the presence of different types of involuntary physiological motion, affecting the diagnostic utility of acquired images due to severe motion artifacts. Existing prospective and retrospective motion correction methods remain ineffective when dealing with complex large amplitude nonrigid motion artifacts. Here, we introduce an unsupervised deep learning-based image to image translation method between motion-affected and motion-free image domains, for correction of rigid-body, respiratory and nonrigid motion artifacts in <em>vivo</em> kidney MRI.</p><p>High resolution (i.e., 156 × 156 × 370 μm) <em>ex vivo</em> 3 Tesla MRI scans of 13 porcine kidneys (because of their anatomical homology to human kidney) were conducted using a 3D T2-weighted turbo spin echo sequence. Rigid-body, respiratory and nonrigid motion-affected images were then simulated using the magnitude-only <em>ex vivo</em> motion-free image set. Each 2D coronal slice of motion-affected and motion-free image volume was then divided into patches of 128 × 128 for training the model. We proposed to add normalised cross-correlation loss to cycle consistency generative adversarial network structure (NCC-CycleGAN), to enforce edge alignment between motion-corrected and motion-free image domains.</p><p>Our NCC-CycleGAN motion correction model demonstrated high performance with an in-tissue structural similarity index measure of 0.77 ± 0.08, peak signal-to-noise ratio of 26.67 ± 3.44 and learned perceptual image patch similarity of 0.173 ± 0.05 between the reconstructed motion-corrected and ground truth motion-free images. This corresponds to a significant respective average improvement of 34%, 23% and 39% (p &lt; 0.05; paired <em>t</em>-test) for the three metrics to correct the three different types of simulated motion artifacts.</p><p>We demonstrated the feasibility of developing an unsupervised deep learning-based method for efficient automated retrospective kidney MRI motion correction, while preserving microscopic tissue structures in high resolution imaging.</p></div>","PeriodicalId":73399,"journal":{"name":"Intelligence-based medicine","volume":"8 ","pages":"Article 100108"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An unsupervised deep learning-based image translation method for retrospective motion correction of high resolution kidney MRI\",\"authors\":\"Shahrzad Moinian ,&nbsp;Nyoman D. Kurniawan ,&nbsp;Shekhar S. Chandra ,&nbsp;Viktor Vegh ,&nbsp;David C. Reutens\",\"doi\":\"10.1016/j.ibmed.2023.100108\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>A primary challenge for <em>in vivo</em> kidney magnetic resonance imaging (MRI) is the presence of different types of involuntary physiological motion, affecting the diagnostic utility of acquired images due to severe motion artifacts. Existing prospective and retrospective motion correction methods remain ineffective when dealing with complex large amplitude nonrigid motion artifacts. Here, we introduce an unsupervised deep learning-based image to image translation method between motion-affected and motion-free image domains, for correction of rigid-body, respiratory and nonrigid motion artifacts in <em>vivo</em> kidney MRI.</p><p>High resolution (i.e., 156 × 156 × 370 μm) <em>ex vivo</em> 3 Tesla MRI scans of 13 porcine kidneys (because of their anatomical homology to human kidney) were conducted using a 3D T2-weighted turbo spin echo sequence. Rigid-body, respiratory and nonrigid motion-affected images were then simulated using the magnitude-only <em>ex vivo</em> motion-free image set. Each 2D coronal slice of motion-affected and motion-free image volume was then divided into patches of 128 × 128 for training the model. We proposed to add normalised cross-correlation loss to cycle consistency generative adversarial network structure (NCC-CycleGAN), to enforce edge alignment between motion-corrected and motion-free image domains.</p><p>Our NCC-CycleGAN motion correction model demonstrated high performance with an in-tissue structural similarity index measure of 0.77 ± 0.08, peak signal-to-noise ratio of 26.67 ± 3.44 and learned perceptual image patch similarity of 0.173 ± 0.05 between the reconstructed motion-corrected and ground truth motion-free images. This corresponds to a significant respective average improvement of 34%, 23% and 39% (p &lt; 0.05; paired <em>t</em>-test) for the three metrics to correct the three different types of simulated motion artifacts.</p><p>We demonstrated the feasibility of developing an unsupervised deep learning-based method for efficient automated retrospective kidney MRI motion correction, while preserving microscopic tissue structures in high resolution imaging.</p></div>\",\"PeriodicalId\":73399,\"journal\":{\"name\":\"Intelligence-based medicine\",\"volume\":\"8 \",\"pages\":\"Article 100108\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligence-based medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666521223000224\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligence-based medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666521223000224","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

体内肾脏磁共振成像(MRI)的主要挑战是存在不同类型的非自愿生理运动,由于严重的运动伪影,影响了采集图像的诊断效用。现有的前瞻性和回顾性运动校正方法在处理复杂的大振幅非刚性运动伪影时仍然无效。在这里,我们介绍了一种基于无监督深度学习的图像到图像在受运动影响和无运动图像域之间的转换方法,用于刚体的校正,活体肾脏MRI中的呼吸和非刚性运动伪影。使用3D T2加权turbo自旋回波序列对13个猪肾脏(由于其与人类肾脏的解剖同源性)进行了高分辨率(即156×156×370μm)的离体3特斯拉MRI扫描。然后使用仅幅值的离体无运动图像集模拟刚体、呼吸和非刚体运动影响的图像。然后,将受运动影响和无运动图像体积的每个2D冠状切片划分为128×128的块,用于训练模型。我们提出将归一化互相关损失添加到循环一致性生成对抗性网络结构(NCC CycleGAN)中,以加强运动校正和无运动图像域之间的边缘对齐。我们的NCC CycleGAN运动校正模型表现出高性能,组织内结构相似性指数为0.77±0.08,峰值信噪比为26.67±3.44,在重建的运动校正图像和无地面实况运动图像之间,学习感知图像块相似性为0.173±0.05。这对应于用于校正三种不同类型的模拟运动伪影的三个度量的34%、23%和39%的显著的各自平均改进(p<0.05;配对t检验)。我们证明了开发一种基于无监督深度学习的方法的可行性,该方法用于有效的自动回顾性肾脏MRI运动校正,同时在高分辨率成像中保留微观组织结构。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An unsupervised deep learning-based image translation method for retrospective motion correction of high resolution kidney MRI

A primary challenge for in vivo kidney magnetic resonance imaging (MRI) is the presence of different types of involuntary physiological motion, affecting the diagnostic utility of acquired images due to severe motion artifacts. Existing prospective and retrospective motion correction methods remain ineffective when dealing with complex large amplitude nonrigid motion artifacts. Here, we introduce an unsupervised deep learning-based image to image translation method between motion-affected and motion-free image domains, for correction of rigid-body, respiratory and nonrigid motion artifacts in vivo kidney MRI.

High resolution (i.e., 156 × 156 × 370 μm) ex vivo 3 Tesla MRI scans of 13 porcine kidneys (because of their anatomical homology to human kidney) were conducted using a 3D T2-weighted turbo spin echo sequence. Rigid-body, respiratory and nonrigid motion-affected images were then simulated using the magnitude-only ex vivo motion-free image set. Each 2D coronal slice of motion-affected and motion-free image volume was then divided into patches of 128 × 128 for training the model. We proposed to add normalised cross-correlation loss to cycle consistency generative adversarial network structure (NCC-CycleGAN), to enforce edge alignment between motion-corrected and motion-free image domains.

Our NCC-CycleGAN motion correction model demonstrated high performance with an in-tissue structural similarity index measure of 0.77 ± 0.08, peak signal-to-noise ratio of 26.67 ± 3.44 and learned perceptual image patch similarity of 0.173 ± 0.05 between the reconstructed motion-corrected and ground truth motion-free images. This corresponds to a significant respective average improvement of 34%, 23% and 39% (p < 0.05; paired t-test) for the three metrics to correct the three different types of simulated motion artifacts.

We demonstrated the feasibility of developing an unsupervised deep learning-based method for efficient automated retrospective kidney MRI motion correction, while preserving microscopic tissue structures in high resolution imaging.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Intelligence-based medicine
Intelligence-based medicine Health Informatics
CiteScore
5.00
自引率
0.00%
发文量
0
审稿时长
187 days
期刊最新文献
Artificial intelligence in child development monitoring: A systematic review on usage, outcomes and acceptance Automatic characterization of cerebral MRI images for the detection of autism spectrum disorders DOTnet 2.0: Deep learning network for diffuse optical tomography image reconstruction Artificial intelligence in child development monitoring: A systematic review on usage, outcomes and acceptance Clustering polycystic ovary syndrome laboratory results extracted from a large internet forum with machine learning
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1