Image fusion network for dual-modal restoration

IF 1.2 4区 数学 Q2 MATHEMATICS, APPLIED Inverse Problems and Imaging Pub Date : 2021-01-01 DOI:10.3934/ipi.2021067
Ying Zhang, Xuhua Ren, B. Clifford, Qian Wang, Xiaoqun Zhang
{"title":"Image fusion network for dual-modal restoration","authors":"Ying Zhang, Xuhua Ren, B. Clifford, Qian Wang, Xiaoqun Zhang","doi":"10.3934/ipi.2021067","DOIUrl":null,"url":null,"abstract":"In recent years multi-modal data processing methods have gained considerable research interest as technological advancements in imaging, computing, and data storage have made the collection of redundant, multi-modal data more commonplace. In this work we present an image restoration method tailored for scenarios where pre-existing, high-quality images from different modalities or contrasts are available in addition to the target image. Our method is based on a novel network architecture which combines the benefits of traditional multi-scale signal representation, such as wavelets, with more recent concepts from data fusion methods. Results from numerical simulations in which T1-weighted MRI images are used to restore noisy and undersampled T2-weighted images demonstrate that the proposed network successfully utilizes information from high-quality reference images to improve the restoration quality of the target image beyond that of existing popular methods.","PeriodicalId":50274,"journal":{"name":"Inverse Problems and Imaging","volume":null,"pages":null},"PeriodicalIF":1.2000,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Inverse Problems and Imaging","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.3934/ipi.2021067","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years multi-modal data processing methods have gained considerable research interest as technological advancements in imaging, computing, and data storage have made the collection of redundant, multi-modal data more commonplace. In this work we present an image restoration method tailored for scenarios where pre-existing, high-quality images from different modalities or contrasts are available in addition to the target image. Our method is based on a novel network architecture which combines the benefits of traditional multi-scale signal representation, such as wavelets, with more recent concepts from data fusion methods. Results from numerical simulations in which T1-weighted MRI images are used to restore noisy and undersampled T2-weighted images demonstrate that the proposed network successfully utilizes information from high-quality reference images to improve the restoration quality of the target image beyond that of existing popular methods.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
双峰恢复图像融合网络
近年来,随着成像、计算和数据存储技术的进步,使得冗余、多模态数据的收集变得更加普遍,多模态数据处理方法获得了相当大的研究兴趣。在这项工作中,我们提出了一种图像恢复方法,适用于除了目标图像之外,还可以获得来自不同模态或对比度的预先存在的高质量图像的场景。我们的方法是基于一种新的网络架构,它结合了传统的多尺度信号表示(如小波)的优点和数据融合方法的最新概念。利用t1加权MRI图像恢复有噪声和欠采样的t2加权图像的数值模拟结果表明,所提出的网络成功地利用了高质量参考图像的信息,提高了目标图像的恢复质量,超过了现有的流行方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Inverse Problems and Imaging
Inverse Problems and Imaging 数学-物理:数学物理
CiteScore
2.50
自引率
0.00%
发文量
55
审稿时长
>12 weeks
期刊介绍: Inverse Problems and Imaging publishes research articles of the highest quality that employ innovative mathematical and modeling techniques to study inverse and imaging problems arising in engineering and other sciences. Every published paper has a strong mathematical orientation employing methods from such areas as control theory, discrete mathematics, differential geometry, harmonic analysis, functional analysis, integral geometry, mathematical physics, numerical analysis, optimization, partial differential equations, and stochastic and statistical methods. The field of applications includes medical and other imaging, nondestructive testing, geophysical prospection and remote sensing as well as image analysis and image processing. This journal is committed to recording important new results in its field and will maintain the highest standards of innovation and quality. To be published in this journal, a paper must be correct, novel, nontrivial and of interest to a substantial number of researchers and readers.
期刊最新文献
Inverse problems of identifying the time-dependent source coefficient for subelliptic heat equations Imaging of conductivity distribution based on a combined reconstruction method in brain electrical impedance tomography Deblurring photographs of characters using deep neural networks Determination of piecewise homogeneous sources for elastic and electromagnetic waves Nonlinearity parameter imaging in the frequency domain
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1