Assessment of video frame interpolation network to generate digital breast tomosynthesis projections

Arthur C. Costa, R. B. Vimieiro, L. Borges, B. Barufaldi, Andrew D. A. Maidment, M. Vieira
{"title":"Assessment of video frame interpolation network to generate digital breast tomosynthesis projections","authors":"Arthur C. Costa, R. B. Vimieiro, L. Borges, B. Barufaldi, Andrew D. A. Maidment, M. Vieira","doi":"10.1117/12.2625748","DOIUrl":null,"url":null,"abstract":"The angular range and number of projections are parameters that directly influence the image quality and the visibility of lesions in digital breast tomosynthesis (DBT). The medical field is taking advantage of the increasing performance of machine learning algorithms with the use of complex data-driven models, known as deep learning (DL) networks. The use of DL has also been highlighted in the tasks of video frame interpolation (VFI) for the synthesis of new images in order to increase the frame rate per second. In the present work, we use a residual refinement interpolation network (RRIN) to generate new synthetic DBT projections from pairs of real projections. We studied two different approaches: first, we increased the number of projections before reconstruction using the synthetic images, with the aim of improving the quality of the reconstructed slices without increasing the radiation dose to the patient. In the second, we investigated the effect of replacing existing projections with synthetic ones, with the objective of reducing the radiation dose and acquisition time. In the first approach, we used virtual phantoms to generate sets of DBT projections to train the network. We then evaluated the contrast-to-noise ratio (CNR) of simulated microcalcifications after reconstruction. The CNR was higher for all sets where supplementary images were added compared to those with only real images. In the second approach, we trained the network with clinical data and tested it with images acquired with a physical anthropomorphic breast phantom. Both the projections and the slices showed good similarity with the real ones, suggesting that the use of VFI networks to generate DBT projections is promising. However, further studies should be carried out to assess the feasibility of this approach.","PeriodicalId":92005,"journal":{"name":"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)","volume":"377 1","pages":"122861D - 122861D-8"},"PeriodicalIF":0.0000,"publicationDate":"2022-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2625748","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

The angular range and number of projections are parameters that directly influence the image quality and the visibility of lesions in digital breast tomosynthesis (DBT). The medical field is taking advantage of the increasing performance of machine learning algorithms with the use of complex data-driven models, known as deep learning (DL) networks. The use of DL has also been highlighted in the tasks of video frame interpolation (VFI) for the synthesis of new images in order to increase the frame rate per second. In the present work, we use a residual refinement interpolation network (RRIN) to generate new synthetic DBT projections from pairs of real projections. We studied two different approaches: first, we increased the number of projections before reconstruction using the synthetic images, with the aim of improving the quality of the reconstructed slices without increasing the radiation dose to the patient. In the second, we investigated the effect of replacing existing projections with synthetic ones, with the objective of reducing the radiation dose and acquisition time. In the first approach, we used virtual phantoms to generate sets of DBT projections to train the network. We then evaluated the contrast-to-noise ratio (CNR) of simulated microcalcifications after reconstruction. The CNR was higher for all sets where supplementary images were added compared to those with only real images. In the second approach, we trained the network with clinical data and tested it with images acquired with a physical anthropomorphic breast phantom. Both the projections and the slices showed good similarity with the real ones, suggesting that the use of VFI networks to generate DBT projections is promising. However, further studies should be carried out to assess the feasibility of this approach.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
评估视频帧插值网络生成数字乳房断层合成投影
在数字乳腺断层合成(DBT)中,投影的角度范围和数量是直接影响图像质量和病变可见性的参数。医疗领域正在利用复杂的数据驱动模型(即深度学习(DL)网络)来提高机器学习算法的性能。在合成新图像的视频帧插值(VFI)任务中,为了提高每秒帧率,DL的使用也得到了强调。在本工作中,我们使用残差细化插值网络(RRIN)从对真实投影生成新的合成DBT投影。我们研究了两种不同的方法:第一,我们在使用合成图像重建之前增加投影的数量,目的是在不增加对患者的辐射剂量的情况下提高重建切片的质量。其次,我们研究了用合成投影代替现有投影的效果,目的是减少辐射剂量和获取时间。在第一种方法中,我们使用虚拟幻影来生成DBT投影集来训练网络。然后我们评估重建后模拟微钙化的对比噪声比(CNR)。与只添加真实图像的集合相比,添加了补充图像的所有集合的CNR都更高。在第二种方法中,我们用临床数据训练网络,并用物理拟人化乳房幻影获得的图像对其进行测试。投影和切片都显示出与真实图像的良好相似性,这表明使用VFI网络生成DBT投影是有希望的。但是,应该进行进一步的研究,以评估这种方法的可行性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Robustness of a U-net model for different image processing types in segmentation of the mammary gland region Lesion detection in contrast enhanced spectral mammography Correspondence between areas causing recall in breast cancer screening and artificial intelligence findings Lesion detection in digital breast tomosynthesis: method, experiences and results of participating to the DBTex challenge Breast shape estimation and correction in CESM biopsy
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1