Arthur C. Costa, R. B. Vimieiro, L. Borges, B. Barufaldi, Andrew D. A. Maidment, M. Vieira
{"title":"评估视频帧插值网络生成数字乳房断层合成投影","authors":"Arthur C. Costa, R. B. Vimieiro, L. Borges, B. Barufaldi, Andrew D. A. Maidment, M. Vieira","doi":"10.1117/12.2625748","DOIUrl":null,"url":null,"abstract":"The angular range and number of projections are parameters that directly influence the image quality and the visibility of lesions in digital breast tomosynthesis (DBT). The medical field is taking advantage of the increasing performance of machine learning algorithms with the use of complex data-driven models, known as deep learning (DL) networks. The use of DL has also been highlighted in the tasks of video frame interpolation (VFI) for the synthesis of new images in order to increase the frame rate per second. In the present work, we use a residual refinement interpolation network (RRIN) to generate new synthetic DBT projections from pairs of real projections. We studied two different approaches: first, we increased the number of projections before reconstruction using the synthetic images, with the aim of improving the quality of the reconstructed slices without increasing the radiation dose to the patient. In the second, we investigated the effect of replacing existing projections with synthetic ones, with the objective of reducing the radiation dose and acquisition time. In the first approach, we used virtual phantoms to generate sets of DBT projections to train the network. We then evaluated the contrast-to-noise ratio (CNR) of simulated microcalcifications after reconstruction. The CNR was higher for all sets where supplementary images were added compared to those with only real images. In the second approach, we trained the network with clinical data and tested it with images acquired with a physical anthropomorphic breast phantom. Both the projections and the slices showed good similarity with the real ones, suggesting that the use of VFI networks to generate DBT projections is promising. However, further studies should be carried out to assess the feasibility of this approach.","PeriodicalId":92005,"journal":{"name":"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)","volume":"377 1","pages":"122861D - 122861D-8"},"PeriodicalIF":0.0000,"publicationDate":"2022-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Assessment of video frame interpolation network to generate digital breast tomosynthesis projections\",\"authors\":\"Arthur C. Costa, R. B. Vimieiro, L. Borges, B. Barufaldi, Andrew D. A. Maidment, M. Vieira\",\"doi\":\"10.1117/12.2625748\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The angular range and number of projections are parameters that directly influence the image quality and the visibility of lesions in digital breast tomosynthesis (DBT). The medical field is taking advantage of the increasing performance of machine learning algorithms with the use of complex data-driven models, known as deep learning (DL) networks. The use of DL has also been highlighted in the tasks of video frame interpolation (VFI) for the synthesis of new images in order to increase the frame rate per second. In the present work, we use a residual refinement interpolation network (RRIN) to generate new synthetic DBT projections from pairs of real projections. We studied two different approaches: first, we increased the number of projections before reconstruction using the synthetic images, with the aim of improving the quality of the reconstructed slices without increasing the radiation dose to the patient. In the second, we investigated the effect of replacing existing projections with synthetic ones, with the objective of reducing the radiation dose and acquisition time. In the first approach, we used virtual phantoms to generate sets of DBT projections to train the network. We then evaluated the contrast-to-noise ratio (CNR) of simulated microcalcifications after reconstruction. The CNR was higher for all sets where supplementary images were added compared to those with only real images. In the second approach, we trained the network with clinical data and tested it with images acquired with a physical anthropomorphic breast phantom. Both the projections and the slices showed good similarity with the real ones, suggesting that the use of VFI networks to generate DBT projections is promising. However, further studies should be carried out to assess the feasibility of this approach.\",\"PeriodicalId\":92005,\"journal\":{\"name\":\"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)\",\"volume\":\"377 1\",\"pages\":\"122861D - 122861D-8\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-07-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2625748\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Breast imaging : 11th International Workshop, IWDM 2012, Philadelphia, PA, USA, July 8-11, 2012 : proceedings. International Workshop on Breast Imaging (11th : 2012 : Philadelphia, Pa.)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2625748","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Assessment of video frame interpolation network to generate digital breast tomosynthesis projections
The angular range and number of projections are parameters that directly influence the image quality and the visibility of lesions in digital breast tomosynthesis (DBT). The medical field is taking advantage of the increasing performance of machine learning algorithms with the use of complex data-driven models, known as deep learning (DL) networks. The use of DL has also been highlighted in the tasks of video frame interpolation (VFI) for the synthesis of new images in order to increase the frame rate per second. In the present work, we use a residual refinement interpolation network (RRIN) to generate new synthetic DBT projections from pairs of real projections. We studied two different approaches: first, we increased the number of projections before reconstruction using the synthetic images, with the aim of improving the quality of the reconstructed slices without increasing the radiation dose to the patient. In the second, we investigated the effect of replacing existing projections with synthetic ones, with the objective of reducing the radiation dose and acquisition time. In the first approach, we used virtual phantoms to generate sets of DBT projections to train the network. We then evaluated the contrast-to-noise ratio (CNR) of simulated microcalcifications after reconstruction. The CNR was higher for all sets where supplementary images were added compared to those with only real images. In the second approach, we trained the network with clinical data and tested it with images acquired with a physical anthropomorphic breast phantom. Both the projections and the slices showed good similarity with the real ones, suggesting that the use of VFI networks to generate DBT projections is promising. However, further studies should be carried out to assess the feasibility of this approach.