Anparasy Sivaanpu , Kumaradevan Punithakumar , Kokul Thanikasalam , Michelle Noga , Rui Zheng , Dean Ta , Edmond H.M. Lou , Lawrence H. Le
{"title":"使用并行注意力模块和胶囊生成对抗网络的轻量级超声图像去噪器","authors":"Anparasy Sivaanpu , Kumaradevan Punithakumar , Kokul Thanikasalam , Michelle Noga , Rui Zheng , Dean Ta , Edmond H.M. Lou , Lawrence H. Le","doi":"10.1016/j.imu.2024.101569","DOIUrl":null,"url":null,"abstract":"<div><p>The quality of ultrasound (US) imaging has been constrained by its limited contrast and resolution, inherent speckle noise, and the presence of other artifacts. Existing traditional and deep learning-based US denoising approaches have many limitations, such as reliance on manual parameter configurations, poor performance for unknown noise levels, the requirement for a large number of training data, and high computational expense. To address these challenges, we propose a novel Generative Adversarial Network (GAN) based denoiser. Capsule networks are utilized in both the generator and discriminator of the proposed GAN to capture intricate sparse features with less complexity. In addition, bias components are removed from all neurons of the generator to handle the unknown noise levels. A parallel attention module is also included in the proposed model to further enhance denoising performance. The proposed approach is trained in a semi-supervised manner and can thus be trained with fewer labeled images. Experimental evaluation on publicly available HC18 and BUSI datasets showed that the proposed approach achieved state-of-the-art denoising performance, with PSNR values of 33.86 and 34.16, and SSIM indices of 0.91 and 0.90, respectively. Moreover, experiments showed that the proposed approach is lightweight and more than twice as fast as similar denoisers.</p></div>","PeriodicalId":13953,"journal":{"name":"Informatics in Medicine Unlocked","volume":"50 ","pages":"Article 101569"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2352914824001254/pdfft?md5=2b794aebffd78d4c605d374f27873417&pid=1-s2.0-S2352914824001254-main.pdf","citationCount":"0","resultStr":"{\"title\":\"A Lightweight Ultrasound Image Denoiser Using Parallel Attention Modules and Capsule Generative Adversarial Network\",\"authors\":\"Anparasy Sivaanpu , Kumaradevan Punithakumar , Kokul Thanikasalam , Michelle Noga , Rui Zheng , Dean Ta , Edmond H.M. Lou , Lawrence H. Le\",\"doi\":\"10.1016/j.imu.2024.101569\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The quality of ultrasound (US) imaging has been constrained by its limited contrast and resolution, inherent speckle noise, and the presence of other artifacts. Existing traditional and deep learning-based US denoising approaches have many limitations, such as reliance on manual parameter configurations, poor performance for unknown noise levels, the requirement for a large number of training data, and high computational expense. To address these challenges, we propose a novel Generative Adversarial Network (GAN) based denoiser. Capsule networks are utilized in both the generator and discriminator of the proposed GAN to capture intricate sparse features with less complexity. In addition, bias components are removed from all neurons of the generator to handle the unknown noise levels. A parallel attention module is also included in the proposed model to further enhance denoising performance. The proposed approach is trained in a semi-supervised manner and can thus be trained with fewer labeled images. Experimental evaluation on publicly available HC18 and BUSI datasets showed that the proposed approach achieved state-of-the-art denoising performance, with PSNR values of 33.86 and 34.16, and SSIM indices of 0.91 and 0.90, respectively. Moreover, experiments showed that the proposed approach is lightweight and more than twice as fast as similar denoisers.</p></div>\",\"PeriodicalId\":13953,\"journal\":{\"name\":\"Informatics in Medicine Unlocked\",\"volume\":\"50 \",\"pages\":\"Article 101569\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2352914824001254/pdfft?md5=2b794aebffd78d4c605d374f27873417&pid=1-s2.0-S2352914824001254-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Informatics in Medicine Unlocked\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2352914824001254\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Informatics in Medicine Unlocked","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352914824001254","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
摘要
超声波(US)成像的质量一直受限于其有限的对比度和分辨率、固有的斑点噪声以及其他伪影的存在。现有的传统和基于深度学习的 US 去噪方法有很多局限性,如依赖手动参数配置、对未知噪声水平的性能较差、需要大量训练数据以及计算成本较高。为了应对这些挑战,我们提出了一种基于生成对抗网络(GAN)的新型去噪器。在所提出的 GAN 的生成器和判别器中都使用了胶囊网络,以较低的复杂度捕捉错综复杂的稀疏特征。此外,生成器的所有神经元都去除了偏置成分,以处理未知噪声水平。拟议模型中还包含一个并行注意模块,以进一步提高去噪性能。所提出的方法采用半监督方式进行训练,因此可以使用较少的标记图像进行训练。在公开的 HC18 和 BUSI 数据集上进行的实验评估表明,所提出的方法达到了最先进的去噪性能,PSNR 值分别为 33.86 和 34.16,SSIM 指数分别为 0.91 和 0.90。此外,实验还表明,所提出的方法重量轻,速度是同类去噪器的两倍多。
A Lightweight Ultrasound Image Denoiser Using Parallel Attention Modules and Capsule Generative Adversarial Network
The quality of ultrasound (US) imaging has been constrained by its limited contrast and resolution, inherent speckle noise, and the presence of other artifacts. Existing traditional and deep learning-based US denoising approaches have many limitations, such as reliance on manual parameter configurations, poor performance for unknown noise levels, the requirement for a large number of training data, and high computational expense. To address these challenges, we propose a novel Generative Adversarial Network (GAN) based denoiser. Capsule networks are utilized in both the generator and discriminator of the proposed GAN to capture intricate sparse features with less complexity. In addition, bias components are removed from all neurons of the generator to handle the unknown noise levels. A parallel attention module is also included in the proposed model to further enhance denoising performance. The proposed approach is trained in a semi-supervised manner and can thus be trained with fewer labeled images. Experimental evaluation on publicly available HC18 and BUSI datasets showed that the proposed approach achieved state-of-the-art denoising performance, with PSNR values of 33.86 and 34.16, and SSIM indices of 0.91 and 0.90, respectively. Moreover, experiments showed that the proposed approach is lightweight and more than twice as fast as similar denoisers.
期刊介绍:
Informatics in Medicine Unlocked (IMU) is an international gold open access journal covering a broad spectrum of topics within medical informatics, including (but not limited to) papers focusing on imaging, pathology, teledermatology, public health, ophthalmological, nursing and translational medicine informatics. The full papers that are published in the journal are accessible to all who visit the website.