Yuer Lu, Yongfa Ying, Chen Lin, Yan Wang, Jun Jin, Xiaoming Jiang, Jianwei Shuai, Xiang Li, Jinjin Zhong
{"title":"UNet-Att: a self-supervised denoising and recovery model for two-photon microscopic image","authors":"Yuer Lu, Yongfa Ying, Chen Lin, Yan Wang, Jun Jin, Xiaoming Jiang, Jianwei Shuai, Xiang Li, Jinjin Zhong","doi":"10.1007/s40747-024-01633-7","DOIUrl":null,"url":null,"abstract":"<p>Two-photon microscopy is indispensable in cell and molecular biology for its high-resolution visualization of cellular and molecular dynamics. However, the inevitable low signal-to-noise conditions significantly degrade image quality, obscuring essential details and complicating morphological analysis. While existing denoising methods such as CNNs, Noise2Noise, and DeepCAD serve broad applications in imaging, they still have limitations in preserving texture structures and fine details in two-photon microscopic images affected by complex noise, particularly in sophisticated structures like neuronal synapses. To improve two-photon microscopy image denoising effectiveness, by experimenting on real two-photon microscopy images, we propose a novel deep learning framework, the UNet-Att model, which integrates a specifically tailored UNet++ architecture with attention mechanisms. Specifically, this approach consists of a sophisticated downsampling module for extracting hierarchical features at varied scales, and an innovative attention module that strategically emphasizes salient features during the integration process. The architecture is completed by an ingenious upsampling pathway that reconstructs the image with high fidelity, ensuring the retention of textural integrity. Additionally, the model supports end-to-end training, optimizing its denoising efficacy. The UNet-Att model proves to surpass mainstream algorithms in the dual objectives of denoising and preserving the textural intricacies of original images, which is evidenced by an increase of 9.42 dB in the high Peak Signal-to-Noise Ratio (PSNR) coupled with an improvement of 0.1131 in the Structural Similarity Index Measurement (SSIM). The ablation experiments reveal the effectiveness of each module. The associated Python packages and datasets of UNet-Att are freely available at https://github.com/ZjjDh/UNet-Att.</p>","PeriodicalId":10524,"journal":{"name":"Complex & Intelligent Systems","volume":"24 1","pages":""},"PeriodicalIF":5.0000,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Complex & Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s40747-024-01633-7","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Two-photon microscopy is indispensable in cell and molecular biology for its high-resolution visualization of cellular and molecular dynamics. However, the inevitable low signal-to-noise conditions significantly degrade image quality, obscuring essential details and complicating morphological analysis. While existing denoising methods such as CNNs, Noise2Noise, and DeepCAD serve broad applications in imaging, they still have limitations in preserving texture structures and fine details in two-photon microscopic images affected by complex noise, particularly in sophisticated structures like neuronal synapses. To improve two-photon microscopy image denoising effectiveness, by experimenting on real two-photon microscopy images, we propose a novel deep learning framework, the UNet-Att model, which integrates a specifically tailored UNet++ architecture with attention mechanisms. Specifically, this approach consists of a sophisticated downsampling module for extracting hierarchical features at varied scales, and an innovative attention module that strategically emphasizes salient features during the integration process. The architecture is completed by an ingenious upsampling pathway that reconstructs the image with high fidelity, ensuring the retention of textural integrity. Additionally, the model supports end-to-end training, optimizing its denoising efficacy. The UNet-Att model proves to surpass mainstream algorithms in the dual objectives of denoising and preserving the textural intricacies of original images, which is evidenced by an increase of 9.42 dB in the high Peak Signal-to-Noise Ratio (PSNR) coupled with an improvement of 0.1131 in the Structural Similarity Index Measurement (SSIM). The ablation experiments reveal the effectiveness of each module. The associated Python packages and datasets of UNet-Att are freely available at https://github.com/ZjjDh/UNet-Att.
期刊介绍:
Complex & Intelligent Systems aims to provide a forum for presenting and discussing novel approaches, tools and techniques meant for attaining a cross-fertilization between the broad fields of complex systems, computational simulation, and intelligent analytics and visualization. The transdisciplinary research that the journal focuses on will expand the boundaries of our understanding by investigating the principles and processes that underlie many of the most profound problems facing society today.