Qiangyu Cai, Jun Lu, Wenting Gu, Di Xiao, Boyi Li, Lei Xu, Yuanjie Gu, Biqin Dong, Xin Liu
{"title":"利用具有物理先验的卷积网络对荧光显微镜图像进行超分辨率重建。","authors":"Qiangyu Cai, Jun Lu, Wenting Gu, Di Xiao, Boyi Li, Lei Xu, Yuanjie Gu, Biqin Dong, Xin Liu","doi":"10.1364/BOE.537589","DOIUrl":null,"url":null,"abstract":"<p><p>Super-solution fluorescence microscopy, such as single-molecule localization microscopy (SMLM), is effective in observing subcellular structures and achieving excellent enhancement in spatial resolution in contrast to traditional fluorescence microscopy. Recently, deep learning has demonstrated excellent performance in SMLM in solving the trade-offs between spatiotemporal resolution, phototoxicity, and signal intensity. However, most of these researches rely on sufficient and high-quality datasets. Here, we propose a physical priors-based convolutional super-resolution network (PCSR), which incorporates a physical-based loss term and an initial optimization process based on the Wiener filter to create excellent super-resolution images directly using low-resolution images. The experimental results demonstrate that PCSR enables the achievement of a fast reconstruction time of 100 ms and a high spatial resolution of 10 nm by training on a limited dataset, allowing subcellular research with high spatiotemporal resolution, low cell phototoxic illumination, and high accessibility. In addition, the generalizability of PCSR to different live cell structures makes it a practical instrument for diverse cell research.</p>","PeriodicalId":8969,"journal":{"name":"Biomedical optics express","volume":"15 11","pages":"6638-6653"},"PeriodicalIF":2.9000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11563314/pdf/","citationCount":"0","resultStr":"{\"title\":\"Super resolution reconstruction of fluorescence microscopy images by a convolutional network with physical priors.\",\"authors\":\"Qiangyu Cai, Jun Lu, Wenting Gu, Di Xiao, Boyi Li, Lei Xu, Yuanjie Gu, Biqin Dong, Xin Liu\",\"doi\":\"10.1364/BOE.537589\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Super-solution fluorescence microscopy, such as single-molecule localization microscopy (SMLM), is effective in observing subcellular structures and achieving excellent enhancement in spatial resolution in contrast to traditional fluorescence microscopy. Recently, deep learning has demonstrated excellent performance in SMLM in solving the trade-offs between spatiotemporal resolution, phototoxicity, and signal intensity. However, most of these researches rely on sufficient and high-quality datasets. Here, we propose a physical priors-based convolutional super-resolution network (PCSR), which incorporates a physical-based loss term and an initial optimization process based on the Wiener filter to create excellent super-resolution images directly using low-resolution images. The experimental results demonstrate that PCSR enables the achievement of a fast reconstruction time of 100 ms and a high spatial resolution of 10 nm by training on a limited dataset, allowing subcellular research with high spatiotemporal resolution, low cell phototoxic illumination, and high accessibility. In addition, the generalizability of PCSR to different live cell structures makes it a practical instrument for diverse cell research.</p>\",\"PeriodicalId\":8969,\"journal\":{\"name\":\"Biomedical optics express\",\"volume\":\"15 11\",\"pages\":\"6638-6653\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11563314/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical optics express\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1364/BOE.537589\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"BIOCHEMICAL RESEARCH METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical optics express","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1364/BOE.537589","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
Super resolution reconstruction of fluorescence microscopy images by a convolutional network with physical priors.
Super-solution fluorescence microscopy, such as single-molecule localization microscopy (SMLM), is effective in observing subcellular structures and achieving excellent enhancement in spatial resolution in contrast to traditional fluorescence microscopy. Recently, deep learning has demonstrated excellent performance in SMLM in solving the trade-offs between spatiotemporal resolution, phototoxicity, and signal intensity. However, most of these researches rely on sufficient and high-quality datasets. Here, we propose a physical priors-based convolutional super-resolution network (PCSR), which incorporates a physical-based loss term and an initial optimization process based on the Wiener filter to create excellent super-resolution images directly using low-resolution images. The experimental results demonstrate that PCSR enables the achievement of a fast reconstruction time of 100 ms and a high spatial resolution of 10 nm by training on a limited dataset, allowing subcellular research with high spatiotemporal resolution, low cell phototoxic illumination, and high accessibility. In addition, the generalizability of PCSR to different live cell structures makes it a practical instrument for diverse cell research.
期刊介绍:
The journal''s scope encompasses fundamental research, technology development, biomedical studies and clinical applications. BOEx focuses on the leading edge topics in the field, including:
Tissue optics and spectroscopy
Novel microscopies
Optical coherence tomography
Diffuse and fluorescence tomography
Photoacoustic and multimodal imaging
Molecular imaging and therapies
Nanophotonic biosensing
Optical biophysics/photobiology
Microfluidic optical devices
Vision research.