Reconstructing interpretable features in computational super-resolution microscopy via regularized latent search.

Biological imaging Pub Date : 2024-05-30 eCollection Date: 2024-01-01 DOI:10.1017/S2633903X24000084
Marzieh Gheisari, Auguste Genovesio
{"title":"Reconstructing interpretable features in computational super-resolution microscopy via regularized latent search.","authors":"Marzieh Gheisari, Auguste Genovesio","doi":"10.1017/S2633903X24000084","DOIUrl":null,"url":null,"abstract":"<p><p>Supervised deep learning approaches can artificially increase the resolution of microscopy images by learning a mapping between two image resolutions or modalities. However, such methods often require a large set of hard-to-get low-res/high-res image pairs and produce synthetic images with a moderate increase in resolution. Conversely, recent methods based on generative adversarial network (GAN) latent search offered a drastic increase in resolution without the need of paired images. However, they offer limited reconstruction of the high-resolution (HR) image interpretable features. Here, we propose a robust super-resolution (SR) method based on regularized latent search (RLS) that offers an actionable balance between fidelity to the ground truth (GT) and realism of the recovered image given a distribution prior. The latter allows to split the analysis of a low-resolution (LR) image into a computational SR task performed by deep learning followed by a quantification task performed by a handcrafted algorithm based on interpretable biological features. This two-step process holds potential for various applications such as diagnostics on mobile devices, where the main aim is not to recover the HR details of a specific sample but rather to obtain HR images that preserve explainable and quantifiable differences between conditions.</p>","PeriodicalId":72371,"journal":{"name":"Biological imaging","volume":"4 ","pages":"e8"},"PeriodicalIF":0.0000,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11418082/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biological imaging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1017/S2633903X24000084","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Supervised deep learning approaches can artificially increase the resolution of microscopy images by learning a mapping between two image resolutions or modalities. However, such methods often require a large set of hard-to-get low-res/high-res image pairs and produce synthetic images with a moderate increase in resolution. Conversely, recent methods based on generative adversarial network (GAN) latent search offered a drastic increase in resolution without the need of paired images. However, they offer limited reconstruction of the high-resolution (HR) image interpretable features. Here, we propose a robust super-resolution (SR) method based on regularized latent search (RLS) that offers an actionable balance between fidelity to the ground truth (GT) and realism of the recovered image given a distribution prior. The latter allows to split the analysis of a low-resolution (LR) image into a computational SR task performed by deep learning followed by a quantification task performed by a handcrafted algorithm based on interpretable biological features. This two-step process holds potential for various applications such as diagnostics on mobile devices, where the main aim is not to recover the HR details of a specific sample but rather to obtain HR images that preserve explainable and quantifiable differences between conditions.

Abstract Image

Abstract Image

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
通过正则化潜在搜索重建计算超分辨率显微镜中的可解释特征。
有监督的深度学习方法可以通过学习两种图像分辨率或模式之间的映射,人为提高显微图像的分辨率。然而,这类方法通常需要大量难以获得的低分辨率/高分辨率图像对,生成的合成图像分辨率也只能适度提高。相反,最近基于生成式对抗网络(GAN)潜搜索的方法无需配对图像即可大幅提高分辨率。然而,这些方法对高分辨率(HR)图像可解释特征的重建有限。在此,我们提出了一种基于正则化潜在搜索(RLS)的鲁棒性超分辨率(SR)方法,该方法在忠实于地面实况(GT)和给定分布先验的恢复图像逼真度之间实现了可操作的平衡。后者可以将低分辨率(LR)图像的分析拆分为由深度学习执行的计算 SR 任务和由基于可解释生物特征的手工算法执行的量化任务。这种两步法可用于各种应用,如移动设备诊断,其主要目的不是恢复特定样本的 HR 细节,而是获取 HR 图像,以保留不同条件下可解释和可量化的差异。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Deep-learning-based image compression for microscopy images: An empirical study. The quest for early detection of retinal disease: 3D CycleGAN-based translation of optical coherence tomography into confocal microscopy. Bridging the gap: Integrating cutting-edge techniques into biological imaging with deepImageJ. Deep-blur: Blind identification and deblurring with convolutional neural networks. Exploring self-supervised learning biases for microscopy image representation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1