Yuhao Li, Wenkang Gong, Tianle Li, Jiaqing Dong, Xianlin Song
{"title":"Defocus-enhanced technique for real-world scenarios using generative models","authors":"Yuhao Li, Wenkang Gong, Tianle Li, Jiaqing Dong, Xianlin Song","doi":"10.1117/12.3007254","DOIUrl":null,"url":null,"abstract":"In recent years, significant progress has been made in deep learning-based image deblurring. These approaches utilize deep neural networks to learn the map between blurry and clear images or jointly learn the blurry kernel and clear image. They have demonstrated effectiveness in enhancing image quality, preserving details, and handling various types and degrees of blur. The objective of this study is to develop a defocus enhancement technique for real-world scenarios using score-based generative models. Stochastic differential equations (SDE) are employed to gradually introduce noise, thereby smoothing the data distribution towards a known prior distribution. The Score-Matching Langevin Dynamics (SMLD) model estimates the score for each noise scale, while Diffusion Models (DDPM) train the target model for score computation. This process constructs a score-based model capable of reversing the SDE over time. A predictor-corrector framework corrects the evolution of the reverse-time SDE, and the prior distribution is transformed back to the data distribution by removing the noise. By leveraging score-based generative models, accurate score estimation and sample generation are achieved using neural networks and numerical SDE solvers. This technique effectively restores clarity and details in defocused images, thereby enhancing overall image quality.","PeriodicalId":505225,"journal":{"name":"Advanced Imaging and Information Processing","volume":"41 9","pages":"129420F - 129420F-5"},"PeriodicalIF":0.0000,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Imaging and Information Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.3007254","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In recent years, significant progress has been made in deep learning-based image deblurring. These approaches utilize deep neural networks to learn the map between blurry and clear images or jointly learn the blurry kernel and clear image. They have demonstrated effectiveness in enhancing image quality, preserving details, and handling various types and degrees of blur. The objective of this study is to develop a defocus enhancement technique for real-world scenarios using score-based generative models. Stochastic differential equations (SDE) are employed to gradually introduce noise, thereby smoothing the data distribution towards a known prior distribution. The Score-Matching Langevin Dynamics (SMLD) model estimates the score for each noise scale, while Diffusion Models (DDPM) train the target model for score computation. This process constructs a score-based model capable of reversing the SDE over time. A predictor-corrector framework corrects the evolution of the reverse-time SDE, and the prior distribution is transformed back to the data distribution by removing the noise. By leveraging score-based generative models, accurate score estimation and sample generation are achieved using neural networks and numerical SDE solvers. This technique effectively restores clarity and details in defocused images, thereby enhancing overall image quality.