Ruyi Han , Shenghai Liao , Shujun Fu , Xingzhou Wang
{"title":"Transformed sparsity-boosted low-rank model for image inpainting with non-convex γ-norm regularization and non-local prior","authors":"Ruyi Han , Shenghai Liao , Shujun Fu , Xingzhou Wang","doi":"10.1016/j.optlastec.2024.111865","DOIUrl":null,"url":null,"abstract":"<div><div>Low-rank prior has important applications in image restoration tasks, particularly in filling in missing information through low-rank matrix completion models. Although the truncated nuclear norm is a classic low-rank algorithm, practical solutions often rely on convex regularized nuclear norm to approximate the rank function, which limits its approximation ability and leads to blurry edges and loss of details. To improve restoration performance, we introduce a non-convex <span><math><mi>γ</mi></math></span>-norm. Theoretical analysis shows that the <span><math><mi>γ</mi></math></span>-norm approximates the rank function more accurately than the nuclear norm, leading to a novel non-convex low-rank approximation model. Furthermore, we enhance the model by introducing transform domain sparse regularization, aimed at capturing more local details and texture information, thereby improving inpainting quality. Addressing the limitations of traditional low-rank matrix restoration models in cases of entire row or column missing, we introduce a multi-pixel window strategy based on the new model, utilizing non-local similarity to search for similar blocks in the multi-pixel neighborhood of the target block to restore the entire column and eliminate residual column artifacts. Our method demonstrates excellent performance. We compare it with several state-of-the-art image restoration techniques across multiple tasks, including pixel restoration, text and scratch removal, column inpainting, and cloud removal. Experimental results prove that our method shows significant advantages in both visual quality and quantitative evaluation.</div></div>","PeriodicalId":19511,"journal":{"name":"Optics and Laser Technology","volume":"181 ","pages":"Article 111865"},"PeriodicalIF":4.6000,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Laser Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0030399224013239","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0
Abstract
Low-rank prior has important applications in image restoration tasks, particularly in filling in missing information through low-rank matrix completion models. Although the truncated nuclear norm is a classic low-rank algorithm, practical solutions often rely on convex regularized nuclear norm to approximate the rank function, which limits its approximation ability and leads to blurry edges and loss of details. To improve restoration performance, we introduce a non-convex -norm. Theoretical analysis shows that the -norm approximates the rank function more accurately than the nuclear norm, leading to a novel non-convex low-rank approximation model. Furthermore, we enhance the model by introducing transform domain sparse regularization, aimed at capturing more local details and texture information, thereby improving inpainting quality. Addressing the limitations of traditional low-rank matrix restoration models in cases of entire row or column missing, we introduce a multi-pixel window strategy based on the new model, utilizing non-local similarity to search for similar blocks in the multi-pixel neighborhood of the target block to restore the entire column and eliminate residual column artifacts. Our method demonstrates excellent performance. We compare it with several state-of-the-art image restoration techniques across multiple tasks, including pixel restoration, text and scratch removal, column inpainting, and cloud removal. Experimental results prove that our method shows significant advantages in both visual quality and quantitative evaluation.
期刊介绍:
Optics & Laser Technology aims to provide a vehicle for the publication of a broad range of high quality research and review papers in those fields of scientific and engineering research appertaining to the development and application of the technology of optics and lasers. Papers describing original work in these areas are submitted to rigorous refereeing prior to acceptance for publication.
The scope of Optics & Laser Technology encompasses, but is not restricted to, the following areas:
•development in all types of lasers
•developments in optoelectronic devices and photonics
•developments in new photonics and optical concepts
•developments in conventional optics, optical instruments and components
•techniques of optical metrology, including interferometry and optical fibre sensors
•LIDAR and other non-contact optical measurement techniques, including optical methods in heat and fluid flow
•applications of lasers to materials processing, optical NDT display (including holography) and optical communication
•research and development in the field of laser safety including studies of hazards resulting from the applications of lasers (laser safety, hazards of laser fume)
•developments in optical computing and optical information processing
•developments in new optical materials
•developments in new optical characterization methods and techniques
•developments in quantum optics
•developments in light assisted micro and nanofabrication methods and techniques
•developments in nanophotonics and biophotonics
•developments in imaging processing and systems