{"title":"Interpretable Model Learning in Variational Imaging: A Bilevel Optimization Approach","authors":"Juan Carlos De los Reyes, David Villacís","doi":"10.1093/imamat/hxad024","DOIUrl":null,"url":null,"abstract":"Abstract In this paper, we investigate the use of bilevel optimization for model learning in variational imaging problems. Bilevel learning is an alternative approach to deep learning methods, which leads to fully interpretable models. However, it requires a detailed analytical insight into the underlying mathematical model. We focus on the bilevel learning problem for total variation models with spatially- and patch-dependent parameters. Our study encompasses the directional differentiability of the solution mapping, the derivation of optimality conditions, and the characterization of the Bouligand subdifferential of the solution operator. We also propose a two-phase trust-region algorithm for solving the problem and present numerical tests using the CelebA dataset.","PeriodicalId":56297,"journal":{"name":"IMA Journal of Applied Mathematics","volume":"13 1","pages":"0"},"PeriodicalIF":1.4000,"publicationDate":"2023-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IMA Journal of Applied Mathematics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/imamat/hxad024","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract In this paper, we investigate the use of bilevel optimization for model learning in variational imaging problems. Bilevel learning is an alternative approach to deep learning methods, which leads to fully interpretable models. However, it requires a detailed analytical insight into the underlying mathematical model. We focus on the bilevel learning problem for total variation models with spatially- and patch-dependent parameters. Our study encompasses the directional differentiability of the solution mapping, the derivation of optimality conditions, and the characterization of the Bouligand subdifferential of the solution operator. We also propose a two-phase trust-region algorithm for solving the problem and present numerical tests using the CelebA dataset.
期刊介绍:
The IMA Journal of Applied Mathematics is a direct successor of the Journal of the Institute of Mathematics and its Applications which was started in 1965. It is an interdisciplinary journal that publishes research on mathematics arising in the physical sciences and engineering as well as suitable articles in the life sciences, social sciences, and finance. Submissions should address interesting and challenging mathematical problems arising in applications. A good balance between the development of the application(s) and the analysis is expected. Papers that either use established methods to address solved problems or that present analysis in the absence of applications will not be considered.
The journal welcomes submissions in many research areas. Examples are: continuum mechanics materials science and elasticity, including boundary layer theory, combustion, complex flows and soft matter, electrohydrodynamics and magnetohydrodynamics, geophysical flows, granular flows, interfacial and free surface flows, vortex dynamics; elasticity theory; linear and nonlinear wave propagation, nonlinear optics and photonics; inverse problems; applied dynamical systems and nonlinear systems; mathematical physics; stochastic differential equations and stochastic dynamics; network science; industrial applications.