Metastability is a formidable challenge to Markov chain Monte Carlo methods. In this paper we present methods for algorithm design to meet this challenge. The design problem we consider is temperature selection for the infinite swapping scheme, which is the limit of the widely used parallel tempering scheme obtained when the swap rate tends to infinity. We use a recently developed tool for the analysis of the empirical measure of a small noise diffusion to transform the variance reduction problem into an explicit optimization problem. Our first analysis of the optimization problem is in the setting of a double well model, and it shows that the optimal selection of temperature ratios is a geometric sequence except possibly the highest temperature. In the same setting we identify two different sources of variance reduction, and show how their competition determines the optimal highest temperature. In the general multi-well setting we prove that a pure geometric sequence of temperature ratios is always nearly optimal, with a performance gap that decays geometrically in the number of temperatures.
{"title":"Analysis and Optimization of Certain Parallel Monte Carlo Methods in the Low Temperature Limit","authors":"P. Dupuis, Guo-Jhen Wu","doi":"10.1137/21m1402029","DOIUrl":"https://doi.org/10.1137/21m1402029","url":null,"abstract":"Metastability is a formidable challenge to Markov chain Monte Carlo methods. In this paper we present methods for algorithm design to meet this challenge. The design problem we consider is temperature selection for the infinite swapping scheme, which is the limit of the widely used parallel tempering scheme obtained when the swap rate tends to infinity. We use a recently developed tool for the analysis of the empirical measure of a small noise diffusion to transform the variance reduction problem into an explicit optimization problem. Our first analysis of the optimization problem is in the setting of a double well model, and it shows that the optimal selection of temperature ratios is a geometric sequence except possibly the highest temperature. In the same setting we identify two different sources of variance reduction, and show how their competition determines the optimal highest temperature. In the general multi-well setting we prove that a pure geometric sequence of temperature ratios is always nearly optimal, with a performance gap that decays geometrically in the number of temperatures.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128379504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We introduce and study a notion of Asymptotic Preserving schemes, related to convergence in distribution, for a class of slow-fast Stochastic Differential Equations. In some examples , crude schemes fail to capture the correct limiting equation resulting from averaging and diffusion approximation procedures. We propose examples of Asymptotic Preserving schemes: when the timescale separation vanishes, one obtains a limiting scheme, which is shown to be consistent in distribution with the limiting Stochastic Differential Equation. Numerical experiments illustrate the importance of the proposed Asymptotic Preserving schemes for several examples. In addition, in the averaging regime, error estimates are obtained and the proposed scheme is proved to be uniformly accurate.
{"title":"On Asymptotic Preserving schemes for a class of Stochastic Differential Equations in averaging and diffusion approximation regimes","authors":"Charles-Edouard Br'ehier, Shmuel Rakotonirina-Ricquebourg","doi":"10.1137/20m1379836","DOIUrl":"https://doi.org/10.1137/20m1379836","url":null,"abstract":"We introduce and study a notion of Asymptotic Preserving schemes, related to convergence in distribution, for a class of slow-fast Stochastic Differential Equations. In some examples , crude schemes fail to capture the correct limiting equation resulting from averaging and diffusion approximation procedures. We propose examples of Asymptotic Preserving schemes: when the timescale separation vanishes, one obtains a limiting scheme, which is shown to be consistent in distribution with the limiting Stochastic Differential Equation. Numerical experiments illustrate the importance of the proposed Asymptotic Preserving schemes for several examples. In addition, in the averaging regime, error estimates are obtained and the proposed scheme is proved to be uniformly accurate.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131837645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We present a data-driven point of view for the rare events, which represent conformational transitions in biochemical reactions modeled by over-damped Langevin dynamics on manifolds in high dimensions. Given the point clouds sampled from an unknown reaction dynamics, we construct a discrete Markov process based on an approximated Voronoi tesselation which incorporates both the equilibrium and the manifold information. We reinterpret the transition state theory and transition path theory from the optimal control viewpoint. The controlled random walk on point clouds is utilized to simulate the transition path, which becomes an almost sure event instead of a rare event in the original reaction dynamics. Some numerical examples on sphere and torus are conducted to illustrate the data-driven solver for transition path theory on point clouds. The resulting dominated transition path highly coincides with the mean transition path obtained via the controlled Monte Carlo simulations.
{"title":"Transition path theory for Langevin dynamics on manifold: optimal control and data-driven solver","authors":"Yuan Gao, Tiejun Li, Xiaoguang Li, Jianguo Liu","doi":"10.1137/21M1437883","DOIUrl":"https://doi.org/10.1137/21M1437883","url":null,"abstract":"We present a data-driven point of view for the rare events, which represent conformational transitions in biochemical reactions modeled by over-damped Langevin dynamics on manifolds in high dimensions. Given the point clouds sampled from an unknown reaction dynamics, we construct a discrete Markov process based on an approximated Voronoi tesselation which incorporates both the equilibrium and the manifold information. We reinterpret the transition state theory and transition path theory from the optimal control viewpoint. The controlled random walk on point clouds is utilized to simulate the transition path, which becomes an almost sure event instead of a rare event in the original reaction dynamics. Some numerical examples on sphere and torus are conducted to illustrate the data-driven solver for transition path theory on point clouds. The resulting dominated transition path highly coincides with the mean transition path obtained via the controlled Monte Carlo simulations.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130279701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Investigation of dynamic processes in cell biology very often relies on the observation in two dimensions of 3D biological processes. Consequently, the data are partial and statistical methods and models are required to recover the parameters describing the dynamical processes. In the case of molecules moving over the 3D surface, such as proteins on walls of bacteria cell, a large portion of the 3D surface is not observed in 2D-time microscopy. It follows that biomolecules may disappear for a period of time in a region of interest, and then reappear later. Assuming Brownian motion with drift, we address the mathematical problem of the reconstruction of biomolecules trajectories on a cylindrical surface. A subregion of the cylinder is typically recorded during the observation period, and biomolecules may appear or disappear in any place of the 3D surface. The performance of the method is demonstrated on simulated particle trajectories that mimic MreB protein dynamics observed in 2D time-lapse fluorescence microscopy in rod-shaped bacteria.
{"title":"Probabilistic Reconstruction of Truncated Particle Trajectories on a Closed Surface","authors":"Yunjiao Lu, P. Hodara, C. Kervrann, A. Trubuil","doi":"10.1137/20M1333742","DOIUrl":"https://doi.org/10.1137/20M1333742","url":null,"abstract":"Investigation of dynamic processes in cell biology very often relies on the observation in two dimensions of 3D biological processes. Consequently, the data are partial and statistical methods and models are required to recover the parameters describing the dynamical processes. In the case of molecules moving over the 3D surface, such as proteins on walls of bacteria cell, a large portion of the 3D surface is not observed in 2D-time microscopy. It follows that biomolecules may disappear for a period of time in a region of interest, and then reappear later. Assuming Brownian motion with drift, we address the mathematical problem of the reconstruction of biomolecules trajectories on a cylindrical surface. A subregion of the cylinder is typically recorded during the observation period, and biomolecules may appear or disappear in any place of the 3D surface. The performance of the method is demonstrated on simulated particle trajectories that mimic MreB protein dynamics observed in 2D time-lapse fluorescence microscopy in rod-shaped bacteria.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129281227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Fackeldey, M. Oster, Leon Sallandt, R. Schneider
We consider a stochastic optimal exit time feedback control problem. The Bellman equation is solved approximatively via the Policy Iteration algorithm on a polynomial ansatz space by a sequence of linear equations. As high degree multi-polynomials are needed, the corresponding equations suffer from the curse of dimensionality even in moderate dimensions. We employ tensor-train methods to account for this problem. The approximation process within the Policy Iteration is done via a Least-Squares ansatz and the integration is done via Monte-Carlo methods. Numerical evidences are given for the (multi dimensional) double well potential and a three-hole potential.
{"title":"Approximative Policy Iteration for Exit Time Feedback Control Problems Driven by Stochastic Differential Equations using Tensor Train Format","authors":"K. Fackeldey, M. Oster, Leon Sallandt, R. Schneider","doi":"10.1137/20m1372500","DOIUrl":"https://doi.org/10.1137/20m1372500","url":null,"abstract":"We consider a stochastic optimal exit time feedback control problem. The Bellman equation is solved approximatively via the Policy Iteration algorithm on a polynomial ansatz space by a sequence of linear equations. As high degree multi-polynomials are needed, the corresponding equations suffer from the curse of dimensionality even in moderate dimensions. We employ tensor-train methods to account for this problem. The approximation process within the Policy Iteration is done via a Least-Squares ansatz and the integration is done via Monte-Carlo methods. Numerical evidences are given for the (multi dimensional) double well potential and a three-hole potential.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"244 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114606318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anne Dietrich, N. Kolbe, Nikolaos Sfakianakis, C. Surulescu
We propose a novel approach to modeling cell migration in an anisotropic environment with biochemical heterogeneity and interspecies interactions, using as a paradigm glioma invasion in brain tissue under the influence of hypoxia-triggered angiogenesis. The multiscale procedure links single-cell and mesoscopic dynamics with population level behavior, leading on the macroscopic scale to flux-limited glioma diffusion and multiple taxis. We verify the non-negativity of regular solutions (provided they exist) to the obtained macroscopic PDE-ODE system and perform numerical simulations to illustrate the solution behavior under several scenarios.
{"title":"Multiscale Modeling of Glioma Invasion: From Receptor Binding to Flux-Limited Macroscopic PDEs","authors":"Anne Dietrich, N. Kolbe, Nikolaos Sfakianakis, C. Surulescu","doi":"10.1137/21m1412104","DOIUrl":"https://doi.org/10.1137/21m1412104","url":null,"abstract":"We propose a novel approach to modeling cell migration in an anisotropic environment with biochemical heterogeneity and interspecies interactions, using as a paradigm glioma invasion in brain tissue under the influence of hypoxia-triggered angiogenesis. The multiscale procedure links single-cell and mesoscopic dynamics with population level behavior, leading on the macroscopic scale to flux-limited glioma diffusion and multiple taxis. We verify the non-negativity of regular solutions (provided they exist) to the obtained macroscopic PDE-ODE system and perform numerical simulations to illustrate the solution behavior under several scenarios.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123725758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In the first part of the paper, we propose and rigorously analyze a mixed finite element method for the approximation of the periodic strong solution to the fully nonlinear second-order Hamilton--Jacobi--Bellman equation with coefficients satisfying the Cordes condition. These problems arise as the corrector problems in the homogenization of Hamilton--Jacobi--Bellman equations. The second part of the paper focuses on the numerical homogenization of such equations, more precisely on the numerical approximation of the effective Hamiltonian. Numerical experiments demonstrate the approximation scheme for the effective Hamiltonian and the numerical solution of the homogenized problem.
{"title":"Mixed finite element approximation of periodic Hamilton-Jacobi-Bellman problems with application to numerical homogenization","authors":"D. Gallistl, Timo Sprekeler, E. Süli","doi":"10.1137/20M1371397","DOIUrl":"https://doi.org/10.1137/20M1371397","url":null,"abstract":"In the first part of the paper, we propose and rigorously analyze a mixed finite element method for the approximation of the periodic strong solution to the fully nonlinear second-order Hamilton--Jacobi--Bellman equation with coefficients satisfying the Cordes condition. These problems arise as the corrector problems in the homogenization of Hamilton--Jacobi--Bellman equations. The second part of the paper focuses on the numerical homogenization of such equations, more precisely on the numerical approximation of the effective Hamiltonian. Numerical experiments demonstrate the approximation scheme for the effective Hamiltonian and the numerical solution of the homogenized problem.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"218 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126106838","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yves Capdeboscq, Roland Griesmaier, Marvin Knöller
We consider the scattering of time-harmonic electromagnetic waves by a penetrable thin tubular scattering object in three-dimensional free space. We establish an asymptotic representation formula for the scattered wave away from the thin tubular scatterer as the radius of its cross-section tends to zero. The shape, the relative electric permeability and the relative magnetic permittivity of the scattering object enter this asymptotic representation formula by means of the center curve of the thin tubular scatterer and two electric and magnetic polarization tensors. We give an explicit characterization of these two three-dimensional polarization tensors in terms of the center curve and of the two two-dimensional polarization tensor for the cross-section of the scattering object. As an application we demonstrate how this formula may be used to evaluate the residual and the shape derivative in an efficient iterative reconstruction algorithm for an inverse scattering problem with thin tubular scattering objects. We present numerical results to illustrate our theoretical findings.
{"title":"An Asymptotic Representation Formula for Scattering by Thin Tubular Structures and an Application in Inverse Scattering","authors":"Yves Capdeboscq, Roland Griesmaier, Marvin Knöller","doi":"10.5445/IR/1000124274","DOIUrl":"https://doi.org/10.5445/IR/1000124274","url":null,"abstract":"We consider the scattering of time-harmonic electromagnetic waves by a penetrable thin tubular scattering object in three-dimensional free space. We establish an asymptotic representation formula for the scattered wave away from the thin tubular scatterer as the radius of its cross-section tends to zero. The shape, the relative electric permeability and the relative magnetic permittivity of the scattering object enter this asymptotic representation formula by means of the center curve of the thin tubular scatterer and two electric and magnetic polarization tensors. We give an explicit characterization of these two three-dimensional polarization tensors in terms of the center curve and of the two two-dimensional polarization tensor for the cross-section of the scattering object. As an application we demonstrate how this formula may be used to evaluate the residual and the shape derivative in an efficient iterative reconstruction algorithm for an inverse scattering problem with thin tubular scattering objects. We present numerical results to illustrate our theoretical findings.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"204 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114282612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We study optimal convergence rates in the periodic homogenization of linear elliptic equations of the form $-A(x/varepsilon):D^2 u^{varepsilon} = f$ subject to a homogeneous Dirichlet boundary condition. We show that the optimal rate for the convergence of $u^{varepsilon}$ to the solution of the corresponding homogenized problem in the $W^{1,p}$-norm is $mathcal{O}(varepsilon)$. We further obtain optimal gradient and Hessian bounds with correction terms taken into account in the $L^p$-norm. We then provide an explicit $c$-bad diffusion matrix and use it to perform various numerical experiments, which demonstrate the optimality of the obtained rates.
{"title":"Optimal Convergence Rates for Elliptic Homogenization Problems in Nondivergence-Form: Analysis and Numerical Illustrations","authors":"Timo Sprekeler, H. Tran","doi":"10.1137/20M137121X","DOIUrl":"https://doi.org/10.1137/20M137121X","url":null,"abstract":"We study optimal convergence rates in the periodic homogenization of linear elliptic equations of the form $-A(x/varepsilon):D^2 u^{varepsilon} = f$ subject to a homogeneous Dirichlet boundary condition. We show that the optimal rate for the convergence of $u^{varepsilon}$ to the solution of the corresponding homogenized problem in the $W^{1,p}$-norm is $mathcal{O}(varepsilon)$. We further obtain optimal gradient and Hessian bounds with correction terms taken into account in the $L^p$-norm. We then provide an explicit $c$-bad diffusion matrix and use it to perform various numerical experiments, which demonstrate the optimality of the obtained rates.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117339837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We study the derivation of generic high order macroscopic traffic models from a follow-the-leader particle description via a kinetic approach. First, we recover a third order traffic model as the hydrodynamic limit of an Enskog-type kinetic equation. Next, we introduce in the vehicle interactions a binary control modelling the automatic feedback provided by driver-assist vehicles and we upscale such a new particle description by means of another Enskog-based hydrodynamic limit. The resulting macroscopic model is now a Generic Second Order Model (GSOM), which contains in turn a control term inherited from the microscopic interactions. We show that such a control may be chosen so as to optimise global traffic trends, such as the vehicle flux or the road congestion, constrained by the GSOM dynamics. By means of numerical simulations, we investigate the effect of this control hierarchy in some specific case studies, which exemplify the multiscale path from the vehicle-wise implementation of a driver-assist control to its optimal hydrodynamic design.
{"title":"Multiscale Control of Generic Second Order Traffic Models by Driver-Assist Vehicles","authors":"F. A. Chiarello, B. Piccoli, A. Tosin","doi":"10.1137/20M1360128","DOIUrl":"https://doi.org/10.1137/20M1360128","url":null,"abstract":"We study the derivation of generic high order macroscopic traffic models from a follow-the-leader particle description via a kinetic approach. First, we recover a third order traffic model as the hydrodynamic limit of an Enskog-type kinetic equation. Next, we introduce in the vehicle interactions a binary control modelling the automatic feedback provided by driver-assist vehicles and we upscale such a new particle description by means of another Enskog-based hydrodynamic limit. The resulting macroscopic model is now a Generic Second Order Model (GSOM), which contains in turn a control term inherited from the microscopic interactions. We show that such a control may be chosen so as to optimise global traffic trends, such as the vehicle flux or the road congestion, constrained by the GSOM dynamics. By means of numerical simulations, we investigate the effect of this control hierarchy in some specific case studies, which exemplify the multiscale path from the vehicle-wise implementation of a driver-assist control to its optimal hydrodynamic design.","PeriodicalId":313703,"journal":{"name":"Multiscale Model. Simul.","volume":"240 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122996827","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}