Friedrich Menhorn, Gianluca Geraci, D. Thomas Seidl, Youssef Marzouk, Michael S. Eldred, Hans-Joachim Bungartz
{"title":"不确定条件下无导数优化的多电平蒙特卡罗估计","authors":"Friedrich Menhorn, Gianluca Geraci, D. Thomas Seidl, Youssef Marzouk, Michael S. Eldred, Hans-Joachim Bungartz","doi":"10.1615/int.j.uncertaintyquantification.2023048049","DOIUrl":null,"url":null,"abstract":"Optimization is a key tool for scientific and engineering applications, however, in the presence of models affected by\nuncertainty, the optimization formulation needs to be extended to consider statistics of the quantity of interest. Op-\ntimization under uncertainty (OUU) deals with this endeavor and requires uncertainty quantification analyses at\nseveral design locations. The cost of OUU is proportional to the cost of performing a forward uncertainty analysis at\neach design location visited, which makes the computational burden too high for high-fidelity simulations with sig-\nnificant computational cost. From a high-level standpoint, an OUU workflow typically has two main components: an\ninner loop strategy for the computation of statistics of the quantity of interest, and an outer loop optimization strategy\ntasked with finding the optimal design, given a merit function based on the inner loop statistics. In this work, we\npropose to alleviate the cost of the inner loop uncertainty analysis by leveraging the so-called Multilevel Monte Carlo\n(MLMC) method. MLMC has the potential of drastically reducing the computational cost by allocating resources over\nmultiple models with varying accuracy and cost. The resource allocation problem in MLMC is formulated by mini-\nmizing the computational cost given a target variance for the estimator. We consider MLMC estimators for statistics\nusually employed in OUU workflows and solve the corresponding allocation problem. For the outer loop, we consider\na derivative-free optimization strategy implemented in the SNOWPAC library; our novel strategy is implemented and\nreleased in the Dakota software toolkit. We discuss several n","PeriodicalId":48814,"journal":{"name":"International Journal for Uncertainty Quantification","volume":"428 8","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MULTILEVEL MONTE CARLO ESTIMATORS FOR DERIVATIVE-FREE OPTIMIZATION UNDER UNCERTAINTY\",\"authors\":\"Friedrich Menhorn, Gianluca Geraci, D. Thomas Seidl, Youssef Marzouk, Michael S. Eldred, Hans-Joachim Bungartz\",\"doi\":\"10.1615/int.j.uncertaintyquantification.2023048049\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Optimization is a key tool for scientific and engineering applications, however, in the presence of models affected by\\nuncertainty, the optimization formulation needs to be extended to consider statistics of the quantity of interest. Op-\\ntimization under uncertainty (OUU) deals with this endeavor and requires uncertainty quantification analyses at\\nseveral design locations. The cost of OUU is proportional to the cost of performing a forward uncertainty analysis at\\neach design location visited, which makes the computational burden too high for high-fidelity simulations with sig-\\nnificant computational cost. From a high-level standpoint, an OUU workflow typically has two main components: an\\ninner loop strategy for the computation of statistics of the quantity of interest, and an outer loop optimization strategy\\ntasked with finding the optimal design, given a merit function based on the inner loop statistics. In this work, we\\npropose to alleviate the cost of the inner loop uncertainty analysis by leveraging the so-called Multilevel Monte Carlo\\n(MLMC) method. MLMC has the potential of drastically reducing the computational cost by allocating resources over\\nmultiple models with varying accuracy and cost. The resource allocation problem in MLMC is formulated by mini-\\nmizing the computational cost given a target variance for the estimator. We consider MLMC estimators for statistics\\nusually employed in OUU workflows and solve the corresponding allocation problem. For the outer loop, we consider\\na derivative-free optimization strategy implemented in the SNOWPAC library; our novel strategy is implemented and\\nreleased in the Dakota software toolkit. We discuss several n\",\"PeriodicalId\":48814,\"journal\":{\"name\":\"International Journal for Uncertainty Quantification\",\"volume\":\"428 8\",\"pages\":\"\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2023-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal for Uncertainty Quantification\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1615/int.j.uncertaintyquantification.2023048049\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal for Uncertainty Quantification","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1615/int.j.uncertaintyquantification.2023048049","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
MULTILEVEL MONTE CARLO ESTIMATORS FOR DERIVATIVE-FREE OPTIMIZATION UNDER UNCERTAINTY
Optimization is a key tool for scientific and engineering applications, however, in the presence of models affected by
uncertainty, the optimization formulation needs to be extended to consider statistics of the quantity of interest. Op-
timization under uncertainty (OUU) deals with this endeavor and requires uncertainty quantification analyses at
several design locations. The cost of OUU is proportional to the cost of performing a forward uncertainty analysis at
each design location visited, which makes the computational burden too high for high-fidelity simulations with sig-
nificant computational cost. From a high-level standpoint, an OUU workflow typically has two main components: an
inner loop strategy for the computation of statistics of the quantity of interest, and an outer loop optimization strategy
tasked with finding the optimal design, given a merit function based on the inner loop statistics. In this work, we
propose to alleviate the cost of the inner loop uncertainty analysis by leveraging the so-called Multilevel Monte Carlo
(MLMC) method. MLMC has the potential of drastically reducing the computational cost by allocating resources over
multiple models with varying accuracy and cost. The resource allocation problem in MLMC is formulated by mini-
mizing the computational cost given a target variance for the estimator. We consider MLMC estimators for statistics
usually employed in OUU workflows and solve the corresponding allocation problem. For the outer loop, we consider
a derivative-free optimization strategy implemented in the SNOWPAC library; our novel strategy is implemented and
released in the Dakota software toolkit. We discuss several n
期刊介绍:
The International Journal for Uncertainty Quantification disseminates information of permanent interest in the areas of analysis, modeling, design and control of complex systems in the presence of uncertainty. The journal seeks to emphasize methods that cross stochastic analysis, statistical modeling and scientific computing. Systems of interest are governed by differential equations possibly with multiscale features. Topics of particular interest include representation of uncertainty, propagation of uncertainty across scales, resolving the curse of dimensionality, long-time integration for stochastic PDEs, data-driven approaches for constructing stochastic models, validation, verification and uncertainty quantification for predictive computational science, and visualization of uncertainty in high-dimensional spaces. Bayesian computation and machine learning techniques are also of interest for example in the context of stochastic multiscale systems, for model selection/classification, and decision making. Reports addressing the dynamic coupling of modern experiments and modeling approaches towards predictive science are particularly encouraged. Applications of uncertainty quantification in all areas of physical and biological sciences are appropriate.