A comparison of mixed-variables Bayesian optimization approaches

Jhouben Cuesta-Ramirez, R. Riche, O. Roustant, G. Perrin, Cédric Durantin, A. Glière
{"title":"A comparison of mixed-variables Bayesian optimization approaches","authors":"Jhouben Cuesta-Ramirez, R. Riche, O. Roustant, G. Perrin, Cédric Durantin, A. Glière","doi":"10.21203/rs.3.rs-1050987/v1","DOIUrl":null,"url":null,"abstract":"Most real optimization problems are defined over a mixed search space where the variables are both discrete and continuous. In engineering applications, the objective function is typically calculated with a numerically costly black-box simulation. General mixed and costly optimization problems are therefore of a great practical interest, yet their resolution remains in a large part an open scientific question. In this article, costly mixed problems are approached through Gaussian processes where the discrete variables are relaxed into continuous latent variables. The continuous space is more easily harvested by classical Bayesian optimization techniques than a mixed space would. Discrete variables are recovered either subsequently to the continuous optimization, or simultaneously with an additional continuous-discrete compatibility constraint that is handled with augmented Lagrangians. Several possible implementations of such Bayesian mixed optimizers are compared. In particular, the reformulation of the problem with continuous latent variables is put in competition with searches working directly in the mixed space. Among the algorithms involving latent variables and an augmented Lagrangian, a particular attention is devoted to the Lagrange multipliers for which a local and a global estimation techniques are studied. The comparisons are based on the repeated optimization of three analytical functions and a beam design problem.","PeriodicalId":37424,"journal":{"name":"Advanced Modeling and Simulation in Engineering Sciences","volume":"9 1","pages":"1-29"},"PeriodicalIF":2.0000,"publicationDate":"2021-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Modeling and Simulation in Engineering Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21203/rs.3.rs-1050987/v1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MECHANICS","Score":null,"Total":0}
引用次数: 7

Abstract

Most real optimization problems are defined over a mixed search space where the variables are both discrete and continuous. In engineering applications, the objective function is typically calculated with a numerically costly black-box simulation. General mixed and costly optimization problems are therefore of a great practical interest, yet their resolution remains in a large part an open scientific question. In this article, costly mixed problems are approached through Gaussian processes where the discrete variables are relaxed into continuous latent variables. The continuous space is more easily harvested by classical Bayesian optimization techniques than a mixed space would. Discrete variables are recovered either subsequently to the continuous optimization, or simultaneously with an additional continuous-discrete compatibility constraint that is handled with augmented Lagrangians. Several possible implementations of such Bayesian mixed optimizers are compared. In particular, the reformulation of the problem with continuous latent variables is put in competition with searches working directly in the mixed space. Among the algorithms involving latent variables and an augmented Lagrangian, a particular attention is devoted to the Lagrange multipliers for which a local and a global estimation techniques are studied. The comparisons are based on the repeated optimization of three analytical functions and a beam design problem.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
混合变量贝叶斯优化方法的比较
大多数实际的优化问题都是在混合搜索空间上定义的,其中变量既离散又连续。在工程应用中,目标函数通常使用数值昂贵的黑盒模拟进行计算。因此,一般的混合和昂贵的优化问题具有很大的实际意义,但它们的解决在很大程度上仍然是一个开放的科学问题。在本文中,通过高斯过程来处理代价高昂的混合问题,其中离散变量被松弛为连续的潜在变量。与混合空间相比,经典贝叶斯优化技术更容易获得连续空间。离散变量要么在连续优化之后恢复,要么与用增广拉格朗日算子处理的附加连续离散兼容性约束同时恢复。比较了这种贝叶斯混合优化器的几种可能的实现方式。特别是,具有连续潜变量的问题的重新表述与直接在混合空间中进行的搜索相竞争。在涉及潜在变量和增广拉格朗日量的算法中,特别关注拉格朗日乘子,研究了其局部和全局估计技术。比较是基于三个分析函数的重复优化和一个梁设计问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Advanced Modeling and Simulation in Engineering Sciences
Advanced Modeling and Simulation in Engineering Sciences Engineering-Engineering (miscellaneous)
CiteScore
6.80
自引率
0.00%
发文量
22
审稿时长
30 weeks
期刊介绍: The research topics addressed by Advanced Modeling and Simulation in Engineering Sciences (AMSES) cover the vast domain of the advanced modeling and simulation of materials, processes and structures governed by the laws of mechanics. The emphasis is on advanced and innovative modeling approaches and numerical strategies. The main objective is to describe the actual physics of large mechanical systems with complicated geometries as accurately as possible using complex, highly nonlinear and coupled multiphysics and multiscale models, and then to carry out simulations with these complex models as rapidly as possible. In other words, this research revolves around efficient numerical modeling along with model verification and validation. Therefore, the corresponding papers deal with advanced modeling and simulation, efficient optimization, inverse analysis, data-driven computation and simulation-based control. These challenging issues require multidisciplinary efforts – particularly in modeling, numerical analysis and computer science – which are treated in this journal.
期刊最新文献
Application of graph neural networks to predict explosion-induced transient flow Role of physical structure on performance index of crossflow microchannel heat exchanger with regression analysis Enhanced prediction of thermomechanical systems using machine learning, PCA, and finite element simulation Peridynamic numerical investigation of asymmetric strain-controlled fatigue behaviour using the kinetic theory of fracture Solving forward and inverse problems of contact mechanics using physics-informed neural networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1