首页 > 最新文献

arXiv - MATH - Optimization and Control最新文献

英文 中文
New Aspects of Black Box Conditional Gradient: Variance Reduction and One Point Feedback 黑箱条件梯度的新方面:方差缩小和一点反馈
Pub Date : 2024-09-16 DOI: arxiv-2409.10442
Andrey Veprikov, Alexander Bogdanov, Vladislav Minashkin, Alexander Beznosikov
This paper deals with the black-box optimization problem. In this setup, wedo not have access to the gradient of the objective function, therefore, weneed to estimate it somehow. We propose a new type of approximation JAGUAR,that memorizes information from previous iterations and requires$mathcal{O}(1)$ oracle calls. We implement this approximation in theFrank-Wolfe and Gradient Descent algorithms and prove the convergence of thesemethods with different types of zero-order oracle. Our theoretical analysiscovers scenarios of non-convex, convex and PL-condition cases. Also in thispaper, we consider the stochastic minimization problem on the set $Q$ withnoise in the zero-order oracle; this setup is quite unpopular in theliterature, but we prove that the JAGUAR approximation is robust not only indeterministic minimization problems, but also in the stochastic case. Weperform experiments to compare our gradient estimator with those already knownin the literature and confirm the dominance of our methods.
本文讨论的是黑箱优化问题。在这种情况下,我们无法获得目标函数的梯度,因此需要以某种方式对其进行估计。我们提出了一种新的近似方法 JAGUAR,它可以记忆之前迭代的信息,并且只需要调用 $/mathcal{O}(1)$ 神谕。我们在弗兰克-沃尔夫算法和梯度下降算法中实现了这种近似方法,并证明了这些方法在不同类型的零阶神谕下的收敛性。我们的理论分析涵盖了非凸、凸和 PL 条件的情况。在本文中,我们还考虑了零阶甲骨文中带有噪声的集合 $Q$ 上的随机最小化问题;这种设置在文献中很不流行,但我们证明了 JAGUAR 近似不仅在不确定最小化问题上,而且在随机情况下都是稳健的。我们进行了实验,将我们的梯度估计器与文献中已知的梯度估计器进行了比较,并证实了我们方法的优势。
{"title":"New Aspects of Black Box Conditional Gradient: Variance Reduction and One Point Feedback","authors":"Andrey Veprikov, Alexander Bogdanov, Vladislav Minashkin, Alexander Beznosikov","doi":"arxiv-2409.10442","DOIUrl":"https://doi.org/arxiv-2409.10442","url":null,"abstract":"This paper deals with the black-box optimization problem. In this setup, we\u0000do not have access to the gradient of the objective function, therefore, we\u0000need to estimate it somehow. We propose a new type of approximation JAGUAR,\u0000that memorizes information from previous iterations and requires\u0000$mathcal{O}(1)$ oracle calls. We implement this approximation in the\u0000Frank-Wolfe and Gradient Descent algorithms and prove the convergence of these\u0000methods with different types of zero-order oracle. Our theoretical analysis\u0000covers scenarios of non-convex, convex and PL-condition cases. Also in this\u0000paper, we consider the stochastic minimization problem on the set $Q$ with\u0000noise in the zero-order oracle; this setup is quite unpopular in the\u0000literature, but we prove that the JAGUAR approximation is robust not only in\u0000deterministic minimization problems, but also in the stochastic case. We\u0000perform experiments to compare our gradient estimator with those already known\u0000in the literature and confirm the dominance of our methods.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the Hardness of Meaningful Local Guarantees in Nonsmooth Nonconvex Optimization 论非平滑非凸优化中有意义局部保证的难易程度
Pub Date : 2024-09-16 DOI: arxiv-2409.10323
Guy Kornowski, Swati Padmanabhan, Ohad Shamir
We study the oracle complexity of nonsmooth nonconvex optimization, with thealgorithm assumed to have access only to local function information. It hasbeen shown by Davis, Drusvyatskiy, and Jiang (2023) that for nonsmoothLipschitz functions satisfying certain regularity and strictness conditions,perturbed gradient descent converges to local minimizers asymptotically.Motivated by this result and by other recent algorithmic advances in nonconvexnonsmooth optimization concerning Goldstein stationarity, we consider thequestion of obtaining a non-asymptotic rate of convergence to local minima forthis problem class. We provide the following negative answer to this question: Local algorithmsacting on regular Lipschitz functions cannot, in the worst case, providemeaningful local guarantees in terms of function value in sub-exponential time,even when all near-stationary points are global minima. This sharply contrastswith the smooth setting, for which it is well-known that standard gradientmethods can do so in a dimension-independent rate. Our result complements therich body of work in the theoretical computer science literature that providehardness results conditional on conjectures such as $mathsf{P}neqmathsf{NP}$or cryptographic assumptions, in that ours holds unconditional of any suchassumptions.
我们研究了非光滑非凸优化的oracle复杂度,假设算法只能获取局部函数信息。Davis、Drusvyatskiy 和 Jiang(2023 年)已经证明,对于满足特定正则性和严格性条件的非光滑 Lipschitz 函数,扰动梯度下降会渐近地收敛到局部最小值。受这一结果以及非凸非光滑优化中有关 Goldstein 静止性的其他最新算法进展的激励,我们考虑了在这一类问题中获得局部最小值的非渐近收敛率的问题。我们对这个问题给出了如下否定的答案:在最坏的情况下,即使所有近静止点都是全局极小值,作用于正则 Lipschitz 函数的局部算法也无法在亚指数时间内为函数值提供有意义的局部保证。这与光滑设置形成了鲜明对比,众所周知,标准梯度方法可以在与维度无关的时间内做到这一点。我们的结果补充了理论计算机科学文献中的大量工作,这些工作提供了以$mathsf{P}neqmathsf{NP}$等猜想或密码学假设为条件的硬度结果,而我们的结果是在不考虑任何此类假设的情况下成立的。
{"title":"On the Hardness of Meaningful Local Guarantees in Nonsmooth Nonconvex Optimization","authors":"Guy Kornowski, Swati Padmanabhan, Ohad Shamir","doi":"arxiv-2409.10323","DOIUrl":"https://doi.org/arxiv-2409.10323","url":null,"abstract":"We study the oracle complexity of nonsmooth nonconvex optimization, with the\u0000algorithm assumed to have access only to local function information. It has\u0000been shown by Davis, Drusvyatskiy, and Jiang (2023) that for nonsmooth\u0000Lipschitz functions satisfying certain regularity and strictness conditions,\u0000perturbed gradient descent converges to local minimizers asymptotically.\u0000Motivated by this result and by other recent algorithmic advances in nonconvex\u0000nonsmooth optimization concerning Goldstein stationarity, we consider the\u0000question of obtaining a non-asymptotic rate of convergence to local minima for\u0000this problem class. We provide the following negative answer to this question: Local algorithms\u0000acting on regular Lipschitz functions cannot, in the worst case, provide\u0000meaningful local guarantees in terms of function value in sub-exponential time,\u0000even when all near-stationary points are global minima. This sharply contrasts\u0000with the smooth setting, for which it is well-known that standard gradient\u0000methods can do so in a dimension-independent rate. Our result complements the\u0000rich body of work in the theoretical computer science literature that provide\u0000hardness results conditional on conjectures such as $mathsf{P}neqmathsf{NP}$\u0000or cryptographic assumptions, in that ours holds unconditional of any such\u0000assumptions.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254543","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Numerical Analysis for Neumann Optimal Control Problems on Convex Polyhedral Domains 凸多面体域上 Neumann 优化控制问题的数值分析
Pub Date : 2024-09-16 DOI: arxiv-2409.10736
Johannes Pfefferer, Boris Vexler
This paper is concerned with finite element error estimates for Neumannboundary control problems posed on convex and polyhedral domains. Differentdiscretization concepts are considered and for each optimal discretizationerror estimates are established. In particular, for a full discretization withpiecewise linear and globally continuous functions for the control and standardlinear finite elements for the state optimal convergence rates for the controlsare proven which solely depend on the largest interior edge angle. To be moreprecise, below the critical edge angle of $2pi/3$, a convergence rate of two(times a log-factor) can be achieved for the discrete controls in the$L^2$-norm on the boundary. For larger interior edge angles the convergencerates are reduced depending on their size, which is due the impact of singular(domain dependent) terms in the solution. The results are comparable to thosefor the two dimensional case. However, new techniques in this context are usedto prove the estimates on the boundary which also extend to the two dimensionalcase. Moreover, it is shown that the discrete states converge with a rate oftwo in the $L^2$-norm in the domain independent of the interior edge angles,i.e. for any convex and polyhedral domain. It is remarkable that this not onlyholds for a full discretization using piecewise linear and globally continuousfunctions for the control, but also for a full discretization using piecewiseconstant functions for the control, where the discrete controls only convergewith a rate of one in the $L^2$-norm on the boundary at best. At the end, thetheoretical results are confirmed by several numerical experiments.
本文关注在凸域和多面体域上提出的 Neumann 边界控制问题的有限元误差估计。本文考虑了不同的离散化概念,并为每种最佳离散化建立了误差估计。特别是,对于使用片断线性和全局连续函数进行控制的完全离散化,以及使用标准线性有限元进行状态离散化,证明了控制的最优收敛率仅取决于最大内边缘角。更精确地说,在临界边缘角 2pi/3$ 以下,离散控制在边界上的 L^2$ 正则收敛率可达 2(对数因子的 2 倍)。对于较大的内部边缘角,收敛率会根据其大小而降低,这是由于解中奇异(与域相关)项的影响。这些结果与二维情况下的结果相当。然而,在这种情况下,使用了新技术来证明边界上的估计值,这些估计值也扩展到了二维情况。此外,研究还表明,离散状态在与内部边角无关的域中,即在任何凸多面体域中,以 $L^2$ 规范的 2 的速率收敛。值得注意的是,这不仅适用于使用片断线性和全局连续函数进行控制的完全离散化,也适用于使用片断常数函数进行控制的完全离散化,在这种情况下,离散控制在边界上最多只能以 $L^2$-norm 的一收敛率收敛。最后,几个数值实验证实了理论结果。
{"title":"Numerical Analysis for Neumann Optimal Control Problems on Convex Polyhedral Domains","authors":"Johannes Pfefferer, Boris Vexler","doi":"arxiv-2409.10736","DOIUrl":"https://doi.org/arxiv-2409.10736","url":null,"abstract":"This paper is concerned with finite element error estimates for Neumann\u0000boundary control problems posed on convex and polyhedral domains. Different\u0000discretization concepts are considered and for each optimal discretization\u0000error estimates are established. In particular, for a full discretization with\u0000piecewise linear and globally continuous functions for the control and standard\u0000linear finite elements for the state optimal convergence rates for the controls\u0000are proven which solely depend on the largest interior edge angle. To be more\u0000precise, below the critical edge angle of $2pi/3$, a convergence rate of two\u0000(times a log-factor) can be achieved for the discrete controls in the\u0000$L^2$-norm on the boundary. For larger interior edge angles the convergence\u0000rates are reduced depending on their size, which is due the impact of singular\u0000(domain dependent) terms in the solution. The results are comparable to those\u0000for the two dimensional case. However, new techniques in this context are used\u0000to prove the estimates on the boundary which also extend to the two dimensional\u0000case. Moreover, it is shown that the discrete states converge with a rate of\u0000two in the $L^2$-norm in the domain independent of the interior edge angles,\u0000i.e. for any convex and polyhedral domain. It is remarkable that this not only\u0000holds for a full discretization using piecewise linear and globally continuous\u0000functions for the control, but also for a full discretization using piecewise\u0000constant functions for the control, where the discrete controls only converge\u0000with a rate of one in the $L^2$-norm on the boundary at best. At the end, the\u0000theoretical results are confirmed by several numerical experiments.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Local SGD for Near-Quadratic Problems: Improving Convergence under Unconstrained Noise Conditions 近二次元问题的局部 SGD:改善无约束噪声条件下的收敛性
Pub Date : 2024-09-16 DOI: arxiv-2409.10478
Andrey Sadchikov, Savelii Chezhegov, Aleksandr Beznosikov, Alexander Gasnikov
Distributed optimization plays an important role in modern large-scalemachine learning and data processing systems by optimizing the utilization ofcomputational resources. One of the classical and popular approaches is LocalStochastic Gradient Descent (Local SGD), characterized by multiple localupdates before averaging, which is particularly useful in distributedenvironments to reduce communication bottlenecks and improve scalability. Atypical feature of this method is the dependence on the frequency ofcommunications. But in the case of a quadratic target function with homogeneousdata distribution over all devices, the influence of frequency ofcommunications vanishes. As a natural consequence, subsequent studies includethe assumption of a Lipschitz Hessian, as this indicates the similarity of theoptimized function to a quadratic one to some extent. However, in order toextend the completeness of the Local SGD theory and unlock its potential, inthis paper we abandon the Lipschitz Hessian assumption by introducing a newconcept of $textit{approximate quadraticity}$. This assumption gives a newperspective on problems that have near quadratic properties. In addition,existing theoretical analyses of Local SGD often assume bounded variance. We,in turn, consider the unbounded noise condition, which allows us to broaden theclass of studied problems.
分布式优化通过优化计算资源的利用,在现代大型机器学习和数据处理系统中发挥着重要作用。LocalStochastic Gradient Descent(Local SGD)是其中一种经典且流行的方法,其特点是在平均之前进行多次局部更新,在分布式环境中尤其适用,可以减少通信瓶颈,提高可扩展性。这种方法的一个非典型特征是依赖于通信频率。但在所有设备数据分布均匀的二次目标函数情况下,通信频率的影响就消失了。因此,随后的研究自然而然地纳入了 Lipschitz Hessian 假设,因为这在一定程度上表明了优化函数与二次函数的相似性。然而,为了扩展局部 SGD 理论的完整性并释放其潜力,本文通过引入 $textit{approximate quadraticity}$ 的新概念,放弃了 Lipschitz Hessian 假设。这一假设为具有近似二次性质的问题提供了新的视角。此外,现有的局部 SGD 理论分析通常假设方差是有界的。而我们考虑的是无界噪声条件,这使我们能够扩大所研究问题的类别。
{"title":"Local SGD for Near-Quadratic Problems: Improving Convergence under Unconstrained Noise Conditions","authors":"Andrey Sadchikov, Savelii Chezhegov, Aleksandr Beznosikov, Alexander Gasnikov","doi":"arxiv-2409.10478","DOIUrl":"https://doi.org/arxiv-2409.10478","url":null,"abstract":"Distributed optimization plays an important role in modern large-scale\u0000machine learning and data processing systems by optimizing the utilization of\u0000computational resources. One of the classical and popular approaches is Local\u0000Stochastic Gradient Descent (Local SGD), characterized by multiple local\u0000updates before averaging, which is particularly useful in distributed\u0000environments to reduce communication bottlenecks and improve scalability. A\u0000typical feature of this method is the dependence on the frequency of\u0000communications. But in the case of a quadratic target function with homogeneous\u0000data distribution over all devices, the influence of frequency of\u0000communications vanishes. As a natural consequence, subsequent studies include\u0000the assumption of a Lipschitz Hessian, as this indicates the similarity of the\u0000optimized function to a quadratic one to some extent. However, in order to\u0000extend the completeness of the Local SGD theory and unlock its potential, in\u0000this paper we abandon the Lipschitz Hessian assumption by introducing a new\u0000concept of $textit{approximate quadraticity}$. This assumption gives a new\u0000perspective on problems that have near quadratic properties. In addition,\u0000existing theoretical analyses of Local SGD often assume bounded variance. We,\u0000in turn, consider the unbounded noise condition, which allows us to broaden the\u0000class of studied problems.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Controllability and Inverse Problems for Parabolic Systems with Dynamic Boundary Conditions 具有动态边界条件的抛物线系统的可控性和逆问题
Pub Date : 2024-09-16 DOI: arxiv-2409.10302
S. E. Chorfi, L. Maniar
This review surveys previous and recent results on null controllability andinverse problems for parabolic systems with dynamic boundary conditions. We aimto demonstrate how classical methods such as Carleman estimates can be extendedto prove null controllability for parabolic systems and Lipschitz stabilityestimates for inverse problems with dynamic boundary conditions of surfacediffusion type. We mainly focus on the substantial difficulties compared tostatic boundary conditions. Finally, some conclusions and open problems will bementioned.
这篇综述综述了关于具有动态边界条件的抛物线系统的空可控性和逆问题的以往和最新成果。我们旨在证明如何将经典方法(如 Carleman 估计)扩展到证明抛物线系统的空可控性,以及如何证明具有表面扩散类型动态边界条件的逆问题的 Lipschitz 稳定性估计。我们主要关注与静态边界条件相比存在的实质性困难。最后,将提及一些结论和有待解决的问题。
{"title":"Controllability and Inverse Problems for Parabolic Systems with Dynamic Boundary Conditions","authors":"S. E. Chorfi, L. Maniar","doi":"arxiv-2409.10302","DOIUrl":"https://doi.org/arxiv-2409.10302","url":null,"abstract":"This review surveys previous and recent results on null controllability and\u0000inverse problems for parabolic systems with dynamic boundary conditions. We aim\u0000to demonstrate how classical methods such as Carleman estimates can be extended\u0000to prove null controllability for parabolic systems and Lipschitz stability\u0000estimates for inverse problems with dynamic boundary conditions of surface\u0000diffusion type. We mainly focus on the substantial difficulties compared to\u0000static boundary conditions. Finally, some conclusions and open problems will be\u0000mentioned.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data-Driven Output Regulation via Internal Model Principle 通过内部模型原则进行数据驱动的产出监管
Pub Date : 2024-09-15 DOI: arxiv-2409.09571
Liquan Lin, Jie Huang
The data-driven techniques have been developed to deal with the outputregulation problem of unknown linear systems by various approaches. In thispaper, we first extend an existing algorithm from single-input single-outputlinear systems to multi-input multi-output linear systems. Then, by separatingthe dynamics used in the learning phase and the control phase, we furtherpropose an improved algorithm that significantly reduces the computational costand weakens the solvability conditions over the first algorithm.
为解决未知线性系统的输出调节问题,人们开发了多种数据驱动技术。在本文中,我们首先将现有算法从单输入单输出线性系统扩展到多输入多输出线性系统。然后,通过分离学习阶段和控制阶段所使用的动力学,我们进一步提出了一种改进算法,与第一种算法相比,该算法大大降低了计算成本,并弱化了可解性条件。
{"title":"Data-Driven Output Regulation via Internal Model Principle","authors":"Liquan Lin, Jie Huang","doi":"arxiv-2409.09571","DOIUrl":"https://doi.org/arxiv-2409.09571","url":null,"abstract":"The data-driven techniques have been developed to deal with the output\u0000regulation problem of unknown linear systems by various approaches. In this\u0000paper, we first extend an existing algorithm from single-input single-output\u0000linear systems to multi-input multi-output linear systems. Then, by separating\u0000the dynamics used in the learning phase and the control phase, we further\u0000propose an improved algorithm that significantly reduces the computational cost\u0000and weakens the solvability conditions over the first algorithm.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Tie-breaking based Local Search Algorithm for Stable Matching Problems 用于稳定匹配问题的基于打破平局的局部搜索算法
Pub Date : 2024-09-15 DOI: arxiv-2409.10575
Junyuan Qiu
The stable marriage problem with incomplete lists and ties (SMTI) and thehospitals/residents problem with ties (HRT) are important in matching theorywith broad practical applications. In this paper, we introduce a tie-breakingbased local search algorithm (TBLS) designed to achieve a weakly stablematching of maximum size for both the SMTI and HRT problems. TBLS begins byarbitrarily resolving all ties and iteratively refines the tie-breakingstrategy by adjusting the relative order within ties based on preference ranksand the current stable matching. Additionally, we introduce TBLS-E, anequity-focused variant of TBLS, specifically designed for the SMTI problem.This variant maintains the objective of maximizing matching size, whileenhancing equity through two simple modifications. In comparison with ten otherapproximation and local search algorithms, TBLS achieves the highest matchingsize, while TBLS-E exhibits the lowest sex equality cost. Significantly, TBLS-Epreserves a matching size comparable to that of TBLS. Both our algorithmsdemonstrate faster computational speed than other local search algorithms insolving large-sized instances.
具有不完整列表和并列关系的稳定婚姻问题(SMTI)和具有并列关系的医院/居民问题(HRT)是匹配理论中的重要问题,具有广泛的实际应用价值。在本文中,我们介绍了一种基于纽带断裂的局部搜索算法(TBLS),旨在为 SMTI 和 HRT 问题实现最大规模的弱稳定匹配。TBLS 首先任意解决所有平局,然后根据偏好等级和当前的稳定匹配,通过调整平局内的相对顺序迭代改进破局策略。此外,我们还引入了 TBLS-E,它是 TBLS 的一个注重公平的变体,专为 SMTI 问题而设计。该变体保持了匹配规模最大化的目标,同时通过两个简单的修改增强了公平性。与其他十种近似和局部搜索算法相比,TBLS 实现了最大匹配规模,而 TBLS-E 的性别平等成本最低。值得注意的是,TBLS-E 保留了与 TBLS 相当的匹配规模。与其他局部搜索算法相比,我们的两种算法在解决大型实例时都表现出更快的计算速度。
{"title":"A Tie-breaking based Local Search Algorithm for Stable Matching Problems","authors":"Junyuan Qiu","doi":"arxiv-2409.10575","DOIUrl":"https://doi.org/arxiv-2409.10575","url":null,"abstract":"The stable marriage problem with incomplete lists and ties (SMTI) and the\u0000hospitals/residents problem with ties (HRT) are important in matching theory\u0000with broad practical applications. In this paper, we introduce a tie-breaking\u0000based local search algorithm (TBLS) designed to achieve a weakly stable\u0000matching of maximum size for both the SMTI and HRT problems. TBLS begins by\u0000arbitrarily resolving all ties and iteratively refines the tie-breaking\u0000strategy by adjusting the relative order within ties based on preference ranks\u0000and the current stable matching. Additionally, we introduce TBLS-E, an\u0000equity-focused variant of TBLS, specifically designed for the SMTI problem.\u0000This variant maintains the objective of maximizing matching size, while\u0000enhancing equity through two simple modifications. In comparison with ten other\u0000approximation and local search algorithms, TBLS achieves the highest matching\u0000size, while TBLS-E exhibits the lowest sex equality cost. Significantly, TBLS-E\u0000preserves a matching size comparable to that of TBLS. Both our algorithms\u0000demonstrate faster computational speed than other local search algorithms in\u0000solving large-sized instances.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Presolving and cutting planes for the generalized maximal covering location problem 广义最大覆盖位置问题的预分解和切割平面
Pub Date : 2024-09-15 DOI: arxiv-2409.09834
Wei Lv, Cheng-Yang Yu, Jie Liang, Wei-Kun Chen, Yu-Hong Dai
This paper considers the generalized maximal covering location problem(GMCLP) which establishes a fixed number of facilities to maximize the weightedsum of the covered customers, allowing customers' weights to be positive ornegative. The GMCLP can be modeled as a mixed integer programming (MIP)formulation and solved by off-the-shelf MIP solvers. However, due to the largeproblem size and particularly, poor linear programming (LP) relaxation, theGMCLP is extremely difficult to solve by state-of-the-art MIP solvers. Toimprove the computational performance of MIP-based approaches for solvingGMCLPs, we propose customized presolving and cutting plane techniques, whichare the isomorphic aggregation, dominance reduction, and two-customerinequalities. The isomorphic aggregation and dominance reduction can not onlyreduce the problem size but also strengthen the LP relaxation of the MIPformulation of the GMCLP. The two-customer inequalities can be embedded into abranch-and-cut framework to further strengthen the LP relaxation of the MIPformulation on the fly. By extensive computational experiments, we show thatall three proposed techniques can substantially improve the capability of MIPsolvers in solving GMCLPs. In particular, for a testbed of 40 instances withidentical numbers of customers and facilities in the literature, the proposedtechniques enable to provide optimal solutions for 13 previously unsolvedbenchmark instances; for a testbed of 56 instances where the number ofcustomers is much larger than the number of facilities, the proposed techniquescan turn most of them from intractable to easily solvable.
本文研究了广义最大覆盖位置问题(GMCLP),该问题需要建立固定数量的设施,以最大化所覆盖客户的权重总和,允许客户权重为正或负。GMCLP 可以建模为混合整数编程(MIP),并由现成的 MIP 求解器求解。然而,由于问题规模较大,尤其是线性规划(LP)松弛较差,GMCLP 极难用最先进的 MIP 求解器求解。为了提高基于 MIP 的 GMCLP 求解方法的计算性能,我们提出了定制的预解和切割面技术,即同构聚合、支配性还原和双客户等式。同构聚合和支配性还原不仅能缩小问题规模,还能加强对 GMCLP 的 MIP 计算的 LP 松弛。双客户不等式可以嵌入到ranch-and-cut 框架中,以进一步加强 MIPformulation 的动态 LP 松弛。通过大量的计算实验,我们发现所提出的三种技术都能大幅提高 MIPsolvers 解决 GMCLP 的能力。特别是,在由 40 个客户和设施数量与文献中相同的实例组成的测试平台上,所提出的技术能够为 13 个以前未解决的基准实例提供最优解;在由 56 个客户数量远大于设施数量的实例组成的测试平台上,所提出的技术能够将其中大部分实例从难以解决变为可以轻松解决。
{"title":"Presolving and cutting planes for the generalized maximal covering location problem","authors":"Wei Lv, Cheng-Yang Yu, Jie Liang, Wei-Kun Chen, Yu-Hong Dai","doi":"arxiv-2409.09834","DOIUrl":"https://doi.org/arxiv-2409.09834","url":null,"abstract":"This paper considers the generalized maximal covering location problem\u0000(GMCLP) which establishes a fixed number of facilities to maximize the weighted\u0000sum of the covered customers, allowing customers' weights to be positive or\u0000negative. The GMCLP can be modeled as a mixed integer programming (MIP)\u0000formulation and solved by off-the-shelf MIP solvers. However, due to the large\u0000problem size and particularly, poor linear programming (LP) relaxation, the\u0000GMCLP is extremely difficult to solve by state-of-the-art MIP solvers. To\u0000improve the computational performance of MIP-based approaches for solving\u0000GMCLPs, we propose customized presolving and cutting plane techniques, which\u0000are the isomorphic aggregation, dominance reduction, and two-customer\u0000inequalities. The isomorphic aggregation and dominance reduction can not only\u0000reduce the problem size but also strengthen the LP relaxation of the MIP\u0000formulation of the GMCLP. The two-customer inequalities can be embedded into a\u0000branch-and-cut framework to further strengthen the LP relaxation of the MIP\u0000formulation on the fly. By extensive computational experiments, we show that\u0000all three proposed techniques can substantially improve the capability of MIP\u0000solvers in solving GMCLPs. In particular, for a testbed of 40 instances with\u0000identical numbers of customers and facilities in the literature, the proposed\u0000techniques enable to provide optimal solutions for 13 previously unsolved\u0000benchmark instances; for a testbed of 56 instances where the number of\u0000customers is much larger than the number of facilities, the proposed techniques\u0000can turn most of them from intractable to easily solvable.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Introducing DAIMYO: a first-time-right dynamic design architecture and its application to tail-sitter UAS development 介绍 DAIMYO:首次正确动态设计架构及其在尾翼无人机系统开发中的应用
Pub Date : 2024-09-15 DOI: arxiv-2409.09820
Jolan Wauters, Tom Lefebvre, Joris Degroote, Ivo Couckuyt, Guillaume Crevecoeur
In recent years, there has been a notable evolution in variousmultidisciplinary design methodologies for dynamic systems. Among theseapproaches, a noteworthy concept is that of concurrent conceptual and controldesign or co-design. This approach involves the tuning of feedforward and/orfeedback control strategies in conjunction with the conceptual design of thedynamic system. The primary aim is to discover integrated solutions thatsurpass those attainable through a disjointed or decoupled approach. Thisconcurrent design paradigm exhibits particular promise in the context of hybridunmanned aerial systems (UASs), such as tail-sitters, where the objectives ofversatility (driven by control considerations) and efficiency (influenced byconceptual design) often present conflicting demands. Nevertheless, apersistent challenge lies in the potential disparity between the theoreticalmodels that underpin the design process and the real-world operationalenvironment, the so-called reality gap. Such disparities can lead to suboptimalperformance when the designed system is deployed in reality. To address thisissue, this paper introduces DAIMYO, a novel design architecture thatincorporates a high-fidelity environment, which emulates real-world conditions,into the procedure in pursuit of a `first-time-right' design. The outcome ofthis innovative approach is a design procedure that yields versatile andefficient UAS designs capable of withstanding the challenges posed by thereality gap.
近年来,动态系统的各种多学科设计方法有了显著的发展。在这些方法中,一个值得注意的概念是并行概念和控制设计或协同设计。这种方法涉及在动态系统概念设计的同时,调整前馈和/或反馈控制策略。其主要目的是发现超越脱节或分离方法的综合解决方案。这种并行设计范例在混合无人机系统(UASs)(如尾翼飞行器)中尤其有前途,因为在这种系统中,多变性(由控制因素驱动)和效率(受概念设计影响)这两个目标经常会提出相互冲突的要求。然而,持续存在的挑战在于支撑设计过程的理论模型与实际操作环境之间的潜在差距,即所谓的现实差距。当设计的系统在现实中部署时,这种差距可能会导致次优性能。为了解决这个问题,本文介绍了 DAIMYO,这是一种新颖的设计架构,它将模拟真实环境的高保真环境融入到程序中,以追求 "首次正确 "的设计。这种创新方法的成果是一种设计程序,可产生多功能、高效的无人机系统设计,能够应对现实差距带来的挑战。
{"title":"Introducing DAIMYO: a first-time-right dynamic design architecture and its application to tail-sitter UAS development","authors":"Jolan Wauters, Tom Lefebvre, Joris Degroote, Ivo Couckuyt, Guillaume Crevecoeur","doi":"arxiv-2409.09820","DOIUrl":"https://doi.org/arxiv-2409.09820","url":null,"abstract":"In recent years, there has been a notable evolution in various\u0000multidisciplinary design methodologies for dynamic systems. Among these\u0000approaches, a noteworthy concept is that of concurrent conceptual and control\u0000design or co-design. This approach involves the tuning of feedforward and/or\u0000feedback control strategies in conjunction with the conceptual design of the\u0000dynamic system. The primary aim is to discover integrated solutions that\u0000surpass those attainable through a disjointed or decoupled approach. This\u0000concurrent design paradigm exhibits particular promise in the context of hybrid\u0000unmanned aerial systems (UASs), such as tail-sitters, where the objectives of\u0000versatility (driven by control considerations) and efficiency (influenced by\u0000conceptual design) often present conflicting demands. Nevertheless, a\u0000persistent challenge lies in the potential disparity between the theoretical\u0000models that underpin the design process and the real-world operational\u0000environment, the so-called reality gap. Such disparities can lead to suboptimal\u0000performance when the designed system is deployed in reality. To address this\u0000issue, this paper introduces DAIMYO, a novel design architecture that\u0000incorporates a high-fidelity environment, which emulates real-world conditions,\u0000into the procedure in pursuit of a `first-time-right' design. The outcome of\u0000this innovative approach is a design procedure that yields versatile and\u0000efficient UAS designs capable of withstanding the challenges posed by the\u0000reality gap.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimality of Motion Camouflage Under Escape Uncertainty 逃逸不确定性下运动伪装的最优性
Pub Date : 2024-09-15 DOI: arxiv-2409.09890
Mallory Gaspard
Motion camouflage can be a useful tactic for a pursuer attempting to concealtheir true trajectory from their target. Many previous studies determineoptimal trajectories subject to motion camouflage constraints, but theseanalyses do not address when it is optimal to use, nor do they account for thepursuer's inability to predict if and when the target will try to escape. Wepresent an optimal control framework to determine when the pursuer should usemotion camouflage amidst uncertainty in the target's escape attempt time.Focusing on the illustrative problem of a male hover fly pursuing a femalehover fly for mating, we model the female fly's escape response as the resultof a non-homogeneous Poisson point process with a biologically informed ratefunction, and we obtain and numerically solve two Hamilton-Jacobi-Bellman (HJB)PDEs which encode the pursuer's optimal trajectories. Our numerical experimentsand statistics illustrate when it is optimal to use motion camouflage pursuittactics under varying degrees of the target's visual acuity and tolerance tothe pursuer's presence.
运动伪装对于试图向目标隐藏真实轨迹的追击者来说是一种有用的战术。以前的许多研究确定了受运动伪装约束的最佳轨迹,但这些分析并没有解决何时使用运动伪装是最佳选择的问题,也没有考虑到追击者无法预测目标是否以及何时会试图逃跑的情况。我们提出了一个最优控制框架,以确定在目标试图逃跑时间不确定的情况下,追逐者何时应该使用运动伪装。我们将重点放在雄性食蚜蝇追逐雌性食蚜蝇交配的说明性问题上,将雌性食蚜蝇的逃跑反应建模为一个非均质泊松点过程的结果,该过程具有生物学意义上的速率函数,我们得到了两个汉密尔顿-贾可比-贝尔曼(HJB)PDEs,它们编码了追逐者的最优轨迹,并对其进行了数值求解。我们的数值实验和统计数据说明了在目标视觉敏锐度和对追逐者存在的容忍度不同的情况下,何时使用运动伪装追逐策略是最佳的。
{"title":"Optimality of Motion Camouflage Under Escape Uncertainty","authors":"Mallory Gaspard","doi":"arxiv-2409.09890","DOIUrl":"https://doi.org/arxiv-2409.09890","url":null,"abstract":"Motion camouflage can be a useful tactic for a pursuer attempting to conceal\u0000their true trajectory from their target. Many previous studies determine\u0000optimal trajectories subject to motion camouflage constraints, but these\u0000analyses do not address when it is optimal to use, nor do they account for the\u0000pursuer's inability to predict if and when the target will try to escape. We\u0000present an optimal control framework to determine when the pursuer should use\u0000motion camouflage amidst uncertainty in the target's escape attempt time.\u0000Focusing on the illustrative problem of a male hover fly pursuing a female\u0000hover fly for mating, we model the female fly's escape response as the result\u0000of a non-homogeneous Poisson point process with a biologically informed rate\u0000function, and we obtain and numerically solve two Hamilton-Jacobi-Bellman (HJB)\u0000PDEs which encode the pursuer's optimal trajectories. Our numerical experiments\u0000and statistics illustrate when it is optimal to use motion camouflage pursuit\u0000tactics under varying degrees of the target's visual acuity and tolerance to\u0000the pursuer's presence.","PeriodicalId":501286,"journal":{"name":"arXiv - MATH - Optimization and Control","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254541","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
arXiv - MATH - Optimization and Control
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1