首页 > 最新文献

Doklady Mathematics最新文献

英文 中文
Intransitive Sets of Financial Strategies with Constant Levels 常水平财务策略的不可传递集
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562424702387
A. A. Kovalchuk

The phenomenon of intransitivity of trading strategies with constant levels in the stock market is studied. By using Doob’s stopping theorem and basic concepts from probability theory, accurate estimates for the strength of intransitivity are derived for the case of strategies with constant levels.

研究了股票市场中定水平交易策略的不可及性现象。利用Doob停止定理和概率论的基本概念,对具有常阶策略的不可及性强度给出了准确的估计。
{"title":"Intransitive Sets of Financial Strategies with Constant Levels","authors":"A. A. Kovalchuk","doi":"10.1134/S1064562424702387","DOIUrl":"10.1134/S1064562424702387","url":null,"abstract":"<p>The phenomenon of intransitivity of trading strategies with constant levels in the stock market is studied. By using Doob’s stopping theorem and basic concepts from probability theory, accurate estimates for the strength of intransitivity are derived for the case of strategies with constant levels.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S367 - S375"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Models of Optimal Organization of Tax Inspection 税务稽查最优组织模型
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562424602609
A. A. Vasin, N. I. Tsyganov

The problem of optimal organization of state inspection with an honest head and rational auditors is considered. Audit schemes are investigated in which the honest behavior of taxpayers and auditors turns out to be resistant to coalition deviations. In addition to hierarchical structures, a three-stage scheme with cross-checking is considered. It is proved that cross-checking is never optimal. The minimum audit costs for two- and three-level structures are determined. The best option is specified depending on the model parameters.

考虑了一个诚实的领导和理性的审计员的最优国家监察组织问题。本文对审计方案进行了研究,结果表明纳税人和审计师的诚实行为对联盟偏差具有抵抗性。除了分层结构外,还考虑了具有交叉检查的三阶段方案。证明了交叉检验从来都不是最优的。确定了二级和三级结构的最低审计成本。根据模型参数指定最佳选项。
{"title":"Models of Optimal Organization of Tax Inspection","authors":"A. A. Vasin,&nbsp;N. I. Tsyganov","doi":"10.1134/S1064562424602609","DOIUrl":"10.1134/S1064562424602609","url":null,"abstract":"<p>The problem of optimal organization of state inspection with an honest head and rational auditors is considered. Audit schemes are investigated in which the honest behavior of taxpayers and auditors turns out to be resistant to coalition deviations. In addition to hierarchical structures, a three-stage scheme with cross-checking is considered. It is proved that cross-checking is never optimal. The minimum audit costs for two- and three-level structures are determined. The best option is specified depending on the model parameters.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S468 - S472"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716738","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multistage Model for Renewable Resource Extraction by Players of Two Types 两类参与者可再生资源开采的多阶段模型
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562424602592
D. V. Kuzyutin, N. V. Smirnova, I. R. Tantlevskij

The paper examines an infinite-horizon multistage game of renewable resource extraction with two types of players differing in the discount rates of future payoffs. Using the dynamic programming method, we construct a noncooperative solution—a subgame perfect Nash equilibrium in stationary feedback strategies—and a cooperative (Pareto optimal) solution for the case of complete cooperation of all players. The resulting solutions are analyzed for sensitivity to variations in model parameters. In particular, the range of the coefficient of natural resource renewal is found in which a noncooperative solution leads to complete depletion of the resource, while a cooperative scheme allows the players to avoid this negative scenario. A numerical example is given to demonstrate the theoretical results obtained.

本文研究了一个无限视界的多阶段可再生资源开采博弈,其中两类参与者的未来收益贴现率不同。利用动态规划方法,构造了平稳反馈策略下的非合作解——子博弈完美纳什均衡,以及所有参与者完全合作情况下的合作(帕累托最优)解。分析了所得解对模型参数变化的敏感性。特别是,发现了自然资源更新系数的范围,其中非合作解决方案导致资源完全枯竭,而合作方案允许参与者避免这种消极情况。最后通过数值算例验证了理论结果。
{"title":"Multistage Model for Renewable Resource Extraction by Players of Two Types","authors":"D. V. Kuzyutin,&nbsp;N. V. Smirnova,&nbsp;I. R. Tantlevskij","doi":"10.1134/S1064562424602592","DOIUrl":"10.1134/S1064562424602592","url":null,"abstract":"<p>The paper examines an infinite-horizon multistage game of renewable resource extraction with two types of players differing in the discount rates of future payoffs. Using the dynamic programming method, we construct a noncooperative solution—a subgame perfect Nash equilibrium in stationary feedback strategies—and a cooperative (Pareto optimal) solution for the case of complete cooperation of all players. The resulting solutions are analyzed for sensitivity to variations in model parameters. In particular, the range of the coefficient of natural resource renewal is found in which a noncooperative solution leads to complete depletion of the resource, while a cooperative scheme allows the players to avoid this negative scenario. A numerical example is given to demonstrate the theoretical results obtained.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S445 - S451"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716734","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large Language Models in Cyberattacks 网络攻击中的大型语言模型
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562425700012
S. V. Lebed, D. E. Namiot, E. V. Zubareva, P. V. Khenkin, A. A. Vorobeva, D. A. Svichkar

The article provides an overview of the practice of using large language models (LLMs) in cyberattacks. Artificial intelligence models (machine learning and deep learning) are applied across various fields, with cybersecurity being no exception. One aspect of this usage is offensive artificial intelligence, specifically in relation to LLMs. Generative models, including LLMs, have been utilized in cybersecurity for some time, primarily for generating adversarial attacks on machine learning models. The analysis focuses on how LLMs, such as ChatGPT, can be exploited by malicious actors to automate the creation of phishing emails and malware, significantly simplifying and accelerating the process of conducting cyberattacks. Key aspects of LLM usage are examined, including text generation for social engineering attacks and the creation of malicious code. The article is aimed at cybersecurity professionals, researchers, and LLM developers, providing them with insights into the risks associated with the malicious use of these technologies and recommendations for preventing their exploitation as cyber weapons. The research emphasizes the importance of recognizing potential threats and the need for active countermeasures against automated cyberattacks.

本文概述了在网络攻击中使用大型语言模型(llm)的实践。人工智能模型(机器学习和深度学习)应用于各个领域,网络安全也不例外。这种用法的一个方面是攻击性人工智能,特别是与法学硕士相关的人工智能。包括法学硕士在内的生成模型已经在网络安全领域使用了一段时间,主要用于对机器学习模型产生对抗性攻击。分析的重点是llm(如ChatGPT)如何被恶意行为者利用来自动创建网络钓鱼电子邮件和恶意软件,从而大大简化和加速进行网络攻击的过程。法学硕士使用的关键方面进行了检查,包括社会工程攻击的文本生成和恶意代码的创建。本文针对网络安全专业人员、研究人员和法学硕士开发人员,为他们提供与恶意使用这些技术相关的风险的见解,以及防止其被利用为网络武器的建议。该研究强调了识别潜在威胁的重要性,以及对自动网络攻击采取主动对策的必要性。
{"title":"Large Language Models in Cyberattacks","authors":"S. V. Lebed,&nbsp;D. E. Namiot,&nbsp;E. V. Zubareva,&nbsp;P. V. Khenkin,&nbsp;A. A. Vorobeva,&nbsp;D. A. Svichkar","doi":"10.1134/S1064562425700012","DOIUrl":"10.1134/S1064562425700012","url":null,"abstract":"<p>The article provides an overview of the practice of using large language models (LLMs) in cyberattacks. Artificial intelligence models (machine learning and deep learning) are applied across various fields, with cybersecurity being no exception. One aspect of this usage is offensive artificial intelligence, specifically in relation to LLMs. Generative models, including LLMs, have been utilized in cybersecurity for some time, primarily for generating adversarial attacks on machine learning models. The analysis focuses on how LLMs, such as ChatGPT, can be exploited by malicious actors to automate the creation of phishing emails and malware, significantly simplifying and accelerating the process of conducting cyberattacks. Key aspects of LLM usage are examined, including text generation for social engineering attacks and the creation of malicious code. The article is aimed at cybersecurity professionals, researchers, and LLM developers, providing them with insights into the risks associated with the malicious use of these technologies and recommendations for preventing their exploitation as cyber weapons. The research emphasizes the importance of recognizing potential threats and the need for active countermeasures against automated cyberattacks.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S510 - S520"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Intransitively Winning Chess Players’ Positions 非传递性地赢得棋手的位置
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562424702417
A. Poddiakov

Chess players’ positions in intransitive (rock-paper-scissors) relations are considered. Intransitivity of chess players’ positions means that: position A of White is preferable (it should be chosen if choice is possible) to position B of Black, if A and B are on a chessboard; position B of Black is preferable to position C of White, if B and C are on the chessboard; position C of White is preferable to position D of Black, if C and D are on the chessboard; but position D of Black is preferable to position A of White, if A and D are on the chessboard. Intransitivity of winningness of chess players’ positions is considered to be a consequence of complexity of the chess environment—in contrast with simpler games with transitive positions only. The space of relations between winningness of chess players’ positions is non-Euclidean. The Zermelo-von Neumann theorem is complemented by statements about possibility vs. impossibility of building pure winning strategies based on the assumption of transitivity of players’ positions. Questions about the possibility of intransitive players’ positions in other positional games are raised.

象棋选手在不及物关系(石头-剪刀-布)中的位置被考虑。棋手位置的不可及性意味着:如果A和B在一个棋盘上,白棋的位置A比黑棋的位置B更可取(如果可能的话,应该选择A);如果棋盘上有B和C,黑棋的位置B比白棋的位置C更可取;如果棋盘上有C和D,白棋的C位置比黑棋的D位置更可取;但如果棋盘上有A和D,黑棋的D位置比白棋的A位置更可取。与只有传递位置的简单游戏相比,棋手获胜的非传递性被认为是国际象棋环境复杂性的结果。棋手的胜负关系空间是非欧几里得的。Zermelo-von Neumann定理还补充了基于玩家位置传递性假设而构建纯粹获胜策略的可能性与不可能性。对其他位置博弈中不及物棋手位置的可能性提出了疑问。
{"title":"Intransitively Winning Chess Players’ Positions","authors":"A. Poddiakov","doi":"10.1134/S1064562424702417","DOIUrl":"10.1134/S1064562424702417","url":null,"abstract":"<p>Chess players’ positions in intransitive (rock-paper-scissors) relations are considered. Intransitivity of chess players’ positions means that: position A of White is preferable (it should be chosen if choice is possible) to position B of Black, if A and B are on a chessboard; position B of Black is preferable to position C of White, if B and C are on the chessboard; position C of White is preferable to position D of Black, if C and D are on the chessboard; but position D of Black is preferable to position A of White, if A and D are on the chessboard. Intransitivity of winningness of chess players’ positions is considered to be a consequence of complexity of the chess environment—in contrast with simpler games with transitive positions only. The space of relations between winningness of chess players’ positions is non-Euclidean. The Zermelo-von Neumann theorem is complemented by statements about possibility <i>vs</i>. impossibility of building pure winning strategies based on the assumption of transitivity of players’ positions. Questions about the possibility of intransitive players’ positions in other positional games are raised.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S391 - S398"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How to Maximize the Total Strength of Survivors in a Battle and Tournament in Gladiator Game Models 如何在角斗士游戏模式的战斗和锦标赛中最大化幸存者的总力量
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562424602725
M. A. Khodiakova

In 1984, Kaminsky, Luks, and Nelson formulated the gladiator game model of two teams with given strengths. Suppose that a team wants to maximize its expected strength at the end of a battle. We consider an optimization problem: how to distribute the team’s strength among its gladiators. In the above we suppose that the teams distribute their strengths at the beginning of a battle. We also consider Nash equilibria when the teams may change gladiators’ strengths before every fight. We consider two cases. In both, the first team wants to maximize its strength. The second team wants to maximize its strength too in the first case or wants to minimize the first team’s strength in the second case.

在1984年,Kaminsky, Luks和Nelson提出了角斗士游戏模型,即两个具有特定优势的团队。假设一个团队希望在战斗结束时最大化其预期力量。我们考虑一个优化问题:如何在角斗士之间分配团队的力量。在上面的例子中,我们假设两支队伍在战斗开始时分配他们的力量。我们还考虑纳什均衡,当团队在每次战斗前可能会改变角斗士的力量。我们考虑两种情况。在这两种情况下,一线队都希望最大限度地发挥自己的实力。在第一种情况下,第二支队伍想要最大化自己的实力,或者在第二种情况下,想要最小化第一支队伍的实力。
{"title":"How to Maximize the Total Strength of Survivors in a Battle and Tournament in Gladiator Game Models","authors":"M. A. Khodiakova","doi":"10.1134/S1064562424602725","DOIUrl":"10.1134/S1064562424602725","url":null,"abstract":"<p>In 1984, Kaminsky, Luks, and Nelson formulated the gladiator game model of two teams with given strengths. Suppose that a team wants to maximize its expected strength at the end of a battle. We consider an optimization problem: how to distribute the team’s strength among its gladiators. In the above we suppose that the teams distribute their strengths at the beginning of a battle. We also consider Nash equilibria when the teams may change gladiators’ strengths before every fight. We consider two cases. In both, the first team wants to maximize its strength. The second team wants to maximize its strength too in the first case or wants to minimize the first team’s strength in the second case.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S452 - S462"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic Models of Competition and Cooperation in Cournot Oligopoly Taking into Account the Environmental Impact 考虑环境影响的古诺寡头竞争与合作动态模型
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562424602610
P. D. Demchuk, A. V. Korolev, G. A. Ugolnitsky

The basic model of the Cournot oligopoly taking into account competition-cooperation and environmental pollution as a differential game in a normal form is described. The numerical analysis for independent and cooperative behavior is carried out for an example used in the future. Games in the form of the characteristic von Neumann–Morgenstern, Petrosyan–Zaccour, and Gromova–Petrosyan functions are constructed, and the Shapley values are calculated. Hierarchical games with information regulations for direct and reverse Stackelberg games are analyzed, payoffs’ comparative analysis for all methods of organization is provided. All the results are presented for the dynamic game with three players.

本文描述了古诺寡头垄断的基本模型,将竞争-合作和环境污染作为一种标准形式的微分博弈来考虑。并对独立行为和合作行为进行了数值分析。构造了特征von Neumann-Morgenstern、Petrosyan-Zaccour和Gromova-Petrosyan函数形式的博弈,并计算了Shapley值。分析了具有信息规则的直接和反向Stackelberg博弈的层次博弈,并对各种组织方式的收益进行了比较分析。本文给出了三人动态博弈的所有结果。
{"title":"Dynamic Models of Competition and Cooperation in Cournot Oligopoly Taking into Account the Environmental Impact","authors":"P. D. Demchuk,&nbsp;A. V. Korolev,&nbsp;G. A. Ugolnitsky","doi":"10.1134/S1064562424602610","DOIUrl":"10.1134/S1064562424602610","url":null,"abstract":"<p>The basic model of the Cournot oligopoly taking into account competition-cooperation and environmental pollution as a differential game in a normal form is described. The numerical analysis for independent and cooperative behavior is carried out for an example used in the future. Games in the form of the characteristic von Neumann–Morgenstern, Petrosyan–Zaccour, and Gromova–Petrosyan functions are constructed, and the Shapley values are calculated. Hierarchical games with information regulations for direct and reverse Stackelberg games are analyzed, payoffs’ comparative analysis for all methods of organization is provided. All the results are presented for the dynamic game with three players.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S473 - S486"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic Models of Competition with Endogenous Network Formation: The Case of Constant Output 具有内生网络形成的动态竞争模型:以恒定产出为例
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-28 DOI: 10.1134/S1064562424702375
V. A. Kochevadov, A. A. Sedakov

The paper examines discrete-time network models of competition with a finite planning horizon. Firms produce a homogeneous product in constant quantities and sell it in a common market. In a nonterminal period, the behavior of each firm is characterized by a multicomponent profile that includes, among other things, the amount of investment and the structure of bilateral links with partner firms. The latter affects the technological state of the firm and allows it to reduce its current costs. The endogenous structure of partner firms is described by a network. For the models under study, an open-loop Nash equilibrium is characterized.

本文研究具有有限规划视界的离散时间竞争网络模型。企业以恒定的数量生产同质产品,并在共同市场上销售。在非终结期,每个企业的行为都具有多要素特征,其中包括投资额和与合作伙伴企业的双边关系结构。后者影响企业的技术状态,使其能够降低当前成本。伙伴企业的内生结构用网络来描述。对于所研究的模型,具有开环纳什均衡的特征。
{"title":"Dynamic Models of Competition with Endogenous Network Formation: The Case of Constant Output","authors":"V. A. Kochevadov,&nbsp;A. A. Sedakov","doi":"10.1134/S1064562424702375","DOIUrl":"10.1134/S1064562424702375","url":null,"abstract":"<p>The paper examines discrete-time network models of competition with a finite planning horizon. Firms produce a homogeneous product in constant quantities and sell it in a common market. In a nonterminal period, the behavior of each firm is characterized by a multicomponent profile that includes, among other things, the amount of investment and the structure of bilateral links with partner firms. The latter affects the technological state of the firm and allows it to reduce its current costs. The endogenous structure of partner firms is described by a network. For the models under study, an open-loop Nash equilibrium is characterized.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 2 supplement","pages":"S357 - S366"},"PeriodicalIF":0.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143716947","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Zero Order Algorithm for Decentralized Optimization Problems 分散优化问题的零阶算法
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-22 DOI: 10.1134/S1064562424602336
A. S. Veprikov, E. D. Petrov, G. V. Evseev, A. N. Beznosikov

In this paper we consider a distributed optimization problem in the black-box formulation. This means that the target function   f is decomposed into the sum of (n) functions ({{f}_{i}}), where (n) is the number of workers, it is assumed that each worker has access only to the zero-order noisy oracle, i.e., only to the values of ({{f}_{i}}(x)) with added noise. In this paper, we propose a new method ZO-MARINA based on the state-of-the-art distributed optimization algorithm MARINA. In particular, the following modifications are made to solve the problem in the black-box formulation: (i) we use approximations of the gradient instead of the true value, (ii) the difference of two approximated gradients at some coordinates is used instead of the compression operator. In this paper, a theoretical convergence analysis is provided for non-convex functions and functions satisfying the PL condition. The convergence rate of the proposed algorithm is correlated with the results for the algorithm that uses the first-order oracle. The theoretical results are validated in computational experiments to find optimal hyperparameters for the Resnet-18 neural network, that is trained on the CIFAR-10 dataset and the SVM model on the LibSVM library dataset and on the Mnist-784 dataset.

本文考虑了黑箱公式中的一个分布式优化问题。这意味着目标函数f被分解为(n)函数({{f}_{i}})的和,其中(n)是工作人员的数量,假设每个工作人员只能访问零阶有噪声的oracle,即只能访问带有附加噪声的({{f}_{i}}(x))的值。本文在最先进的分布式优化算法MARINA的基础上,提出了一种新的算法ZO-MARINA。特别地,为了解决黑箱公式中的问题,我们做了以下修改:(i)我们使用梯度的近似值而不是真值,(ii)使用两个近似梯度在某些坐标处的差值而不是压缩算子。本文给出了非凸函数和满足PL条件的函数的理论收敛性分析。该算法的收敛速度与使用一阶oracle的算法的结果相关。利用CIFAR-10数据集和LibSVM库数据集和mist -784数据集上的SVM模型对Resnet-18神经网络进行训练,并通过计算实验验证了理论结果,找到了最优超参数。
{"title":"Zero Order Algorithm for Decentralized Optimization Problems","authors":"A. S. Veprikov,&nbsp;E. D. Petrov,&nbsp;G. V. Evseev,&nbsp;A. N. Beznosikov","doi":"10.1134/S1064562424602336","DOIUrl":"10.1134/S1064562424602336","url":null,"abstract":"<p>In this paper we consider a distributed optimization problem in the black-box formulation. This means that the target function   <i>f</i> is decomposed into the sum of <span>(n)</span> functions <span>({{f}_{i}})</span>, where <span>(n)</span> is the number of workers, it is assumed that each worker has access only to the zero-order noisy oracle, i.e., only to the values of <span>({{f}_{i}}(x))</span> with added noise. In this paper, we propose a new method <span>ZO-MARINA</span> based on the state-of-the-art distributed optimization algorithm <i><span>MARINA</span></i>. In particular, the following modifications are made to solve the problem in the black-box formulation: (i) we use approximations of the gradient instead of the true value, (ii) the difference of two approximated gradients at some coordinates is used instead of the compression operator. In this paper, a theoretical convergence analysis is provided for non-convex functions and functions satisfying the PL condition. The convergence rate of the proposed algorithm is correlated with the results for the algorithm that uses the first-order oracle. The theoretical results are validated in computational experiments to find optimal hyperparameters for the Resnet-18 neural network, that is trained on the CIFAR-10 dataset and the SVM model on the LibSVM library dataset and on the Mnist-784 dataset.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 1 supplement","pages":"S261 - S277"},"PeriodicalIF":0.5,"publicationDate":"2025-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1134/S1064562424602336.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143676487","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Heterogeneous Computational Scheduling Using Adaptive Neural Hyper-Heuristic 基于自适应神经超启发式的异构计算调度
IF 0.5 4区 数学 Q3 MATHEMATICS Pub Date : 2025-03-22 DOI: 10.1134/S106456242460221X
A. Allahverdyan, A. Zhadan, I. Kondratov, O. Petrosian, A. Romanovskii, V. Kharin, Yin Li

In heterogeneous computing environments, efficiently scheduling tasks, especially those forming Directed Acyclic Graphs (DAGs), is critical. This is particularly true for various Cloud and Edge computing tasks, as well as training Large Language Models (LLMs). This paper introduces a new scheduling approach using an Adaptive Neural Hyper-heuristic. By integrating a neural network trained with genetic algorithms, our method aims to minimize makespan. The approach uses a two-level algorithm: the first level prioritizes tasks using adaptive heuristic and the second level assigns resources based on the Earliest Finish Time (EFT) algorithm. Our tests show that this method significantly improves over traditional scheduling heuristics and other machine learning-based approaches. It reduces the makespan by 6.7% for small-scale DAGs and 28.49% for large-scale DAGs compared to the leading DONF algorithm. Additionally, it achieves a proximity of 84.08% to 96.43% to the optimal solutions found using Mixed-Integer Linear Programming (MILP), demonstrating its effectiveness in diverse computational settings.

在异构计算环境中,高效调度任务,尤其是那些形成有向无环图(DAG)的任务,至关重要。对于各种云计算和边缘计算任务以及大型语言模型(LLM)的训练而言,尤其如此。本文介绍了一种使用自适应神经超启发式的新调度方法。通过将经过遗传算法训练的神经网络整合在一起,我们的方法旨在最大限度地减少时间跨度。该方法使用两级算法:第一级使用自适应启发式确定任务的优先级,第二级根据最早完成时间(EFT)算法分配资源。我们的测试表明,与传统的调度启发式方法和其他基于机器学习的方法相比,这种方法有明显改善。与领先的 DONF 算法相比,小规模 DAG 的 makepan 降低了 6.7%,大规模 DAG 的 makespan 降低了 28.49%。此外,它还实现了 84.08% 至 96.43% 的接近度,接近于使用混合整数线性规划(MILP)找到的最优解,证明了它在各种计算环境中的有效性。
{"title":"Heterogeneous Computational Scheduling Using Adaptive Neural Hyper-Heuristic","authors":"A. Allahverdyan,&nbsp;A. Zhadan,&nbsp;I. Kondratov,&nbsp;O. Petrosian,&nbsp;A. Romanovskii,&nbsp;V. Kharin,&nbsp;Yin Li","doi":"10.1134/S106456242460221X","DOIUrl":"10.1134/S106456242460221X","url":null,"abstract":"<p>In heterogeneous computing environments, efficiently scheduling tasks, especially those forming Directed Acyclic Graphs (DAGs), is critical. This is particularly true for various Cloud and Edge computing tasks, as well as training Large Language Models (LLMs). This paper introduces a new scheduling approach using an Adaptive Neural Hyper-heuristic. By integrating a neural network trained with genetic algorithms, our method aims to minimize makespan. The approach uses a two-level algorithm: the first level prioritizes tasks using adaptive heuristic and the second level assigns resources based on the Earliest Finish Time (EFT) algorithm. Our tests show that this method significantly improves over traditional scheduling heuristics and other machine learning-based approaches. It reduces the makespan by 6.7% for small-scale DAGs and 28.49% for large-scale DAGs compared to the leading DONF algorithm. Additionally, it achieves a proximity of 84.08% to 96.43% to the optimal solutions found using Mixed-Integer Linear Programming (MILP), demonstrating its effectiveness in diverse computational settings.</p>","PeriodicalId":531,"journal":{"name":"Doklady Mathematics","volume":"110 1 supplement","pages":"S151 - S161"},"PeriodicalIF":0.5,"publicationDate":"2025-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1134/S106456242460221X.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143676271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Doklady Mathematics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1